#
Competition

Calculating excitation gaps of small molecules (ES-Gap)

## Recent updates

- 2019-08-06
- Competition opens and initial records are added.

## Competition summary

Participants are asked to calculate excitation energies of small molecules with various configurations. The result is evaluated as an average of relative errors between the submitted values of the gap calculated by quantum algorithms/methods and those by exact calculations.

## Background information

### Quantum Chemistry

See `Background information`

of the similar problem.
Again, we treat only electrons as quantum-mechanical objects and leave nuclei of a molecule as classical in this competition.

### Excited state and excitations energy

Eigenstates of Hamiltonian of a molecular system other than the ground state (lowest-energy eigenstate) are called excited states. The excited states slightly above the ground state (i.e. eigenstates whose eigenenergies are close to the ground state energy) are important to know the chemical properties of the system such as

- absorption/fluorescence spectrum of molecules,
- photon-induced chemical reactions,
- charge/energy transfer transition.

Those properties have several industrial interests as well as academic ones: for example, the absorption/fluorescence spectrum is critical to design organic electro-luminescence materials. However, calculation of excited states is typically by far difficult than that of the ground state.

Noisy Intermediate-Scale Quantum (NISQ) devices are again a nice candidate to overcome the difficulty. As an extension of the algorithm to compute the ground state, several algorithms for computing excited states are proposed. Interested readers can refer our brief introduction on several methods and the references therein.

## Purpose of competition

This competition aims to search promising quantum algorithms/methods on NISQ devices for computing the excited states of molecules. As is the same with the competition for the ground states, this competition considers only small molecules that one can calculate exact results by classical computers. Benchmarking precision of quantum algorithms/methods will still be a useful milestone when we apply them to larger molecules that cannot be calculated by classical computers.

## Evaluation

In this competition, participants calculate the first excitation gap of in the singlet sector (total spin $S^2=0$) of energy spectrum of the molecules specified in `Competition_ES-Gap.csv`

, https://github.com/qulacs/Quantaggle_dataset/tree/master/competitions/ES-Gap/.
Evaluation is done by the following score $z$,

$$ z=\frac{1}{N}\sum_m\left(\frac{1}{N_m}\sum_{i=1}^{N_m}\frac{|\Delta_{QC}^m(R^m_i)-\Delta_{FCI}^m(R^m_i)|}{|\Delta_{FCI}^m(R^m_i)|}\right), $$ $$ \Delta_{QC,FCI}^m(R)=ES_{QC,FCI}^m(R)-GS_{QC,FCI}^m(R). $$

Here we use the notations

- $N$ is the number of molecules in the dataset
- $N_m$ is the number of data points (configurations) of each molecule $m$
- $R_i^m$ is a coordinate of data point $i$ of molecule $m$
- $GS_{QC(FCI)}^m(R)$ is the ground state energy of molecule $m$ at coordinate $R$ calculated by quantum algorithms/methods (exact diagonalization = full configuration interaction (FCI)) of the Hamiltonian
- $ES_{QC(FCI)}^m(R)$ is the 1st excited state energy of the molecule $m$ at coordinate $R$ in the singlet (total spin $S^2=0$) sector calculated by quantum algorithms/methods (FCI).

In short, we evaluate the score by an average of the relative errors between the energy gaps calculated by quantum algorithms/methods and those by exact diagonalization.

Moreover, we consider four cases separately according to the way we simulate the result of the quantum algorithm. The definition can be found here.

- Case 1: Expectation value
- Case 2: Sampling without noise
- Case 3: Sampling with noise
- Case 4: Real NISQ devices

## Dataset

Dataset for this competition is based on `Small_Molecules_1`

dataset, which is available on this Github page https://github.com/qulacs/Quantaggle_dataset/tree/master/datasets/Small_Molecules_1.
The molecules is the same as those in the competition for the potential energy surface for small molecules,

- H
_{2}/ H_{4}/ H_{6}molecules with linear geometry and ring geometry - LiH
- BeH
_{2} - H
_{2}O

Molecule | Bond length | Total # of points |
---|---|---|

$\rm H_2$ | `r=0.5, 0.6, ..., 2.0` |
16 |

$\rm H_4$ (line) | `r=0.5, 0.6, ..., 2.0` |
16 |

$\rm H_6$ (line) | `r=0.5, 0.6, ..., 2.0` |
16 |

$\rm H_4$ (ring) | `r=0.5, 0.6, ..., 2.0` |
16 |

$\rm H_6$ (ring) | `r=0.5, 0.6, ..., 2.0` |
16 |

$\rm LiH$ | `r=0.5, 0.6, ..., 2.0` |
16 |

$\rm BeH_2$ | `r=0.5, 0.6, ..., 2.0` |
16 |

$\rm H_2O$ | `r=0.5, 0.6, ..., 2.0` , `angle = 104.5 deg` |
16 |

Here, H_{n} (line) denotes the molecule where $n$ hydrogen atoms are aligned in line and have the same distance between each adjacent atom.
For H_{n} (ring), $n$ hydrogen atoms are placed on the circle with the same adjacent bond length.
Two bond lengths of `Be-H`

in BeH_{2} are taken as the same and all atoms are aligned in line.
The angle of two `O-H`

bonds in H_{2}O is taken as 104.5 degree and each bond length is taken as the same.

All data contained in `Small_Molecules_1`

dataset are `openfermion.hamiltonian.MolecularData`

class in `.hdf5`

format [1].
We prepare `Competition_ES-Gap.csv`

at https://github.com/qulacs/Quantaggle_dataset/tree/master/competitions/ES-Gap/ that specifies the names of files to be computed in this competition.
To ease calculations of the score, we also put a Python script at https://github.com/qulacs/Quantaggle_dataset/tree/master/competitions/ES-Gap/ that calculates the score from the csv: participants have only to fill `qc_energy_0`

column and `qc_energy_1`

column in the csv by the obtained ground state energy and the excited state energy.

For further details of the dataset, See `README.md`

of the dataset directory, https://github.com/qulacs/Quantaggle_dataset/tree/master/datasets/Small_Molecules_1.

## Submission Guide

- We accept submission in the form of
`Competition_ES-Gap.csv`

at https://github.com/qulacs/Quantaggle_dataset/tree/master/competitions/ES-Gap, whose`qc_energy_0`

column and`qc_energy_1`

column are filled. We are happy if you also submit the script used for calculations. - We also accept submission in the form of programming codes, since benchmarking all points in the dataset needs relatively large computational power for personal computers. We will run the submitted code and add the records of it. We recommend the codes are written in Python with Qulacs, but use of any language/library is considered.

## Competition host and contact

- Host: QunaSys Inc.
- Contact: contact form

## Reference

[1] Preparation of molecular data is performed by PySCF, OpenFermion, OpenFermion-PySCF.

## Current result

### Case 1: Expectation value

Rank | Author | Method | Score | Mean # of func. eval. | Date |
---|---|---|---|---|---|

1 | QunaSys | VQD, SymmetryPreserving-20, BFGS, jordan-wigner | 0.369094 | 94376.953 | 20191004 |

2 | QunaSys | MCVQE, SymmetryPreserving-20, BFGS, jordan-wigner | 0.554986 | 34208.750 | 20191004 |

3 | QunaSys | QSE, HardwareEfficient-5, SMO, jordan-wigner | 0.720857 | nan | 20190801 |

4 | QunaSys | QSE, HardwareEfficient-5, BFGS, jordan-wigner | 0.723876 | nan | 20190801 |

5 | QunaSys | VQD, UCCSD, BFGS, jordan-wigner | 1.107189 | 1426.891 | 20191004 |

6 | QunaSys | MCVQE, UCCSD, BFGS, jordan-wigner | 1.427822 | 675.141 | 20191004 |

7 | QunaSys | VQD, HardwareEfficient-8, BFGS, jordan-wigner | 1.553515 | 20218.672 | 20191005 |

8 | QunaSys | SSVQE, UCCSD, SMO, jordan-wigner, cis | 1.577729 | 1177.328 | 20190730 |

9 | QunaSys | QSE, UCCSD, BFGS, jordan-wigner | 1.598058 | nan | 20190801 |

10 | QunaSys | SSVQE, UCCSD, BFGS, jordan-wigner | 1.617397 | 721.469 | 20191004 |

11 | QunaSys | MCVQE, HardwareEfficient-8, BFGS, jordan-wigner | 3.615655 | 15593.281 | 20191005 |

12 | QunaSys | QSE, UCCSD, SMO, jordan-wigner | 9.342742 | nan | 20190801 |

### Case 2: Sampling without noise

To be benchmarked!

### Case 3: Sampling with noise

To be benchmarked!

### Case 4: Real NISQ devices

To be benchmarked!