Samuel Yen-Chi Chen
ABSTRACT
This paper presents a quantum architecture search (QAS) framework using quantum reinforcement learning (QRL) to generate quantum gate sequences for multi-qubit GHZ states. The proposed framework employs the asynchronous advantage actor-critic (A3C) algorithm to optimize the QRL agent, which has access to Pauli-X, Y, Z expectation values and a predefined set of quantum operations. Our approach does not require any prior knowledge of quantum physics. The framework can be used with other QRL architectures or optimization methods to explore gate synthesis and compilation for various quantum states.
- Kishor Bharti, Alba Cervera-Lierta, Thi Ha Kyaw, Tobias Haug, Sumner Alperin-Lea, Abhinav Anand, Matthias Degroote, Hermanni Heimonen, Jakob S Kottmann, Tim Menke, et al. 2022. Noisy intermediate-scale quantum algorithms. Reviews of Modern Physics, Vol. 94, 1 (2022), 015004.Google Scholar
Cross Ref
- Mahdi Chehimi and Walid Saad. 2022. Quantum federated learning with quantum data. In ICASSP 2022--2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 8617--8621.Google ScholarCross Ref
- Chuangtao Chen, Zhimin He, Shenggen Zheng, Yan Zhou, and Haozhen Situ. 2022b. Generating the optimal structures for parameterized quantum circuits by a meta-trained graph variational autoencoder. arXiv preprint arXiv:2201.03309 (2022).Google Scholar
- Samuel Yen-Chi Chen. 2022. Quantum deep recurrent reinforcement learning. arXiv preprint arXiv:2210.14876 (2022).Google Scholar
- Samuel Yen-Chi Chen. 2023. Asynchronous training of quantum reinforcement learning. arXiv preprint arXiv:2301.05096 (2023).Google Scholar
- Samuel Yen-Chi Chen, Daniel Fry, Amol Deshmukh, Vladimir Rastunkov, and Charlee Stefanski. 2022a. Reservoir Computing via Quantum Recurrent Neural Networks. arXiv preprint arXiv:2211.02612 (2022).Google Scholar
- Samuel Yen-Chi Chen, Chih-Min Huang, Chia-Wei Hsing, Hsi-Sheng Goan, and Ying-Jer Kao. 2022c. Variational quantum reinforcement learning via evolutionary optimization. Machine Learning: Science and Technology, Vol. 3, 1 (2022), 015025.Google ScholarCross Ref
- Samuel Yen-Chi Chen, Chih-Min Huang, Chia-Wei Hsing, and Ying-Jer Kao. 2021. An end-to-end trainable hybrid classical-quantum classifier. Machine Learning: Science and Technology, Vol. 2, 4 (2021), 045021.Google ScholarCross Ref
- Samuel Yen-Chi Chen, Chao-Han Huck Yang, Jun Qi, Pin-Yu Chen, Xiaoli Ma, and Hsi-Sheng Goan. 2020. Variational quantum circuits for deep reinforcement learning. IEEE Access, Vol. 8 (2020), 141007--141024.Google ScholarCross Ref
- Samuel Yen-Chi Chen and Shinjae Yoo. 2021. Federated quantum machine learning. Entropy, Vol. 23, 4 (2021), 460.Google ScholarCross Ref
- Samuel Yen-Chi Chen, Shinjae Yoo, and Yao-Lung L Fang. 2022d. Quantum long short-term memory. In ICASSP 2022--2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 8622--8626.Google ScholarCross Ref
- Riccardo Di Sipio, Jia-Hong Huang, Samuel Yen-Chi Chen, Stefano Mangini, and Marcel Worring. 2022. The dawn of quantum natural language processing. In ICASSP 2022--2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 8612--8616.Google ScholarCross Ref
- Li Ding and Lee Spector. 2022. Evolutionary quantum architecture search for parametrized quantum circuits. In Proceedings of the Genetic and Evolutionary Computation Conference Companion. 2190--2195.Google ScholarDigital Library
- Trong Duong, Sang T Truong, Minh Tam, Bao Bach, Ju-Young Ryu, and June-Koo Kevin Rhee. 2022. Quantum Neural Architecture Search with Quantum Circuits Metric and Bayesian Optimization. arXiv preprint arXiv:2206.14115 (2022).Google Scholar
- Thomas Fösel, Murphy Yuezhen Niu, Florian Marquardt, and Li Li. 2021. Quantum circuit optimization with deep reinforcement learning. arXiv preprint arXiv:2103.07585 (2021).Google Scholar
- Zhimin He, Chuangtao Chen, Lvzhou Li, Shenggen Zheng, and Haozhen Situ. 2022a. Quantum Architecture Search with Meta-Learning. Advanced Quantum Technologies, Vol. 5, 8 (2022), 2100134.Google ScholarCross Ref
- Zhimin He, Junjian Su, Chuangtao Chen, Minghua Pan, and Haozhen Situ. 2022b. Search space pruning for quantum architecture search. The European Physical Journal Plus, Vol. 137, 4 (2022), 491.Google ScholarCross Ref
- Zhimin He, Xuefen Zhang, Chuangtao Chen, Zhiming Huang, Yan Zhou, and Haozhen Situ. 2023. A GNN-based predictor for quantum architecture search. Quantum Information Processing, Vol. 22, 2 (2023), 128.Google ScholarCross Ref
- Jen-Yueh Hsiao, Yuxuan Du, Wei-Yin Chiang, Min-Hsiu Hsieh, and Hsi-Sheng Goan. 2022. Unentangled quantum reinforcement learning agents in the OpenAI Gym. arXiv preprint arXiv:2203.14348 (2022).Google Scholar
- Yuhan Huang, Qingyu Li, Xiaokai Hou, Rebing Wu, Man-Hong Yung, Abolfazl Bayat, and Xiaoting Wang. 2022. Robust resource-efficient quantum variational ansatz through an evolutionary algorithm. Physical Review A, Vol. 105, 5 (2022), 052414.Google ScholarCross Ref
- Sofiene Jerbi, Casper Gyurik, Simon Marshall, Hans J Briegel, and Vedran Dunjko. 2021. Variational quantum policies for reinforcement learning. arXiv preprint arXiv:2103.05577 (2021).Google Scholar
- Tomoaki Kimura, Kodai Shiba, Chih-Chieh Chen, Masaru Sogabe, Katsuyoshi Sakamoto, and Tomah Sogabe. 2022. Quantum circuit architectures via quantum observable Markov decision process planning. Journal of Physics Communications, Vol. 6, 7 (2022), 075006.Google ScholarCross Ref
- En-Jui Kuo, Yao-Lung L Fang, and Samuel Yen-Chi Chen. 2021. Quantum architecture search via deep reinforcement learning. arXiv preprint arXiv:2104.07715 (2021).Google Scholar
- Owen Lockwood and Mei Si. 2020. Reinforcement Learning with Quantum Variational Circuit. In Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, Vol. 16. 245--251.Google ScholarCross Ref
- Nico Meyer, Christian Ufrecht, Maniraman Periyasamy, Daniel D Scherer, Axel Plinge, and Christopher Mutschler. 2022. A Survey on Quantum Reinforcement Learning. arXiv preprint arXiv:2211.03464 (2022).Google Scholar
- Kosuke Mitarai, Makoto Negoro, Masahiro Kitagawa, and Keisuke Fujii. 2018. Quantum circuit learning. Physical Review A, Vol. 98, 3 (2018), 032309.Google ScholarCross Ref
- Michael A Nielsen and Isaac Chuang. 2002. Quantum computation and quantum information.Google Scholar
- Mateusz Ostaszewski, Lea M Trenkwalder, Wojciech Masarczyk, Eleanor Scerri, and Vedran Dunjko. 2021. Reinforcement learning for optimization of variational quantum circuit architectures. Advances in Neural Information Processing Systems, Vol. 34 (2021), 18182--18194.Google Scholar
- Jun Qi, Chao-Han Huck Yang, and Pin-Yu Chen. 2021. Qtn-vqc: An end-to-end learning framework for quantum neural networks. arXiv preprint arXiv:2110.03861 (2021).Google Scholar
- André Sequeira, Luis Paulo Santos, and Luis Soares Barbosa. 2023. Policy gradients using variational quantum circuits. Quantum Machine Intelligence, Vol. 5, 1 (2023), 18.Google ScholarCross Ref
- Andrea Skolik, Sofiene Jerbi, and Vedran Dunjko. 2022. Quantum agents in the gym: a variational quantum algorithm for deep q-learning. Quantum, Vol. 6 (2022), 720.Google Scholar
- Tomah Sogabe, Tomoaki Kimura, Chih-Chieh Chen, Kodai Shiba, Nobuhiro Kasahara, Masaru Sogabe, and Katsuyoshi Sakamoto. 2022. Model-Free Deep Recurrent Q-Network Reinforcement Learning for Quantum Circuit Architectures Design. Quantum Reports, Vol. 4, 4 (2022), 380--389.Google ScholarCross Ref
- Peiyong Wang, Muhammad Usman, Udaya Parampalli, Lloyd CL Hollenberg, and Casey R Myers. 2023. Automated quantum circuit design with nested monte carlo tree search. IEEE Transactions on Quantum Engineering (2023).Google Scholar
- Rudai Yan, Yu Wang, Yan Xu, and Jiahong Dai. 2022. A Multiagent Quantum Deep Reinforcement Learning Method for Distributed Frequency Control of Islanded Microgrids. IEEE Transactions on Control of Network Systems, Vol. 9, 4 (2022), 1622--1632.Google ScholarCross Ref
- Chao-Han Huck Yang, Jun Qi, Samuel Yen-Chi Chen, Pin-Yu Chen, Sabato Marco Siniscalchi, Xiaoli Ma, and Chin-Hui Lee. 2021. Decentralizing feature extraction with quantum convolutional neural network for automatic speech recognition. In ICASSP 2021--2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 6523--6527.Google Scholar
- Chao-Han Huck Yang, Jun Qi, Samuel Yen-Chi Chen, Yu Tsao, and Pin-Yu Chen. 2022. When BERT Meets Quantum Temporal Convolution Learning for Text Classification in Heterogeneous Computing. In ICASSP 2022--2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 8602--8606.Google Scholar
- Jiahao Yao, Haoya Li, Marin Bukov, Lin Lin, and Lexing Ying. 2022. Monte carlo tree search based hybrid optimization of variational quantum circuits. In Mathematical and Scientific Machine Learning. PMLR, 49--64.Google Scholar
- Esther Ye and Samuel Yen-Chi Chen. 2021. Quantum Architecture Search via Continual Reinforcement Learning. arXiv preprint arXiv:2112.05779 (2021).Google Scholar
- Won Joon Yun, Jihong Park, and Joongheon Kim. 2022. Quantum multi-agent meta reinforcement learning. arXiv preprint arXiv:2208.11510 (2022).Google Scholar
Index Terms
- Quantum Reinforcement Learning for Quantum Architecture Search
Recommendations
Evolutionary quantum architecture search for parametrized quantum circuits
GECCO '22: Proceedings of the Genetic and Evolutionary Computation Conference CompanionRecent advancements in quantum computing have shown promising computational advantages in many problem areas. As one of those areas with increasing attention, hybrid quantum-classical machine learning systems have demonstrated the capability to solve ...
A Brief Survey of Quantum Architecture Search
ICACS '22: Proceedings of the 6th International Conference on Algorithms, Computing and SystemsWith the rapid development of quantum computing, the variational quantum algorithms capitalize on the classical optimizer and parametrized quantum circuit to provide outperformance on specific tasks such as combinatorial optimization problems. However, ...
Asynchronous training of quantum reinforcement learning
AbstractThe development of quantum machine learning (QML) has received a lot of interest recently thanks to developments in both quantum computing (QC) and machine learning (ML). One of the ML paradigms that can be utilized to address challenging ...
Comments