Ma, Hailan; Dong, Daoyi; Ding, Steven X.; Chen, Chunlin:
Curriculum-Based Deep Reinforcement Learning for Quantum Control
In: IEEE Transactions on Neural Networks and Learning Systems, Vol. 34 (2023), No. 11, pp. 8852 - 8865
2023article/chapter in journalOA Green
Electrical Engineering and Information TechnologyFaculty of Engineering » Engineering and Information Technology » Automatic Control and Complex Systems
Related: 1 publication(s)
Title in English:
Curriculum-Based Deep Reinforcement Learning for Quantum Control
Author:
Ma, Hailan
ORCID
0000-0002-5039-9916ORCID iD
;
Dong, Daoyi
ORCID
0000-0002-7425-3559ORCID iD
Other
corresponding author
;
Ding, Steven X.UDE
GND
134302427
LSF ID
2347
ORCID
0000-0002-5149-5918ORCID iD
Other
connected with university
;
Chen, Chunlin
ORCID
0000-0003-3929-4707ORCID iD
Other
corresponding author
Year of publication:
2023
Open Access?:
OA Green
arXiv.org ID
IEEE ID
Web of Science ID
PubMed ID
Scopus ID
Language of text:
English
Keyword, Topic:
Curriculum learning ; deep reinforcement learning (DRL) ; Process control ; Quantum computing ; quantum control ; Quantum entanglement ; Quantum state ; Quantum system ; Sequential analysis ; Task analysis
Type of resource:
Text

Abstract in English:

Deep reinforcement learning (DRL) has been recognized as an efficient technique to design optimal strategies for different complex systems without prior knowledge of the control landscape. To achieve a fast and precise control for quantum systems, we propose a novel DRL approach by constructing a curriculum consisting of a set of intermediate tasks defined by fidelity thresholds, where the tasks among a curriculum can be statically determined before the learning process or dynamically generated during the learning process. By transferring knowledge between two successive tasks and sequencing tasks according to their difficulties, the proposed curriculum-based DRL (CDRL) method enables the agent to focus on easy tasks in the early stage, then move onto difficult tasks, and eventually approaches the final task. Numerical comparison with the traditional methods [gradient method (GD), genetic algorithm (GA), and several other DRL methods] demonstrates that CDRL exhibits improved control performance for quantum systems and also provides an efficient way to identify optimal strategies with few control pulses.