Quantum framework for reinforcement learning: Integrating the Markov decision process, quantum arithmetic, and trajectory search

This paper introduces a quantum framework for addressing reinforcement learning (RL) tasks, grounded in the quantum principles and leveraging a fully quantum model of the classical Markov decision process. By employing quantum concepts and a quantum search algorithm, this work presents the implementation and optimization of the agent-environment interactions entirely within the quantum domain, eliminating reliance on classical computations. Key contributions include the quantum-based state transitions, return calculation, and trajectory search mechanism that utilize quantum principles to demonstrate the realization of RL processes through quantum phenomena. The implementation emphasizes the fundamental role of quantum superposition in enhancing computational efficiency for RL tasks. Results demonstrate the capacity of a quantum model to achieve quantum enhancement in RL, highlighting the potential of fully quantum implementations in decision-making tasks. This work not only underscores the applicability of quantum computing in machine learning but also contributes to the field of quantum reinforcement learning by offering a robust framework for understanding and exploiting quantum computing in RL systems.

Authors

Institutions

Publication Details

Journal
Physical review. A/Physical review, A
Published
2025-05-22
DOI
https://doi.org/10.1103/5lfr-xb8m
Citations
3
Primary Topic
Quantum Computing Algorithms and Architecture
Type
article
Field-Weighted Citation Impact
7.44

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Quantum framework for reinforcement learning: Integrating the Markov decision process, quantum arithmetic, and trajectory search

Shaswot Shresthamali, Masaaki Kondo, Karl J. Friston
3 citations
Physical review. A/Physical review, A
Quantum Computing Algorithms and Architecture
7.44
article

Quantum framework for reinforcement learning: Integrating the Markov decision process, quantum arithmetic, and trajectory search

Shaswot Shresthamali, Masaaki Kondo, Karl J. Friston
article en
3 citations

Abstract

This paper introduces a quantum framework for addressing reinforcement learning (RL) tasks, grounded in the quantum principles and leveraging a fully quantum model of the classical Markov decision process. By employing quantum concepts and a quantum search algorithm, this work presents the implementation and optimization of the agent-environment interactions entirely within the quantum domain, eliminating reliance on classical computations. Key contributions include the quantum-based state transitions, return calculation, and trajectory search mechanism that utilize quantum principles to demonstrate the realization of RL processes through quantum phenomena. The implementation emphasizes the fundamental role of quantum superposition in enhancing computational efficiency for RL tasks. Results demonstrate the capacity of a quantum model to achieve quantum enhancement in RL, highlighting the potential of fully quantum implementations in decision-making tasks. This work not only underscores the applicability of quantum computing in machine learning but also contributes to the field of quantum reinforcement learning by offering a robust framework for understanding and exploiting quantum computing in RL systems.

Physical review. A/Physical review, AVol. 111(6)
Kyushu University (JP), Keio University (JP), RIKEN Center for Computational Science (JP)
Ministry of Education, Culture, Sports, Science and Technology, Japan Society for the Promotion of Science, Japan Science and Technology Agency
Peace, Justice and strong institutions
Openalex Percentile: Top 3%
Quantum Computing Algorithms and Architecture
7.44
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.