Computational codes of M4RL for dynamic optimization of cancer treatment

Abstract Dynamic tumor-microenvironment interactions greatly affect growth and drug resistance, highlighting the importance and challenge of developing mathematical models to optimize treatment schedules. Here, we describe a multiscale mathematical model-informed-reinforcement learning (M4RL) framework to simulate dynamic tumor-microenvironment interactions and optimize drug combination scheduling. We first develop a multiscale agent-based model (MSABM) for a critical biological scenario where interactions between tumor-associated macrophages (TAMs) and tumor cells (TCs) underlie immunotherapy resistance in glioblastoma. Next, we learn a surrogate model based on Fokker-Planck equations for the MSABM using a physics-informed neural network approach. We then design a surrogate model-based reinforcement learning method, using an efficient parallel actor-critic algorithm, to predict optimal scheduling of combination treatments. The most effective regimen of dynamic combination of CSF1R inhibitor (targeting TAMs) and IGF1R inhibitor (targeting TCs) is identified and then verified using spatial transcriptomics data. Overall, the M4RL framework introduces a computational approach for characterizing tumor-microenvironment interactions and optimizing dynamic scheduling of drug combinations. Usage Detailed instructions can be found in the README.md.Due to file number limitations, we have uploaded a compressed archive here. For browsing the specific contents, please visit https://github.com/SunXQlab/M4RL.