Using the proximal policy optimization and prospect theory to train a decision-making model for managing personal finances

The subject of this article is the development of a decision-making model that can, in the future, be incorporated into a personal finance simulator to improve personal finance literacy. The goal of this study is to develop decision-making models tailored to different investor profiles to provide personalized financial advice on asset allocation. This article employs reinforcement learning techniques and behavioral economics to achieve this objective, thereby contributing to the advancement of practical algorithms and approaches for financial decision-making. The tasks can be formulated as follows: 1) design a reinforcement learning environment featuring different investment options with varying average returns and volatility levels; 2) train the reinforcement learning agent using the Proximal Policy Optimization algorithm to learn recommended investment allocations; 3) implement a reward function based on Prospect Theory, incorporating parameters that reflect different investor risk profiles, such as loss aversion and diminishing sensitivity to gains and losses. The results reveal the development of distinct models for 3 investor profiles: risk-averse, rational, and wealth-maximizing. A graphical analysis of the recommended allocation percentages revealed significant patterns influenced by the value function parameters of Prospect Theory. The practical implications of this research extend to the development of simulation tools based on the model, which will enable individuals to practice and refine their financial strategies in a risk-free environment. These tools bridge the gap in personal finance education by providing experiential learning opportunities. Conclusions. The developed model effectively generates personalized financial advice that reflects individual risk preferences. Future work will focus on creating interactive simulation tools to enhance personal finance management skills. This study underscores the importance of integrating psychological and behavioral insights into financial decision-making models.