Joint Sensing and Computation Incentive Mechanism for Mobile Crowdsensing Networks: A Multiagent Reinforcement Learning Approach

Mobile crowdsensing (MCS) is a novel sensing paradigm by utilizing mobile users (MUs) to collect data from environment. Considering the finite sensing and computing resources of MUs, it is crucial to inspire MUs to take part in crowdsensing willingly. In this study, a multiagent-deep-reinforcement-learning (DRL)-based incentive mechanism is investigated to tackle the joint data sensing and computing issues. Specifically, due to the heterogeneity of sensing tasks, multiple MCS platforms (MCPs) motivate MUs to participate in different tasks. The interaction between MCPs and MUs is modeled as a multileader-multifollower Stackelberg game with Stackelberg equilibrium proved by derivation. Moreover, the Stackelberg game is transformed as a Markov decision process (MDP) to deal with a multiagent DRL method without any prior knowledge. Due to the continuous high-dimensional action space of multiple MCPs and MUs, a multiagent double actors deep deterministic policy gradient (MA-DADDPG) algorithm is proposed to obtain the optimal sensing data size, computing resource, and incentive payment policies. Extensive simulation results illustrate the effectiveness of the proposed crowdsensing incentive mechanism.