Multi-step script event prediction based on reinforcement learning

Script Event Prediction aims to predict multiple subsequent events based on a given sequence of past events. While one-step script event prediction methods have achieved relatively high accuracy, their applicability is limited, as they cannot capture the evolving trends of event sequences. Moreover, most existing multi-step prediction approaches rely on one-step probability accumulation, which often leads to local optima while neglecting the overall quality of the predicted event chain. To address this issue, we propose a reinforcement learning framework to model the entire multi-step event prediction process. Specifically, we treat the current event chain as the state and employ a multi-layer perceptron as the agent to generate conditional probabilities for each candidate event. Each time a new event is predicted, the state of the event chain is dynamically updated before proceeding to the next prediction step. Additionally, we design a reward function based on the Bilingual Evaluation Understudy (BLEU) to ensure that the predicted event chain maintains high overall quality. Experiments on the MCNC task demonstrate that our framework outperforms existing methods to a certain extent, achieving significant improvements in multi-step script event prediction accuracy.

Authors

Institutions

Publication Details

Published
2025-06-06
DOI
https://doi.org/10.1109/ngdn66208.2025.11182090
Primary Topic
Software Engineering Research
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Multi-step script event prediction based on reinforcement learning

Huizhe Su, Jinpeng Li, Xingyu Weng, Xiangfeng Luo
Software Engineering Research
article

Multi-step script event prediction based on reinforcement learning

Huizhe Su, Jinpeng Li, Xingyu Weng, Xiangfeng Luo
article en

Abstract

Script Event Prediction aims to predict multiple subsequent events based on a given sequence of past events. While one-step script event prediction methods have achieved relatively high accuracy, their applicability is limited, as they cannot capture the evolving trends of event sequences. Moreover, most existing multi-step prediction approaches rely on one-step probability accumulation, which often leads to local optima while neglecting the overall quality of the predicted event chain. To address this issue, we propose a reinforcement learning framework to model the entire multi-step event prediction process. Specifically, we treat the current event chain as the state and employ a multi-layer perceptron as the agent to generate conditional probabilities for each candidate event. Each time a new event is predicted, the state of the event chain is dynamically updated before proceeding to the next prediction step. Additionally, we design a reward function based on the Bilingual Evaluation Understudy (BLEU) to ensure that the predicted event chain maintains high overall quality. Experiments on the MCNC task demonstrate that our framework outperforms existing methods to a certain extent, achieving significant improvements in multi-step script event prediction accuracy.

Shanghai University of Engineering Science (CN)
Openalex Percentile: Top 61%
Software Engineering Research
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.