A multi-stage framework for emotionally intelligent dialogue systems using topological sentiment encoding and causal policy optimization

Emotionally intelligent dialogue systems should not only express sentence-level sentiment but also sense shifts in emotion from sentence to sentence, from speaker to speaker, and over time, and be interpretable down to the decision level. Existing approaches consider only sentiment as a single and static feature, and they either do not consider multi-turn context, temporal variation, speaker-specific trends, or the correlations between emotion and action. To fill these gaps, we introduce a unified 5-stage framework for systematically encoding, transforming, and operationalising emotion in multi-turn conversations. First, Context-Aware Multi-Level Sentiment Encoding (CMLSE) uses RoBERTa embeddings, self-attention, and Dynamic Time Warping (DTW), while preserving the speaker identity, turn order and sentiment continuity. Second, Emotion Clustering Topological Signal Mapping (ECTSM) uses an emotion vector sentiment and persistent homology to obtain robust emotion clusters based on topology and shape. Third, Emotion-Memory Reinforced Graph Aggregation Network (EMR-GAN) constructs a dynamic emotion graph and a long-term memory network, learning the best manner for optimizing emotional coherence through Reinforcement Learning (RL). The Adaptive Causal Decision-Graph Transformer (ACDGT) incorporates causal inference into graph attention to discover hidden emotion-behaviour causality and imitate counterfactual decisions. Finally, the Emotion-Driven Reinforcement Policy Synthesizer (EDRPS) combines emotional memory and causal representations with dual-reward Proximal Policy Optimization (PPO) to generate policies in real-time, emotion-aware mode. Our model shows an average accuracy of 78.8% (+6.4% above the best baseline) on MELD, 0.61 Adjusted Rand Index (ARI) for emotion clustering, and 92.5% accuracy in aligning the policy on DailyDialog. These assessments show scores of empathy, relevance, and naturalness to be higher, marking a new state-of-the-art for affective dialogue systems.

Authors

Institutions

Publication Details

Journal
PLoS ONE
Published
2026-10-28
DOI
https://doi.org/10.1371/journal.pone.0361365
Primary Topic
Speech and dialogue systems
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

A multi-stage framework for emotionally intelligent dialogue systems using topological sentiment encoding and causal policy optimization

Sireesha Koneru, Harika Vanam, Sonali Bodkhe, Niraj Kumar Dewangan et al.
1 links
PLoS ONE
Speech and dialogue systems
article

A multi-stage framework for emotionally intelligent dialogue systems using topological sentiment encoding and causal policy optimization

Sireesha Koneru, Harika Vanam, Sonali Bodkhe, Niraj Kumar Dewangan, Amit Purushottam Pimpalkar, Tabassum H. Khan, Amreen Habibullah Khan
article en

Abstract

Emotionally intelligent dialogue systems should not only express sentence-level sentiment but also sense shifts in emotion from sentence to sentence, from speaker to speaker, and over time, and be interpretable down to the decision level. Existing approaches consider only sentiment as a single and static feature, and they either do not consider multi-turn context, temporal variation, speaker-specific trends, or the correlations between emotion and action. To fill these gaps, we introduce a unified 5-stage framework for systematically encoding, transforming, and operationalising emotion in multi-turn conversations. First, Context-Aware Multi-Level Sentiment Encoding (CMLSE) uses RoBERTa embeddings, self-attention, and Dynamic Time Warping (DTW), while preserving the speaker identity, turn order and sentiment continuity. Second, Emotion Clustering Topological Signal Mapping (ECTSM) uses an emotion vector sentiment and persistent homology to obtain robust emotion clusters based on topology and shape. Third, Emotion-Memory Reinforced Graph Aggregation Network (EMR-GAN) constructs a dynamic emotion graph and a long-term memory network, learning the best manner for optimizing emotional coherence through Reinforcement Learning (RL). The Adaptive Causal Decision-Graph Transformer (ACDGT) incorporates causal inference into graph attention to discover hidden emotion-behaviour causality and imitate counterfactual decisions. Finally, the Emotion-Driven Reinforcement Policy Synthesizer (EDRPS) combines emotional memory and causal representations with dual-reward Proximal Policy Optimization (PPO) to generate policies in real-time, emotion-aware mode. Our model shows an average accuracy of 78.8% (+6.4% above the best baseline) on MELD, 0.61 Adjusted Rand Index (ARI) for emotion clustering, and 92.5% accuracy in aligning the policy on DailyDialog. These assessments show scores of empathy, relevance, and naturalness to be higher, marking a new state-of-the-art for affective dialogue systems.

PLoS ONEVol. 21(10)
Manipal Academy of Higher Education (IN), Raisoni Group of Institutions (IN), MIT Art, Design and Technology University (IN), New Horizon College of Engineering (IN), Koneru Lakshmaiah Education Foundation (IN)
Openalex Percentile: Top 13%
Speech and dialogue systems
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon