Advancing Speech Therapy for Sinhala-Speaking Children with Autism Spectrum Disorder Through an Intelligent Dialog System

This paper presents a dialog system integrated with a NAO socially assistive robot, designed to support Sinhala-speaking children with Autism Spectrum Disorder (ASD). The system leverages a pipeline-based architecture implemented using the RASA framework, consisting of Natural Language Understanding (NLU), Dialog Management (DMU), and Natural Language Generation (NLG) units. The NLU unit processes user input by identifying intents, entities, and dialogue acts, incorporating custom tools like the SpokenSinhalaVerbTokenizer for handling spoken Sinhala. The DMU includes a Dialog State Tracker (DST) to maintain conversation context and a Dialog Policy Generator, which employs rule-based, TED, and UnexpecTED policies to adapt conversation flows dynamically. The NLG unit generates natural responses to foster interactive and goal-oriented conversations. Integrated with the NAO robot, the system engages children through meaningful dialogues, such as discussing toy preferences, aiming to enhance social interaction and communication skills. This work highlights the potential of conversational AI and robotics in therapeutic interventions for ASD in low-resource languages.

Authors

Institutions

Publication Details

Published
2025-04-03
DOI
https://doi.org/10.1109/scse65633.2025.11030959
Primary Topic
Autism Spectrum Disorder Research
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Advancing Speech Therapy for Sinhala-Speaking Children with Autism Spectrum Disorder Through an Intelligent Dialog System

Aparna Jayawardena, Samantha Rajapakshe, Koliya Pulasinghe
Autism Spectrum Disorder Research
article

Advancing Speech Therapy for Sinhala-Speaking Children with Autism Spectrum Disorder Through an Intelligent Dialog System

Aparna Jayawardena, Samantha Rajapakshe, Koliya Pulasinghe
article en

Abstract

This paper presents a dialog system integrated with a NAO socially assistive robot, designed to support Sinhala-speaking children with Autism Spectrum Disorder (ASD). The system leverages a pipeline-based architecture implemented using the RASA framework, consisting of Natural Language Understanding (NLU), Dialog Management (DMU), and Natural Language Generation (NLG) units. The NLU unit processes user input by identifying intents, entities, and dialogue acts, incorporating custom tools like the SpokenSinhalaVerbTokenizer for handling spoken Sinhala. The DMU includes a Dialog State Tracker (DST) to maintain conversation context and a Dialog Policy Generator, which employs rule-based, TED, and UnexpecTED policies to adapt conversation flows dynamically. The NLG unit generates natural responses to foster interactive and goal-oriented conversations. Integrated with the NAO robot, the system engages children through meaningful dialogues, such as discussing toy preferences, aiming to enhance social interaction and communication skills. This work highlights the potential of conversational AI and robotics in therapeutic interventions for ASD in low-resource languages.

Sri Lanka Institute of Information Technology (LK)
Quality Education
Openalex Percentile: Top 87%
Autism Spectrum Disorder Research
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.