Integrating generative AI with multimodal interaction to inquire into scientific phenomena

This study developed and evaluated two customised generative artificial intelligence (GenAI) chatbots designed to provide stepwise guidance for secondary students’ inquiry into scientific phenomena. Biology and physics chatbots were developed using the Predict–Observe–Explain (POE) framework and Retrieval-Augmented Generation (RAG) to align with Singapore science syllabuses and incorporated segmented video demonstrations. 14 evaluators quantitatively and qualitatively assessed the chatbots in terms of Accuracy, Clarity, Dialogue flow, Ease of use, and Efficiency. Both chatbots were rated positively overall, particularly for Ease of use, Clarity, Efficiency, and Accuracy, while Dialogue flow received lower ratings, especially for the physics chatbot. Qualitative feedback identified needs for stronger scaffolding, better handling of follow-up questions, and additional multimodal support. The findings highlight key design considerations for GenAI-supported scientific inquiry.

Authors

Institutions

Publication Details

Journal
Learning Research and Practice
Published
2026-10-09
DOI
https://doi.org/10.1080/23735082.2026.2742916
Primary Topic
Intelligent Tutoring Systems and Adaptive Learning
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Integrating generative AI with multimodal interaction to inquire into scientific phenomena

Joonhyeong Park, Peter Peng Foo Lee, Gracia Xin Jie Soh, Shan Ying Lim
Learning Research and Practice
Intelligent Tutoring Systems and Adaptive Learning
article

Integrating generative AI with multimodal interaction to inquire into scientific phenomena

Joonhyeong Park, Peter Peng Foo Lee, Gracia Xin Jie Soh, Shan Ying Lim
article en

Abstract

This study developed and evaluated two customised generative artificial intelligence (GenAI) chatbots designed to provide stepwise guidance for secondary students’ inquiry into scientific phenomena. Biology and physics chatbots were developed using the Predict–Observe–Explain (POE) framework and Retrieval-Augmented Generation (RAG) to align with Singapore science syllabuses and incorporated segmented video demonstrations. 14 evaluators quantitatively and qualitatively assessed the chatbots in terms of Accuracy, Clarity, Dialogue flow, Ease of use, and Efficiency. Both chatbots were rated positively overall, particularly for Ease of use, Clarity, Efficiency, and Accuracy, while Dialogue flow received lower ratings, especially for the physics chatbot. Qualitative feedback identified needs for stronger scaffolding, better handling of follow-up questions, and additional multimodal support. The findings highlight key design considerations for GenAI-supported scientific inquiry.

Learning Research and Practice
Nanyang Technological University (SG)
Openalex Percentile: Top 12%
Intelligent Tutoring Systems and Adaptive Learning
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.