Predicting Attention Shifts in Second Language Learners Using LSTM and Attention Mechanism: A Multi-Dataset Approach

This paper presents a novel approach for predicting attention shifts in second language learners using a Long Short-Term Memory (LSTM) neural network integrated with an attention mechanism. Eye-tracking data from multiple datasets, including Dundee, ZuCo, Tobii, and GazePoint, were used to evaluate the performance of the proposed model. The LSTM model, enhanced by attention, effectively captures temporal dependencies in learners’ behavior and outperforms traditional models such as Naive Bayes, SVM, and RNN in terms of accuracy, F1-score, and Mean Absolute Error (MAE). The LSTM model achieved the highest accuracy of 86.0% and the lowest MAE of 0.10 on the GazePoint dataset. An ablation study further demonstrates the critical role of the attention mechanism in improving prediction accuracy. These results show that the proposed method provides a robust and scalable solution for modeling attention shifts in second language acquisition.

Authors

Publication Details

Published
2024-09-15
DOI
https://doi.org/10.1145/3689236.3696742
Primary Topic
Online Learning and Analytics
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Predicting Attention Shifts in Second Language Learners Using LSTM and Attention Mechanism: A Multi-Dataset Approach

Yan Li
Online Learning and Analytics
article

Predicting Attention Shifts in Second Language Learners Using LSTM and Attention Mechanism: A Multi-Dataset Approach

Yan Li
article en

Abstract

This paper presents a novel approach for predicting attention shifts in second language learners using a Long Short-Term Memory (LSTM) neural network integrated with an attention mechanism. Eye-tracking data from multiple datasets, including Dundee, ZuCo, Tobii, and GazePoint, were used to evaluate the performance of the proposed model. The LSTM model, enhanced by attention, effectively captures temporal dependencies in learners’ behavior and outperforms traditional models such as Naive Bayes, SVM, and RNN in terms of accuracy, F1-score, and Mean Absolute Error (MAE). The LSTM model achieved the highest accuracy of 86.0% and the lowest MAE of 0.10 on the GazePoint dataset. An ablation study further demonstrates the critical role of the attention mechanism in improving prediction accuracy. These results show that the proposed method provides a robust and scalable solution for modeling attention shifts in second language acquisition.

Quality Education
Openalex Percentile: Top 76%
Online Learning and Analytics
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.