Predictive Coding and Surprisal Effects on N400 Amplitude: An ERP Study Using BERT-Based Language Models in Japanese Contexts

This study aims to reevaluate the role of the N 400 component in language processing from the perspective of predictive coding theory and investigate the impact of surprisal on N400 amplitude. An ERP experiment was conducted using three surprisal conditions (Best Completion, Unrelated, Implausible) with a BERT-based model optimized for Japanese contexts. Analysis of EEG data revealed distinct N400 amplitudes and brain connectivity patterns across the surprisal conditions. Notably, changes in alpha-band phase synchronization reflected cognitive processes related to the degree of mismatch between predicted and actual input in each context. These findings suggest that higher levels of surprisal lead to increased cognitive load, manifesting as dynamic changes in brain network activity.

Authors

Institutions

Publication Details

Published
2024-11-21
DOI
https://doi.org/10.1109/bmeicon64021.2024.10896356
Primary Topic
Natural Language Processing Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Predictive Coding and Surprisal Effects on N400 Amplitude: An ERP Study Using BERT-Based Language Models in Japanese Contexts

Hiroyuki Iwata, Keiji Iramina, Yutaro Nakada
Natural Language Processing Techniques
article

Predictive Coding and Surprisal Effects on N400 Amplitude: An ERP Study Using BERT-Based Language Models in Japanese Contexts

Hiroyuki Iwata, Keiji Iramina, Yutaro Nakada
article en

Abstract

This study aims to reevaluate the role of the N 400 component in language processing from the perspective of predictive coding theory and investigate the impact of surprisal on N400 amplitude. An ERP experiment was conducted using three surprisal conditions (Best Completion, Unrelated, Implausible) with a BERT-based model optimized for Japanese contexts. Analysis of EEG data revealed distinct N400 amplitudes and brain connectivity patterns across the surprisal conditions. Notably, changes in alpha-band phase synchronization reflected cognitive processes related to the degree of mismatch between predicted and actual input in each context. These findings suggest that higher levels of surprisal lead to increased cognitive load, manifesting as dynamic changes in brain network activity.

Kyushu University (JP)
Quality Education
Openalex Percentile: Top 75%
Natural Language Processing Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.