Evaluating Overlap Handling in Gemini 3.1 Flash Live: A Reproduction of Full-Duplex-Bench v1.5

We reproduce the Full-Duplex-Bench v1.5 evaluation pipeline [Lin et al., 2025] for Gemini 3.1 Flash Live Preview on Apple Silicon (M3 Max, no CUDA). In this paper, we extend the original benchmark by running four simulated overlap scenarios — background speech, talking to another person, user backchanneling, and user interruption — and evaluates model behavior using categorical dialogue labels, prosodic adaptation metrics, and stop/response latency. The findings show that Gemini responds correctly to user interruption in 72% of cases and resumes speech after background noise and side conversation in 50–63% of cases. We also found that pitch and speaking rate increase after overlap events across all tasks, while intensity decreases; this indicates that the model adapts to the speaker’s rhythm but does not assert dominance. Stop latency is lowest for user interruption (0.72s), where fast yielding is the correct behavior. The code and data are available at https://github.com/ifeanyidike/full-duplex-bench-repro.

Authors

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2026-05-23
DOI
https://doi.org/10.5281/zenodo.20354456
Primary Topic
Phonetics and Phonology Research
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
preprint

Evaluating Overlap Handling in Gemini 3.1 Flash Live: A Reproduction of Full-Duplex-Bench v1.5

Ifeanyi Dike
Zenodo (CERN European Organization for Nuclear Research)
Phonetics and Phonology Research
preprint

Evaluating Overlap Handling in Gemini 3.1 Flash Live: A Reproduction of Full-Duplex-Bench v1.5

Ifeanyi Dike
preprint en

Abstract

We reproduce the Full-Duplex-Bench v1.5 evaluation pipeline [Lin et al., 2025] for Gemini 3.1 Flash Live Preview on Apple Silicon (M3 Max, no CUDA). In this paper, we extend the original benchmark by running four simulated overlap scenarios — background speech, talking to another person, user backchanneling, and user interruption — and evaluates model behavior using categorical dialogue labels, prosodic adaptation metrics, and stop/response latency. The findings show that Gemini responds correctly to user interruption in 72% of cases and resumes speech after background noise and side conversation in 50–63% of cases. We also found that pitch and speaking rate increase after overlap events across all tasks, while intensity decreases; this indicates that the model adapts to the speaker’s rhythm but does not assert dominance. Stop latency is lowest for user interruption (0.72s), where fast yielding is the correct behavior. The code and data are available at https://github.com/ifeanyidike/full-duplex-bench-repro.

Zenodo (CERN European Organization for Nuclear Research)
Phonetics and Phonology Research
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.