Correcting for Unequal Variance in Signal Detection Models Using Response Time

This study examines performance evaluation in perceptual detection tasks using response-time-based signal detection theory (SDT) analysis. A defining feature of detection tasks is the asymmetry between trials with stimulus presence and absence, often reflected in asymmetric type-1 ROC curves. This ROC asymmetry indicates greater signal variability in stimulus-present trials, which contradicts canonical assumptions in equal-variance SDT models. Across multiple datasets, we implemented an unequal-variance SDT model using response time (RT) data, and compared its estimates with those obtained from the traditional confidence-based method. RT-based estimates of SDT parameters, the SD ratio (σ) and mean difference (μ), aligned closely with confidence-based estimates. The resulting sensitivity measure dₐ—an unequal-variance extension of d′—derived from RT and confidence showed strong consistency across all datasets. Notably, the conventional d′ measure consistently overestimated detection performance compared to the dₐ measures, highlighting the importance of accounting for the degree of unequal variance. Our findings demonstrate that RT-based SDT analysis offers a reliable, cost-effective alternative for the precise evaluation of perceptual detection performance, particularly when confidence ratings are impractical or unavailable.

Authors

Publication Details

Published
2025-09-25
DOI
https://doi.org/10.31234/osf.io/cr9k6_v1
Primary Topic
Control Systems and Identification
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Correcting for Unequal Variance in Signal Detection Models Using Response Time

Hakwan Lau, Dobromir Rahnev, Kiyofumi Miyoshi
Control Systems and Identification
article

Correcting for Unequal Variance in Signal Detection Models Using Response Time

Hakwan Lau, Dobromir Rahnev, Kiyofumi Miyoshi
article en

Abstract

This study examines performance evaluation in perceptual detection tasks using response-time-based signal detection theory (SDT) analysis. A defining feature of detection tasks is the asymmetry between trials with stimulus presence and absence, often reflected in asymmetric type-1 ROC curves. This ROC asymmetry indicates greater signal variability in stimulus-present trials, which contradicts canonical assumptions in equal-variance SDT models. Across multiple datasets, we implemented an unequal-variance SDT model using response time (RT) data, and compared its estimates with those obtained from the traditional confidence-based method. RT-based estimates of SDT parameters, the SD ratio (σ) and mean difference (μ), aligned closely with confidence-based estimates. The resulting sensitivity measure dₐ—an unequal-variance extension of d′—derived from RT and confidence showed strong consistency across all datasets. Notably, the conventional d′ measure consistently overestimated detection performance compared to the dₐ measures, highlighting the importance of accounting for the degree of unequal variance. Our findings demonstrate that RT-based SDT analysis offers a reliable, cost-effective alternative for the precise evaluation of perceptual detection performance, particularly when confidence ratings are impractical or unavailable.

Institute for Basic Science, Japan Society for the Promotion of Science
Openalex Percentile: Top 67%
Control Systems and Identification
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.