Test-Retest Reliability of Two Computationally-Characterised Affective Bias Tasks

Affective biases are commonly seen in disorders such as depression and anxiety, where individuals may show attention towards and preferential processing of negative or threatening stimuli. Affective biases have been shown to change with effective intervention: randomized controlled trials into these biases and the mechanisms that underpin them may allow greater understanding of how interventions can be improved and their success be maximized. For such trials to be informative, we must have reliable ways of measuring affective bias over time, so we can detect how and whether they are altered by interventions: the test-retest reliability of our measures puts an upper bound on our ability to detect any changes. In this online study we therefore examined the test-retest reliability of two behavioural affective bias tasks (an 'Ambiguous Midpoint' and a 'Go-Nogo' task). 58 individuals recruited from the general population completed the tasks twice, with at least 14 days in between sessions. We analysed the reliability of both summary statistics and parameters from computational models using Pearson's correlations and intra-class correlations. Standard summary statistic measures from these affective bias tasks had reliabilities ranging from 0.18 (poor) to 0.49 (moderate). Parameters from computational modelling of these tasks were in many cases less reliable than summary statistics. However, embedding the covariance between sessions within the generative modelling framework resulted in higher estimates of stability. We conclude that measures from these affective bias tasks are moderately reliable, but further work to improve the reliability of these tasks would improve still further our ability to draw inferences in randomized trials.

Authors

Institutions

Publication Details

Journal
Computational Psychiatry
Published
2024-12-18
DOI
https://doi.org/10.5334/cpsy.92
Citations
5
Primary Topic
Mental Health Research Topics
Type
article
Field-Weighted Citation Impact
2.54

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Test-Retest Reliability of Two Computationally-Characterised Affective Bias Tasks

Oliver J. Robinson, Michelle Wing, Katrina Ross A. Tan, Alexandra Claire Pike et al.
5 citations
Computational Psychiatry
Mental Health Research Topics
2.54
article

Test-Retest Reliability of Two Computationally-Characterised Affective Bias Tasks

Oliver J. Robinson, Michelle Wing, Katrina Ross A. Tan, Alexandra Claire Pike, Hoda Tromblee
article en
5 citations

Abstract

Affective biases are commonly seen in disorders such as depression and anxiety, where individuals may show attention towards and preferential processing of negative or threatening stimuli. Affective biases have been shown to change with effective intervention: randomized controlled trials into these biases and the mechanisms that underpin them may allow greater understanding of how interventions can be improved and their success be maximized. For such trials to be informative, we must have reliable ways of measuring affective bias over time, so we can detect how and whether they are altered by interventions: the test-retest reliability of our measures puts an upper bound on our ability to detect any changes. In this online study we therefore examined the test-retest reliability of two behavioural affective bias tasks (an 'Ambiguous Midpoint' and a 'Go-Nogo' task). 58 individuals recruited from the general population completed the tasks twice, with at least 14 days in between sessions. We analysed the reliability of both summary statistics and parameters from computational models using Pearson's correlations and intra-class correlations. Standard summary statistic measures from these affective bias tasks had reliabilities ranging from 0.18 (poor) to 0.49 (moderate). Parameters from computational modelling of these tasks were in many cases less reliable than summary statistics. However, embedding the covariance between sessions within the generative modelling framework resulted in higher estimates of stability. We conclude that measures from these affective bias tasks are moderately reliable, but further work to improve the reliability of these tasks would improve still further our ability to draw inferences in randomized trials.

Computational PsychiatryVol. 8(1)
National Hospital for Neurology and Neurosurgery (GB), University College London (GB), University of York (GB)
Medical Research Council
No poverty
Openalex Percentile: Top 10%
Mental Health Research Topics
2.54
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.