Interrater and Intrarater Reliability of the TWSTRS ‐Delphi Motor Severity Scale for Cervical Dystonia

BACKGROUND: Cervical dystonia (CD) motor severity is typically quantified with the Toronto Western Spasmodic Torticollis Rating Scale (TWSTRS). An expanded version of the Motor Severity section of the TWSTRS ("TWSTRS-Delphi") has been previously evaluated for its clinimetric properties but not for inter- and intrarater reliability. OBJECTIVE: In this study we quantified inter- and intrarater reliability of the Motor Severity section of the TWSTRS-Delphi for CD. METHODS: Ten raters familiar with the TWSTRS-Delphi and ten raters unfamiliar with it independently scored standardized videos from 90 patients with CD. We computed one-way random intraclass correlation coefficient (ICC, absolute agreement) for total and item scores. We repeated assessments and calculations with a subset of raters to assess intrarater reliability. RESULTS: Interrater reliability for the Total score was good for Familiar raters (ICC = 0.697) and fair for Unfamiliar raters (ICC = 0.566). Most individual items achieved fair-excellent interrater agreement in both groups (Familiar 0.415-0.763; Unfamiliar 0.416-0.769). Sagittal Shift, Duration, and Sensory Tricks showed poor agreement. Intrarater reliability was fair-excellent for most items in both groups (Familiar 0.494-0.927; Unfamiliar 0.413-0.877), but poor for Sagittal Shift and Duration among Familiar raters. CONCLUSIONS: The TWSTRS-Delphi yields reproducible Total and item scores across movement disorder raters. The data pinpoint Sagittal Shift, Duration, and Sensory Tricks as the principal sources of between-rater variability, defining immediate priorities for scale modification and focused training.

Institutions

Publication Details

Journal
Movement Disorders Clinical Practice
Published
2026-08-27
DOI
https://doi.org/10.1002/mdc3.70757
Primary Topic
Botulinum Toxin and Related Neurological Disorders
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Interrater and Intrarater Reliability of the TWSTRS ‐Delphi Motor Severity Scale for Cervical Dystonia

Movement Disorders Clinical Practice
Botulinum Toxin and Related Neurological Disorders
article

Interrater and Intrarater Reliability of the TWSTRS ‐Delphi Motor Severity Scale for Cervical Dystonia

article en

Abstract

BACKGROUND: Cervical dystonia (CD) motor severity is typically quantified with the Toronto Western Spasmodic Torticollis Rating Scale (TWSTRS). An expanded version of the Motor Severity section of the TWSTRS ("TWSTRS-Delphi") has been previously evaluated for its clinimetric properties but not for inter- and intrarater reliability. OBJECTIVE: In this study we quantified inter- and intrarater reliability of the Motor Severity section of the TWSTRS-Delphi for CD. METHODS: Ten raters familiar with the TWSTRS-Delphi and ten raters unfamiliar with it independently scored standardized videos from 90 patients with CD. We computed one-way random intraclass correlation coefficient (ICC, absolute agreement) for total and item scores. We repeated assessments and calculations with a subset of raters to assess intrarater reliability. RESULTS: Interrater reliability for the Total score was good for Familiar raters (ICC = 0.697) and fair for Unfamiliar raters (ICC = 0.566). Most individual items achieved fair-excellent interrater agreement in both groups (Familiar 0.415-0.763; Unfamiliar 0.416-0.769). Sagittal Shift, Duration, and Sensory Tricks showed poor agreement. Intrarater reliability was fair-excellent for most items in both groups (Familiar 0.494-0.927; Unfamiliar 0.413-0.877), but poor for Sagittal Shift and Duration among Familiar raters. CONCLUSIONS: The TWSTRS-Delphi yields reproducible Total and item scores across movement disorder raters. The data pinpoint Sagittal Shift, Duration, and Sensory Tricks as the principal sources of between-rater variability, defining immediate priorities for scale modification and focused training.

Movement Disorders Clinical Practice
Università Cattolica del Sacro Cuore (IT), University of Maryland, Baltimore (US), Rush University Medical Center (US), Centre National de la Recherche Scientifique (FR), The University of Sydney (AU), Salk Institute for Biological Studies (US), University Health Network (CA), University Medical Center Groningen (NL), Texas Medical Center (US), Emory University (US), Inserm (FR), University of Toronto (CA), Washington University in St. Louis (US), Toronto Western Hospital (CA), AdventHealth Orlando (US), Leiden University Medical Center (NL), Centre Hospitalier Universitaire de Grenoble (FR), Agostino Gemelli University Polyclinic (IT), University of Rochester Medical Center (US), AbbVie (United States) (US), University of Alabama at Birmingham (US), Medizinische Hochschule Hannover (DE), University of California San Diego (US), Sorbonne Université (FR), Fondazione Istituto Neurologico Nazionale Casimiro Mondino (IT), Pitié-Salpêtrière Hospital (FR), Mayo Clinic in Arizona (US), Institut de Psychiatrie et Neurosciences de Paris (FR), Ospedale Generale Regionale Francesco Miulli (IT), Haga Hospital (NL), Grenoble Institute of Neurosciences (FR), Parkinson-Klinik Ortenau (DE), Université Grenoble Alpes (FR)
Rare Diseases Clinical Research Network, National Institute of Neurological Disorders and Stroke, National Center for Advancing Translational Sciences
No poverty
Openalex Percentile: Top 10%
Botulinum Toxin and Related Neurological Disorders
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.