Test-Retest Reliability and Mode Effects on Single-Item and Multi-Item Measures in a Survey of Adolescent and Young Adults with Cancer

Purpose: This project examined test-retest reliability and survey mode administration across single-item and multi-item measures among adolescent and young adult (AYA) cancer survivors. Methods: Forty-six AYAs randomly assigned to survey mode (phone, online, and paper) completed the survey and were invited to complete the survey again 1 week later. Results: Mode effects were found on 6% of single-items and 25% of multi-item scores. Reliability was low for 52% of single-items and 8% of multi-item scores. Conclusion: Multi-item measures should generally be used over single-item measures due to better reliability, but single-item measures may be preferable when mode effects are large.