An Expert Guide to Planning Experimental Tasks For Evidence-Accumulation Modeling
Evidence-accumulation models (EAMs) are powerful tools for making sense of human and animal decision-making behavior. EAMs have generated significant theoretical advances in psychology, behavioral economics, and cognitive neuroscience and are increasingly used as a measurement tool in clinical research and other applied settings. Obtaining valid and reliable inferences from EAMs depends on knowing how to establish a close match between model assumptions and features of the task/data to which the model is applied. However, this knowledge is rarely articulated in the EAM literature, leaving beginners to rely on the private advice of mentors and colleagues and inefficient trial-and-error learning. In this article, we provide practical guidance for designing tasks appropriate for EAMs, relating experimental manipulations to EAM parameters, planning appropriate sample sizes, and preparing data and conducting an EAM analysis. Our advice is based on prior methodological studies and the our substantial collective experience with EAMs. By encouraging good task-design practices and warning of potential pitfalls, we hope to improve the quality and trustworthiness of future EAM research and applications.
Authors
- Gordon D. Logan (ORCID: https://orcid.org/0000-0002-8301-7726)
- Marius Usher (ORCID: https://orcid.org/0000-0001-8041-9060)
- Luke Strickland (ORCID: https://orcid.org/0000-0002-6071-6022)
- Konstantinos Tsetsos (ORCID: https://orcid.org/0000-0003-2709-7634)
- Russell J. Boag (ORCID: https://orcid.org/0000-0002-7689-0682)
- Chris Donkin (ORCID: https://orcid.org/0000-0002-4285-8537)
- Reilly James Innes (ORCID: https://orcid.org/0000-0003-0382-0154)
- Don van Ravenzwaaij (ORCID: https://orcid.org/0000-0002-5030-4091)
- Jennifer S. Trueblood (ORCID: https://orcid.org/0000-0002-9019-6574)
- Giwon Bahg (ORCID: https://orcid.org/0000-0002-9068-4535)
- Jerome R. Busemeyer (ORCID: https://orcid.org/0000-0002-7594-1871)
- Gregory E. Cox (ORCID: https://orcid.org/0000-0002-0602-1545)
- Henrik Singmann (ORCID: https://orcid.org/0000-0002-4842-3657)
- Birte U. Forstmann (ORCID: https://orcid.org/0000-0002-1005-1675)
- Dóra Matzke (ORCID: https://orcid.org/0000-0003-1990-0175)
- Corey N. White (ORCID: https://orcid.org/0000-0003-0250-263X)
- Leendert van Maanen (ORCID: https://orcid.org/0000-0001-9120-1075)
- Adam F Osth (ORCID: https://orcid.org/0000-0001-5429-089X)
- Mark Steyvers (ORCID: https://orcid.org/0000-0003-1466-5647)
- Craig Hedge (ORCID: https://orcid.org/0000-0001-6145-3319)
- Niek Stevenson (ORCID: https://orcid.org/0000-0003-3206-7544)
- Simon D. Lilburn (ORCID: https://orcid.org/0000-0001-8820-8188)
- Thomas J. Palmeri (ORCID: https://orcid.org/0000-0001-7617-9797)
- Andrew Heathcote (ORCID: https://orcid.org/0000-0003-4324-5537)
- Philip L. Smith (ORCID: https://orcid.org/0000-0002-2381-9372)
- Steven Miletić (ORCID: https://orcid.org/0000-0001-7399-2926)
- Joachim Vandekerckhove (ORCID: https://orcid.org/0000-0003-2600-5937)
- Scott Brown (ORCID: https://orcid.org/0000-0002-9060-6756)
- Emily Ruth Weichart (ORCID: https://orcid.org/0000-0001-5535-5704)
- Michael J. Frank
- Gabriel Weindel (ORCID: https://orcid.org/0000-0002-7592-1686)
- Guy E. Hawkins (ORCID: https://orcid.org/0000-0002-7712-2343)
- Veronika Lerche
- Tom Stafford (ORCID: https://orcid.org/0000-0003-0567-6117)
- Per B. Sederberg (ORCID: https://orcid.org/0000-0001-8586-4542)
- Brandon M. Turner (ORCID: https://orcid.org/0000-0003-0966-9301)
- Nathan J. Evans (ORCID: https://orcid.org/0000-0002-6953-8816)
- Andreas Voss
Institutions
- Leiden University (NL)
- Utah State University (US)
- Tel Aviv University (IL)
- The University of Melbourne (AU)
- Aston University (GB)
- University of Groningen (NL)
- Utrecht University (NL)
- Vanderbilt University (US)
- University of California, Irvine (US)
- Curtin University (AU)
- Heidelberg University (DE)
- Brown University (US)
- Christian-Albrechts-Universität zu Kiel (DE)
- University of Bristol (GB)
- University at Albany, State University of New York (US)
- Indiana University Bloomington (US)
- University College London (GB)
- University of Virginia (US)
- The Ohio State University (US)
- Missouri Western State University (US)
- University of Newcastle Australia (AU)
- Ludwig-Maximilians-Universität München (DE)
- University of Amsterdam (NL)
- University of Sheffield (GB)
Publication Details
- Journal
- Advances in Methods and Practices in Psychological Science
- Published
- 2025-04-01
- DOI
- https://doi.org/10.1177/25152459251336127
- Citations
- 2
- Primary Topic
- Meta-analysis and systematic reviews
- Type
- article
- Field-Weighted Citation Impact
- 2.80
Funders
- Nederlandse Organisatie voor Wetenschappelijk Onderzoek
- National Institutes of Health
- Defence Science and Technology Group
- Office of Naval Research
- National Eye Institute