Using the ODD protocol and NetLogo to replicate agent-based models

• ODD protocol and NetLogo were used for model replication • 15 out of 18 agent-based models from different disciplines were successfully replicated • Model replication can support theory development • A checklist to support model replication is provided • Standards such as ODD and quasi-standards such as NetLogo support Good Modelling Practice. Replicating existing models and their key results not only adds credibility to the original work, it also allows modellers to start model development from an existing approach rather than from scratch. New theory can then be developed by changing the assumptions or scenarios tested, or by carrying out more in-depth analysis of the model. However, model replication can be challenging if the original model description is incomplete or ambiguous. Here we show that the use of standards can facilitate and speed up replication: the ODD protocol for describing models, and NetLogo, an easy-to-learn but powerful software platform and language for implementing agent-based models. To demonstrate the benefits of this approach, we conducted a replication experiment on 18 agent-based models from different disciplines. The researchers doing the replications had no or little previous experience using ODD and NetLogo. Their task was to rewrite the original model description using ODD, implement the model in NetLogo and try to replicate at least one exemplary main result. They were also asked to produce, if time allowed, some initial new results with the replicated model, and to record the total time spent on the replication exercise. Replication was successful for 15 out of 18 models. The time taken varied between 2 and 12 days, with an average of 5 days. ODD helped to systematically scan the original model description, while NetLogo proved easy and quick to learn, but difficult to debug when implementation problems arose. Although most of the models replicated were relatively simple, we conclude that even for more complex models it can be useful to use ODD and NetLogo for replication, at least for developing a prototype to help decide how to proceed with the replicated model. Overall, the use of both, standard approaches such as ODD and easy to learn but powerful software such as NetLogo, can promote coherence and efficiency within and between different models and modelling communities. Imagine if all modellers spoke ODD and NetLogo as a common language or lingua franca .

Authors

Institutions

Publication Details

Journal
Ecological Modelling
Published
2024-12-06
DOI
https://doi.org/10.1016/j.ecolmodel.2024.110967
Citations
12
Primary Topic
Opinion Dynamics and Social Influence
Type
article
Field-Weighted Citation Impact
3.37

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Using the ODD protocol and NetLogo to replicate agent-based models

Florian Härtig, Jordi Ferrer, Mathias Franz, Justin M. Calabrese et al.
12 citations
Ecological Modelling
Opinion Dynamics and Social Influence
3.37
article

Using the ODD protocol and NetLogo to replicate agent-based models

Florian Härtig, Jordi Ferrer, Mathias Franz, Justin M. Calabrese, L.S. Premo, Nadja Rüger, Sandro Pütz, Tamara Münkemüller, Julia Touza, Amélie Schmolke, Roger Jovani, Volker Grimm, Cyril Piou, Christine Rademacher, Steven F. Railsback, Uta Berger, Jürgen Groeneveld, Ainara Cortés‐Avizanda, Jan Christoph Thiele, Stephanie Kramer‐Schadt, Oliver Jakoby, Thomas Quintaine
article en
12 citations

Abstract

• ODD protocol and NetLogo were used for model replication • 15 out of 18 agent-based models from different disciplines were successfully replicated • Model replication can support theory development • A checklist to support model replication is provided • Standards such as ODD and quasi-standards such as NetLogo support Good Modelling Practice. Replicating existing models and their key results not only adds credibility to the original work, it also allows modellers to start model development from an existing approach rather than from scratch. New theory can then be developed by changing the assumptions or scenarios tested, or by carrying out more in-depth analysis of the model. However, model replication can be challenging if the original model description is incomplete or ambiguous. Here we show that the use of standards can facilitate and speed up replication: the ODD protocol for describing models, and NetLogo, an easy-to-learn but powerful software platform and language for implementing agent-based models. To demonstrate the benefits of this approach, we conducted a replication experiment on 18 agent-based models from different disciplines. The researchers doing the replications had no or little previous experience using ODD and NetLogo. Their task was to rewrite the original model description using ODD, implement the model in NetLogo and try to replicate at least one exemplary main result. They were also asked to produce, if time allowed, some initial new results with the replicated model, and to record the total time spent on the replication exercise. Replication was successful for 15 out of 18 models. The time taken varied between 2 and 12 days, with an average of 5 days. ODD helped to systematically scan the original model description, while NetLogo proved easy and quick to learn, but difficult to debug when implementation problems arose. Although most of the models replicated were relatively simple, we conclude that even for more complex models it can be useful to use ODD and NetLogo for replication, at least for developing a prototype to help decide how to proceed with the replicated model. Overall, the use of both, standard approaches such as ODD and easy to learn but powerful software such as NetLogo, can promote coherence and efficiency within and between different models and modelling communities. Imagine if all modellers spoke ODD and NetLogo as a common language or lingua franca .

Ecological ModellingVol. 501
Smithsonian Tropical Research Institute (PA), Centre National de la Recherche Scientifique (FR), Centre de Coopération Internationale en Recherche Agronomique pour le Développement (FR), Helmholtz Centre for Environmental Research (DE), Institut Barcelona d'Estudis Internacionals (ES), University of Potsdam (DE), Université de Montpellier (FR), Radiation Effects Research Foundation (JP), Agropolis International (FR), German Centre for Integrative Biodiversity Research (DE), Federal Agency for Nature Conservation (DE), Helmholtz-Zentrum Dresden-Rossendorf (DE), Knorr-Bremse (Germany) (DE), Institut National de Recherche pour l'Agriculture, l'Alimentation et l'Environnement (FR), Estación Biológica de Doñana (ES), Georg Simon Ohm University of Applied Sciences Nuremberg (DE), Max Planck Institute for Evolutionary Anthropology (DE), Meyer Burger Technology (Germany) (DE), Center for Advanced Systems Understanding (DE), Institut Agro Montpelier (FR), Laboratoire d'Écologie Alpine (FR), Centre de Biologie pour la Gestion des Populations (FR), Leibniz Institute for Zoo and Wildlife Research (DE), Hochschule für Technik und Wirtschaft Dresden – University of Applied Sciences (DE), Institut de Recherche pour le Développement (FR), Technische Universität Berlin (DE), University of York (GB), University of Regensburg (DE), University of Maryland, College Park (US), Université Savoie Mont Blanc (FR), Washington State University (US), University of Göttingen (DE), Freie Universität Berlin (DE), Technische Universität Dresden (DE), Université Grenoble Alpes (FR), Leipzig University (DE), Université de Reims Champagne-Ardenne (FR)
Bundesministerium für Bildung und Forschung, Sächsisches Staatsministerium für Wissenschaft und Kunst
Openalex Percentile: Top 7%
Opinion Dynamics and Social Influence
3.37
DOIOpen Access PDFOpenAlex
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.