Tracking Research Objects Levelling the playing field in research assessment

Case study presentations by Esther and Meron on 22 October 2024 for the Open Science Festival session, round 4 of the parallel sessions. Abstract: Including Open Science practices in the evaluation of researcher performance is currently a contested subject within academia and a topic on the agenda of several initiatives already that try to change research assessment (such as COARA, Adore declaration, DORA, Recognition & Rewards, and Hidden REF). Although many researchers contribute to their field of expertise in a multitude of manners, the most stringent criteria of success is the number of research articles published. Subverting the current “publish or perish” culture requires a novel approach to the assessment of research objects (such as software, data and methods) other than research articles. Appropriate tracking of research objects is a prerequisite for their assessment. However, despite infrastructure already being available to track research objects (such as the Research Software Directory) there is currently no standardised way to track and subsequently assess such research objects. This session aims to provide an overview of some of the existing developments and case studies (~20 minutes), as well as to provide a space to discuss our needs and requirements regarding the tracking of research objects (~40 minutes). This includes discussing questions such as: Should we track research objects or has this the risk to reinforce the publish or perish culture? Are there any examples in the Netherlands where tracking of research objects have been successful? Can tracking of research objects incentivize researchers to share their research outputs in accordance with the FAIR principles, or do we need other tools? What technological infrastructure would be needed to effectively track research objects - Are there existing tools that can be adapted for this purpose? How can we balance quantitative and qualitative metrics in the evaluation of research objects? How can tracking research objects promote equity and inclusion within the research community? Please bring your examples, recommended practices and questions (and answers!) to the session! Session page: https://opensciencefestival.nl/en/programme/tracking-research-objects-levelling-the-playing-field-in-research-assessment

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2024-10-18
DOI
https://doi.org/10.5281/zenodo.13952611
Primary Topic
Research Data Management Practices
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Tracking Research Objects Levelling the playing field in research assessment

Zenodo (CERN European Organization for Nuclear Research)
Research Data Management Practices
article

Tracking Research Objects Levelling the playing field in research assessment

article en

Abstract

Case study presentations by Esther and Meron on 22 October 2024 for the Open Science Festival session, round 4 of the parallel sessions. Abstract: Including Open Science practices in the evaluation of researcher performance is currently a contested subject within academia and a topic on the agenda of several initiatives already that try to change research assessment (such as COARA, Adore declaration, DORA, Recognition & Rewards, and Hidden REF). Although many researchers contribute to their field of expertise in a multitude of manners, the most stringent criteria of success is the number of research articles published. Subverting the current “publish or perish” culture requires a novel approach to the assessment of research objects (such as software, data and methods) other than research articles. Appropriate tracking of research objects is a prerequisite for their assessment. However, despite infrastructure already being available to track research objects (such as the Research Software Directory) there is currently no standardised way to track and subsequently assess such research objects. This session aims to provide an overview of some of the existing developments and case studies (~20 minutes), as well as to provide a space to discuss our needs and requirements regarding the tracking of research objects (~40 minutes). This includes discussing questions such as: Should we track research objects or has this the risk to reinforce the publish or perish culture? Are there any examples in the Netherlands where tracking of research objects have been successful? Can tracking of research objects incentivize researchers to share their research outputs in accordance with the FAIR principles, or do we need other tools? What technological infrastructure would be needed to effectively track research objects - Are there existing tools that can be adapted for this purpose? How can we balance quantitative and qualitative metrics in the evaluation of research objects? How can tracking research objects promote equity and inclusion within the research community? Please bring your examples, recommended practices and questions (and answers!) to the session! Session page: https://opensciencefestival.nl/en/programme/tracking-research-objects-levelling-the-playing-field-in-research-assessment

Zenodo (CERN European Organization for Nuclear Research)
Vrije Universiteit Amsterdam (NL), Delft University of Technology (NL)
Openalex Percentile: Top 34%
Research Data Management Practices
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.