New data for customised research evaluation - SYOS presentation

Slides of a Lightning Talk given at the 5th Swiss Year of Scientometrics Workshop on 14 November 2024. There is agreement that impact factors and h-indexes are not valid and reliable indicators for assessments of research and researchers. It has become clear that there is no simple one indicator to take over the role of impact factors and h-indexesHence we need to look at what kind of assessment stakeholders do want and to what extent that can be supported with indicators being developed. Future research assessment is expected to be more customised and thus use diverse data for specific fields, levels (from individual to country/discipline) and goals. Customisation is a lot of work, hence the need to openly develop and share approaches, code and pipelines, for others to tweak to their needs.Link to online version of this presentation (Google Slides): https://edu.nl/abvcxBased on poster presented at STI2024: https://doi.org/10.5281/zenodo.13311430

Institutions

Publication Details

Journal
Zenodo (CERN European Organization for Nuclear Research)
Published
2024-11-22
DOI
https://doi.org/10.5281/zenodo.14202727
Primary Topic
scientometrics and bibliometrics research
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

New data for customised research evaluation - SYOS presentation

Zenodo (CERN European Organization for Nuclear Research)
scientometrics and bibliometrics research
article

New data for customised research evaluation - SYOS presentation

article en

Abstract

Slides of a Lightning Talk given at the 5th Swiss Year of Scientometrics Workshop on 14 November 2024. There is agreement that impact factors and h-indexes are not valid and reliable indicators for assessments of research and researchers. It has become clear that there is no simple one indicator to take over the role of impact factors and h-indexesHence we need to look at what kind of assessment stakeholders do want and to what extent that can be supported with indicators being developed. Future research assessment is expected to be more customised and thus use diverse data for specific fields, levels (from individual to country/discipline) and goals. Customisation is a lot of work, hence the need to openly develop and share approaches, code and pipelines, for others to tweak to their needs.Link to online version of this presentation (Google Slides): https://edu.nl/abvcxBased on poster presented at STI2024: https://doi.org/10.5281/zenodo.13311430

Zenodo (CERN European Organization for Nuclear Research)
Utrecht University (NL)
Partnerships for the goals
Openalex Percentile: Top 60%
scientometrics and bibliometrics research
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.