Open evaluation of research-related activities - practical considerations

Abstract: This repo contains materials related to a presentation given on 5 September 2024 at the University of Pisa as part of the Annual Meeting 2024 of the Gruppo Telecomunicazioni e Tecnologie dell'Informazione (GTTI). Abstract: The complex nature of the research landscape provides ample opportunities to evaluate specific contributions, yet doing so in a way that spans across multiple contexts is challenging. Opening up this landscape tends to complicate the picture even further. Prevailing evaluation paradigms of research-related activities are strongly biased towards certain types of contributions, and they lack transparency and alignment with societal needs. Such evaluation workflows can be opened up in various ways too, and this talk will zoom in on practical aspects of that from the perspective of multiple stakeholders in the research landscape. While the slides are mostly in English, there are a few comments in Italian sprinkled in; they are referring to elements of the preceding presentation by Marco Malgarini (ANVUR) in the same session.