An open science dashboard for the biomedical community: a user-centered design

The adoption of UNESCO's Recommendations on Open Science cemented open science’s (OS) position as a global science policy. Despite the recognition of its importance, policymakers often do not typically monitor adherence with their policies (Larivière & Sugimoto, 2018). This research-in-progress paper presents the development of an automated biomedical OS dashboard to track practices at the institutional level. The development of the dashboard follows a user-centered design. We were able to successfully automate, using primarily open source tools, a total of 9/19 open science practices identified from a community-consensus Delphi study (Cobey et al., 2023). Each of these practices achieved greater than 85% reliability compared to a manual extraction exercise used to validate the automation of each OS practice. Results from the usability testing indicate that users find the information clear and easy to understand, with modifications made to the dashboard to improve interpretation of metrics and usability.