Evaluating the cross-disciplinary utility of anonymizing applications for scientific equipment in the Australian research sector

Abstract Anonymizing applications for research resources has been demonstrated to reduce bias against women, early career researchers and other marginalized researchers, specifically for applications to use scientific equipment in planetary and space science research. We conducted a nationwide trial in Australia to evaluate the cross-disciplinary impacts of anonymizing applications for use of scientific equipment. The twofold purpose of the study was to examine whether disparities existed–and if so, to quantify their size and direction–and to evaluate how anonymizing applications would impact application outcomes, based on the gender and career seniority of the lead researcher. The trial involved applications to four Australian research entities managing access to national scientific facilities. Entity-specific modelling was carried out, followed by a meta-analysis to assess overall effects. Our evaluation reveals a noteworthy absence of gender and career seniority disparities in application outcomes before anonymization across most entities, with one exception where women-led applications received more resources in a specific program. The introduction of anonymization led to improved success rates for early-career researchers, while generally maintaining existing gender parity, with one entity showing improved success rates for women-led applications. The implications extend beyond funding outcomes, which represent only one piece of the puzzle contributing to inequity in STEM research. By enhancing success rates for early career researchers, anonymization may create a ripple effect by diversifying the research pool, and supporting, retaining and advancing researchers facing barriers in STEM research. Future research examining cultural, racial, and other biases is key to refining equity efforts.

Authors

Institutions

Publication Details

Journal
Research Evaluation
Published
2024-12-27
DOI
https://doi.org/10.1093/reseval/rvaf031
Citations
1
Primary Topic
scientometrics and bibliometrics research
Type
article
Field-Weighted Citation Impact
0.46

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Evaluating the cross-disciplinary utility of anonymizing applications for scientific equipment in the Australian research sector

Isabelle Kingsley, Lisa Harvey-Smith, Lisa A. Williams, Amanda B Chan et al.
1 citations
Research Evaluation
scientometrics and bibliometrics research
0.46
article

Evaluating the cross-disciplinary utility of anonymizing applications for scientific equipment in the Australian research sector

Isabelle Kingsley, Lisa Harvey-Smith, Lisa A. Williams, Amanda B Chan, Nicholas Ho
article en
1 citations

Abstract

Abstract Anonymizing applications for research resources has been demonstrated to reduce bias against women, early career researchers and other marginalized researchers, specifically for applications to use scientific equipment in planetary and space science research. We conducted a nationwide trial in Australia to evaluate the cross-disciplinary impacts of anonymizing applications for use of scientific equipment. The twofold purpose of the study was to examine whether disparities existed–and if so, to quantify their size and direction–and to evaluate how anonymizing applications would impact application outcomes, based on the gender and career seniority of the lead researcher. The trial involved applications to four Australian research entities managing access to national scientific facilities. Entity-specific modelling was carried out, followed by a meta-analysis to assess overall effects. Our evaluation reveals a noteworthy absence of gender and career seniority disparities in application outcomes before anonymization across most entities, with one exception where women-led applications received more resources in a specific program. The introduction of anonymization led to improved success rates for early-career researchers, while generally maintaining existing gender parity, with one entity showing improved success rates for women-led applications. The implications extend beyond funding outcomes, which represent only one piece of the puzzle contributing to inequity in STEM research. By enhancing success rates for early career researchers, anonymization may create a ripple effect by diversifying the research pool, and supporting, retaining and advancing researchers facing barriers in STEM research. Future research examining cultural, racial, and other biases is key to refining equity efforts.

Research EvaluationVol. 34
Australian Government (AU), UNSW Sydney (AU), Kensington Health (CA)
National Computational Infrastructure, Astronomy Australia Limited, Australian Government, Analytical Center for the Government of the Russian Federation, University of New South Wales
Openalex Percentile: Top 25%
scientometrics and bibliometrics research
0.46
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.