ERIP Handbook on integrity, data, and AI in research evaluation

The ERIP Handbook on integrity, data, and AI in research evaluation is the guide of the Coalition for Advancing Research Assessment’s Working Group on Ethics and Research Integrity Policy for Responsible Research Assessment in Data and Artificial Intelligence (CoARA-ERIP) to the ethics and integrity of research assessment where data and artificial intelligence are involved. It is written for policymakers, funders, research-performing organisations, assessment committees, researchers, and students. It consists of ten briefs, each self-standing, which state the essentials of the working group’s record and lead to the full documents by their persistent identifiers: the purpose of the handbook; the key terms; the community and bodies engaged; the policy framework; the methodological guidelines; the assessment of digital contributions; the use of AI in assessment; the lessons of the SE4RA pilots; the digital assessment tools; and a selected, annotated list of references. The handbook holds throughout to one position: data and AI can inform research assessment, but they do not replace the judgement of accountable people, and evidence of contribution is mapped, not reduced to scores or ranks.