Benchmarking with and of Research Software

Benchmarking is an empirical method used in software engineering research, alongside various other research methods. Benchmarks can be used to compare different software development methods, techniques, and tools. Research software is software that is designed and developed to support research activities. It is typically developed to meet specific research needs, and often has unique requirements that differ from those of commercial software. Research software engineering (RSE) is a specialized field that applies software engineering principles to address the unique challenges of developing software for scientific and academic research. The aim is to enhance the efficiency, reproducibility, and impact of research outcomes. Technology research software is a special category of research software covering research software developed in technology research. In this context, the research software itself is a key research tool. For instance, it may take the form of a software prototype that demonstrates or explores a novel software development approach. In this talk, I will present an integrated perspective on benchmarking as an empirical software engineering method, as well as exploring the roles of research software in this context.