Energy policy-making in the European Union between past and present

We use instruments from sociology of quantification to investigate a persistent paradox: the problematic technical quality of modelling studies when these are aimed at policy analysis. We review new and old instances of this paradox, focusing specifically on two energy assessment studies: one performed in the eighties and one recent. We apply sensitivity auditing, an existing checklist for the quality of quantification at the science-policy interface, which appraises the overall model framing process and application. The old energy assessment case is a study that was the subject of a pointed criticism by sociologist of science and technology Brian Wynne in a paper published in 1984. The recent impact analysis is from the European Commission, aimed to inform the selection of greenhouse-gases emission targets for 2040 in the European Union. The similarities in the shortcomings identified by Wynne and those we see in the European Commission one using sensitivity auditing seem to indicate that the lesson from that controversy was not learned, or that at a more fundamental level the purpose of these relevant institutional analyses is not to trace a path to a sustainable energy future but to reassure and confirm present policy agendas and visions, along the lines of a policy-based evidence strategy well known to sociologists of quantification. We investigate how modelling plays a key role in facilitating these analytic distortions, and conclude with some suggestions for progress, anchored to the double nature—technical and normative—of quantification and on the need for more analytic lenses to be systematically deployed when reading a policy assessment that builds on models. • Sociology of quantification helps assess model-based impact assessment quality. • Sensitivity auditing frames modelling at the science-policy interface. • We contrast a 1980s energy study and a 2024 EU impact assessment on emissions. • Auditing reveals persistent flaws when models are used to inform policy. • Key uncertainties and policy-relevant dimensions are often overlooked.

Authors

Institutions

Publication Details

Journal
Energy Research & Social Science
Published
2025-08-26
DOI
https://doi.org/10.1016/j.erss.2025.104296
Citations
1
Primary Topic
Global Energy and Sustainability Research
Type
article
Field-Weighted Citation Impact
0.36
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Energy policy-making in the European Union between past and present

Andrea Saltelli, Samuele Lo Piano
1 citations
Energy Research & Social Science
Global Energy and Sustainability Research
0.36
article

Energy policy-making in the European Union between past and present

Andrea Saltelli, Samuele Lo Piano
article en
1 citations

Abstract

We use instruments from sociology of quantification to investigate a persistent paradox: the problematic technical quality of modelling studies when these are aimed at policy analysis. We review new and old instances of this paradox, focusing specifically on two energy assessment studies: one performed in the eighties and one recent. We apply sensitivity auditing, an existing checklist for the quality of quantification at the science-policy interface, which appraises the overall model framing process and application. The old energy assessment case is a study that was the subject of a pointed criticism by sociologist of science and technology Brian Wynne in a paper published in 1984. The recent impact analysis is from the European Commission, aimed to inform the selection of greenhouse-gases emission targets for 2040 in the European Union. The similarities in the shortcomings identified by Wynne and those we see in the European Commission one using sensitivity auditing seem to indicate that the lesson from that controversy was not learned, or that at a more fundamental level the purpose of these relevant institutional analyses is not to trace a path to a sustainable energy future but to reassure and confirm present policy agendas and visions, along the lines of a policy-based evidence strategy well known to sociologists of quantification. We investigate how modelling plays a key role in facilitating these analytic distortions, and conclude with some suggestions for progress, anchored to the double nature—technical and normative—of quantification and on the need for more analytic lenses to be systematically deployed when reading a policy assessment that builds on models. • Sociology of quantification helps assess model-based impact assessment quality. • Sensitivity auditing frames modelling at the science-policy interface. • We contrast a 1980s energy study and a 2024 EU impact assessment on emissions. • Auditing reveals persistent flaws when models are used to inform policy. • Key uncertainties and policy-relevant dimensions are often overlooked.

Energy Research & Social ScienceVol. 127
Gdańsk University of Technology (PL), Barcelona School of Economics (ES), UPF Barcelona School of Management (ES), University of Bergen (NO)
Affordable and clean energy
Openalex Percentile: Top 40%
Global Energy and Sustainability Research
0.36
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.