An Exploration of the Presence of Positive-Results Bias in Qualitative Comparative Analysis

The value of negative results for knowledge advancement stands in contrast to the abundance of positive findings found in quantitative research across research fields. There is reason to believe that positive-results bias is also present in studies that use qualitative comparative analysis (QCA). This possibility has been neglected so far in work on QCA. This article contributes to the field of meta science and QCA by exploring whether hypothesis-testing QCA articles collectively indicate the presence of positive-results bias. An analysis of consistency scores and comparison of hypotheses and findings reported in QCA articles and PhD theses indicate the presence of biases. The results suggest two implications. First, the interpretation fo findings in a field should take into account that negative results may be underreported. Second, QCA research would benefit from exploring techniques that could be integrated into the research and peer-review process to address positive-results bias.

Authors

Institutions

Publication Details

Journal
Sociological Methods & Research
Published
2025-09-01
DOI
https://doi.org/10.1177/00491241251357948
Primary Topic
Qualitative Comparative Analysis Research
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

An Exploration of the Presence of Positive-Results Bias in Qualitative Comparative Analysis

Ingo Rohlfing
Sociological Methods & Research
Qualitative Comparative Analysis Research
article

An Exploration of the Presence of Positive-Results Bias in Qualitative Comparative Analysis

Ingo Rohlfing
article en

Abstract

The value of negative results for knowledge advancement stands in contrast to the abundance of positive findings found in quantitative research across research fields. There is reason to believe that positive-results bias is also present in studies that use qualitative comparative analysis (QCA). This possibility has been neglected so far in work on QCA. This article contributes to the field of meta science and QCA by exploring whether hypothesis-testing QCA articles collectively indicate the presence of positive-results bias. An analysis of consistency scores and comparison of hypotheses and findings reported in QCA articles and PhD theses indicate the presence of biases. The results suggest two implications. First, the interpretation fo findings in a field should take into account that negative results may be underreported. Second, QCA research would benefit from exploring techniques that could be integrated into the research and peer-review process to address positive-results bias.

Sociological Methods & Research
University of Passau (DE)
H2020 European Research Council
Openalex Percentile: Top 69%
Qualitative Comparative Analysis Research
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.