Beyond metrics: shifting measures of research impact from citations and journal rankings to meaningful impacts on society

Purpose The purpose of this paper is to point out that most research published in hospitality and tourism industry journals is of no value to the visitor industries or society. It argues that a primary reason is the academic practice of evaluating the utility of its research with the inappropriate metrics of journal impact factors and citation counts. To become relevant, academic leaders must refocus evaluation of the field’s research on its meaningful impacts on society. Design/methodology/approach This study reviews the literature that differentiates the constructs of research quality and research impact and identifies their limitations. Findings The contention that either journal impact factors or citation counts adequately measure the usefulness of research is challenged. It is suggested that reliance on them has resulted in an academic self-serving “echo chamber.” The author argues the field should refocus away from the echo chamber to shift the primary evaluation of research to societal impact. Illustrations are offered from the author’s recent experiences that illustrate the fallacy of confusing citation counts with impact. The challenges of shifting to an impact assessment from the existing system are acknowledged, and a way forward is proposed. Research limitations/implications Continuing to embrace beguiling measures that are invested with a conventional, but false, aura of truth inevitably means the field’s scholarship will continue to be ignored. Originality/value An analytical critique of the prevailing metrics is undertaken, and a five-step process to shift the emphasis to societal impact is offered.

Authors

Institutions

Publication Details

Journal
International Journal of Contemporary Hospitality Management
Published
2025-02-28
DOI
https://doi.org/10.1108/ijchm-08-2024-1201
Citations
3
Primary Topic
scientometrics and bibliometrics research
Type
article
Field-Weighted Citation Impact
4.20
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Beyond metrics: shifting measures of research impact from citations and journal rankings to meaningful impacts on society

John L. Crompton
3 citations
International Journal of Contemporary Hospitality Management
scientometrics and bibliometrics research
4.20
article

Beyond metrics: shifting measures of research impact from citations and journal rankings to meaningful impacts on society

John L. Crompton
article en
3 citations

Abstract

Purpose The purpose of this paper is to point out that most research published in hospitality and tourism industry journals is of no value to the visitor industries or society. It argues that a primary reason is the academic practice of evaluating the utility of its research with the inappropriate metrics of journal impact factors and citation counts. To become relevant, academic leaders must refocus evaluation of the field’s research on its meaningful impacts on society. Design/methodology/approach This study reviews the literature that differentiates the constructs of research quality and research impact and identifies their limitations. Findings The contention that either journal impact factors or citation counts adequately measure the usefulness of research is challenged. It is suggested that reliance on them has resulted in an academic self-serving “echo chamber.” The author argues the field should refocus away from the echo chamber to shift the primary evaluation of research to societal impact. Illustrations are offered from the author’s recent experiences that illustrate the fallacy of confusing citation counts with impact. The challenges of shifting to an impact assessment from the existing system are acknowledged, and a way forward is proposed. Research limitations/implications Continuing to embrace beguiling measures that are invested with a conventional, but false, aura of truth inevitably means the field’s scholarship will continue to be ignored. Originality/value An analytical critique of the prevailing metrics is undertaken, and a five-step process to shift the emphasis to societal impact is offered.

International Journal of Contemporary Hospitality ManagementVol. 37(5)
Texas College (US), Texas A&M University (US)
Openalex Percentile: Top 6%
scientometrics and bibliometrics research
4.20
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.