Using Google’s Natural Language Model to Measure Growth of Knowledge in Information Systems Research

The goal of this paper is to propose a new artificial-intelligence (AI) driven method to evaluate how well the information systems (IS) field engages with other disciplines in the process of building IS knowledge. The proposed method combines the veracity and objectivity of quantitative scientometric methods with the semantic depth and interpretive validity of qualitative content analysis methods, both building on theories of citations and disciplinarity. The results find that the IS field relies mostly on reviewed and perfunctory citation functions that do not truly engage with previous research. This evaluation presents a wake-up call to the field to better leverage and engage with theories from previous research. It also showcases the scientometric bases for enhancing the originality of IS research and help the field become intellectually and socially influential. Keywords: Disciplinary theory, citation theory, artificial intelligence (AI) and natural language processing, information systems (IS) knowledge.

Authors

Publication Details

Journal
ScholarSpace (University of Hawaii at Manoa)
Published
2025-12-23
Primary Topic
Computational and Text Analysis Methods
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Using Google’s Natural Language Model to Measure Growth of Knowledge in Information Systems Research

Mauricio Marrone, Nik Rushdi Hassan, Guido Schryen, Jiaqi Yang
ScholarSpace (University of Hawaii at Manoa)
Computational and Text Analysis Methods
article

Using Google’s Natural Language Model to Measure Growth of Knowledge in Information Systems Research

Mauricio Marrone, Nik Rushdi Hassan, Guido Schryen, Jiaqi Yang
article en

Abstract

The goal of this paper is to propose a new artificial-intelligence (AI) driven method to evaluate how well the information systems (IS) field engages with other disciplines in the process of building IS knowledge. The proposed method combines the veracity and objectivity of quantitative scientometric methods with the semantic depth and interpretive validity of qualitative content analysis methods, both building on theories of citations and disciplinarity. The results find that the IS field relies mostly on reviewed and perfunctory citation functions that do not truly engage with previous research. This evaluation presents a wake-up call to the field to better leverage and engage with theories from previous research. It also showcases the scientometric bases for enhancing the originality of IS research and help the field become intellectually and socially influential. Keywords: Disciplinary theory, citation theory, artificial intelligence (AI) and natural language processing, information systems (IS) knowledge.

ScholarSpace (University of Hawaii at Manoa)
Quality Education
Openalex Percentile: Top 21%
Computational and Text Analysis Methods
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.