Influence of Metadata on Quality Evaluation of Unstructured Information Artefacts

Unstructured information artefacts such as social media posts, news articles, and company annual reports are heavily used by knowledge workers in their daily tasks. Such artefacts may stem from a variety of sources with questionable or at least unknown quality. This presents unique challenges for knowledge workers in effectively and efficiently evaluating the quality relative to the task at hand. Metadata holds the potential to enhance this process; however, there is limited research investigating how users interact with metadata to assess the quality. In this paper, we investigate how users engage with metadata during tasks that require them to use such information artefacts. We use a lab experiment, with eye-tracking and retrospective think-aloud methods, to explore user behaviour and cognitive processes during data quality evaluation when interacting with metadata associated with large PDF documents. The results of our study contribute to the understanding of the relationship between metadata usage and data quality evaluation, providing insights to guide the design of data quality assessment tools.

Publication Details

Journal
Journal of the Association for Information Systems
Published
2024-12-10
Primary Topic
Cultural Heritage Materials Analysis
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Influence of Metadata on Quality Evaluation of Unstructured Information Artefacts

Journal of the Association for Information Systems
Cultural Heritage Materials Analysis
article

Influence of Metadata on Quality Evaluation of Unstructured Information Artefacts

article en

Abstract

Unstructured information artefacts such as social media posts, news articles, and company annual reports are heavily used by knowledge workers in their daily tasks. Such artefacts may stem from a variety of sources with questionable or at least unknown quality. This presents unique challenges for knowledge workers in effectively and efficiently evaluating the quality relative to the task at hand. Metadata holds the potential to enhance this process; however, there is limited research investigating how users interact with metadata to assess the quality. In this paper, we investigate how users engage with metadata during tasks that require them to use such information artefacts. We use a lab experiment, with eye-tracking and retrospective think-aloud methods, to explore user behaviour and cognitive processes during data quality evaluation when interacting with metadata associated with large PDF documents. The results of our study contribute to the understanding of the relationship between metadata usage and data quality evaluation, providing insights to guide the design of data quality assessment tools.

Journal of the Association for Information Systems
Openalex Percentile: Top 27%
Cultural Heritage Materials Analysis
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.