Surfacing Text Changes in Archived Webpages

Webpages change over time, and web archives hold copies of historical versions of webpages. Users of web archives, such as journalists, want to find and view changes on webpages over time. However, the current search interfaces for web archives do not adequately support this task. For the web archives that include a full-text search feature, multiple versions of the same webpage that match the search query are shown individually without enumerating changes, or are grouped together in a way that hides changes. We present a change text search engine that allows users to find changes in webpages. We describe the implementation of the search engine backend and frontend, including a tool that allows users to view the changes between two webpage versions in context as an animation. We also propose changes to the Internet Archive’s Wayback Machine replay navigation banner to further support users viewing change over time. We evaluate the search engine with U.S. federal environmental webpages that changed between 2016 and 2020. The change text search results page can clearly show when terms and phrases were added or removed from webpages. The inverted index can also be queried to identify salient and frequently deleted terms in a corpus. We align the dataset to with a real-world click dataset, showing that users were searching for the same environmental terms that were ultimately deleted.

Institutions

Publication Details

Journal
ODU Digital Commons (Old Dominion University)
Published
2024-10-07
DOI
https://doi.org/10.25777/zaq9-sb74
Primary Topic
Species Distribution and Climate Change
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Surfacing Text Changes in Archived Webpages

ODU Digital Commons (Old Dominion University)
Species Distribution and Climate Change
article

Surfacing Text Changes in Archived Webpages

article en

Abstract

Webpages change over time, and web archives hold copies of historical versions of webpages. Users of web archives, such as journalists, want to find and view changes on webpages over time. However, the current search interfaces for web archives do not adequately support this task. For the web archives that include a full-text search feature, multiple versions of the same webpage that match the search query are shown individually without enumerating changes, or are grouped together in a way that hides changes. We present a change text search engine that allows users to find changes in webpages. We describe the implementation of the search engine backend and frontend, including a tool that allows users to view the changes between two webpage versions in context as an animation. We also propose changes to the Internet Archive’s Wayback Machine replay navigation banner to further support users viewing change over time. We evaluate the search engine with U.S. federal environmental webpages that changed between 2016 and 2020. The change text search results page can clearly show when terms and phrases were added or removed from webpages. The inverted index can also be queried to identify salient and frequently deleted terms in a corpus. We align the dataset to with a real-world click dataset, showing that users were searching for the same environmental terms that were ultimately deleted.

ODU Digital Commons (Old Dominion University)
Dominion University College (GH), Old Dominion University (US)
Openalex Percentile: Top 79%
Species Distribution and Climate Change
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.