A Journey of Language Tasks Evaluation: A Keynote at SIGIR 2024

This is a narrative form of my acceptance talk upon receiving the ACM SIGIR 2024 Gerard Salton award. It recaps my information retrieval career and offers my opinions on how best to foster research through evaluation. In particular, I explore how to evaluate the evaluation to ensure that test sets are useful measurement devices. Date : 15 July 2024.

Authors

Ellen M. Voorhees (ORCID: https://orcid.org/0000-0002-5658-2308)

Institutions

National Institute of Standards and Technology (US)

Publication Details

Journal: ACM SIGIR Forum
Published: 2024-12-01
DOI: https://doi.org/10.1145/3722449.3722452
Primary Topic: Natural Language Processing Techniques
Type: article
Field-Weighted Citation Impact: 0.00

Controls

|||

ALL TIME

JAN

FEB

MAR

APR

MAY

JUN

JUL

AUG

SEP

OCT

article

A Journey of Language Tasks Evaluation: A Keynote at SIGIR 2024

Ellen M. Voorhees

Dec 1, 2024

ACM SIGIR Forum

Natural Language Processing Techniques

article

A Journey of Language Tasks Evaluation: A Keynote at SIGIR 2024

Ellen M. Voorhees

December 1, 2024article en

Abstract

ACM SIGIR ForumVol. 58(2)

National Institute of Standards and Technology (US)

Openalex Percentile: Top 74%

Natural Language Processing Techniques

DOI Source OpenAlex

AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

A Journey of Language Tasks Evaluation: A Keynote at SIGIR 2024 — Ellen M. Voorhees · ACM SIGIR Forum (2024) | TGRS Research Map | TGRS