Event-centric human value understanding in news-domain texts: An actor-conditioned benchmark across multi-scope event contexts

This work presents NEVU , a benchmark for actor-conditioned , event-centric , and direction-aware human value recognition in news-domain texts. NEVU evaluates whether models can infer values from event-structured evidence, attribute them to the correct social actors, and determine their aligned or contradictory direction. Built from 2865 English news articles, NEVU represents news at four semantic levels, from subevents to composite events and full articles. Using a hierarchical taxonomy of 54 fine-grained and 20 coarse-grained values, the benchmark contains 46,589 semantic units, 72,905 annotated unit–actor pairs, and 168,061 directed value instances. NEVU is constructed through a staged LLM-assisted annotation and verification pipeline, with targeted human verification for unresolved cases. Candidate-level acceptance and agreement are further examined through a multi-group assessment. The experiments show that prompting-only models remain limited, whereas LoRA-tuned open-weight models substantially improve performance, with overall Micro-F1 gains of 29.77 and 8.21 percentage points over the strongest prompting-only open-weight and proprietary baselines, respectively. These gains primarily reflect learnability under the NEVU reference-label setting. NEVU provides a structured benchmark for systematic evaluation and supervised adaptation of actor-conditioned human value recognition in English news.

Authors

Institutions

Publication Details

Journal
Information Processing & Management
Published
2026-09-16
DOI
https://doi.org/10.1016/j.ipm.2026.105144
Primary Topic
Language, Metaphor, and Cognition
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
article

Event-centric human value understanding in news-domain texts: An actor-conditioned benchmark across multi-scope event contexts

Noriko Kando, Kyoung‐Sook Kim, Adam Jatowt, Hai-Tao Yu et al.
Information Processing & Management
Language, Metaphor, and Cognition
article

Event-centric human value understanding in news-domain texts: An actor-conditioned benchmark across multi-scope event contexts

Noriko Kando, Kyoung‐Sook Kim, Adam Jatowt, Hai-Tao Yu, Zhuochen Liu, Jiankang Chen, Yao Wang, Xin Liu
article en

Abstract

This work presents NEVU , a benchmark for actor-conditioned , event-centric , and direction-aware human value recognition in news-domain texts. NEVU evaluates whether models can infer values from event-structured evidence, attribute them to the correct social actors, and determine their aligned or contradictory direction. Built from 2865 English news articles, NEVU represents news at four semantic levels, from subevents to composite events and full articles. Using a hierarchical taxonomy of 54 fine-grained and 20 coarse-grained values, the benchmark contains 46,589 semantic units, 72,905 annotated unit–actor pairs, and 168,061 directed value instances. NEVU is constructed through a staged LLM-assisted annotation and verification pipeline, with targeted human verification for unresolved cases. Candidate-level acceptance and agreement are further examined through a multi-group assessment. The experiments show that prompting-only models remain limited, whereas LoRA-tuned open-weight models substantially improve performance, with overall Micro-F1 gains of 29.77 and 8.21 percentage points over the strongest prompting-only open-weight and proprietary baselines, respectively. These gains primarily reflect learnability under the NEVU reference-label setting. NEVU provides a structured benchmark for systematic evaluation and supervised adaptation of actor-conditioned human value recognition in English news.

Information Processing & ManagementVol. 64(2)
University of Tsukuba (JP), National Institute of Informatics (JP), Universität Innsbruck (AT), National Institute of Advanced Industrial Science and Technology (JP)
National Institute of Informatics, Japan Society for the Promotion of Science, Japan Science and Technology Agency
Openalex Percentile: Top 7%
Language, Metaphor, and Cognition
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.