Quality assessment in multilingual, multimodal, and multiagent translation and interpreting (QAM <sup>3</sup> T&amp;I): Proposing a unifying framework for research

Quality assessment (QA) plays a crucial role in translation and interpreting (T&amp;I). The rapid digitalisation of communication and the growing demand for accessibility have expanded T&amp;I services across multiple languages (multilingual), through various communication channels encompassing text, visuals, and audio (multimodal), and by different agents including humans, machines, and their hybrid forms (multiagent). This diversity in languages, modes, and agents, along with their combinations, significantly broadens the scope of QA. In this article, I first propose a unifying framework for conceptualising QA research. Then, I apply this framework to systematically analyse 306 research articles on QA, selected from 6,974 articles published in 22 representative sources between 2015 and 2024. The review reveals that: (a) most QA studies focus on language pairs involving English; (b) three assessment scenarios—machine evaluation of machine T&amp;I, human evaluation of machine T&amp;I, and human evaluation of human T&amp;I—dominate, together accounting for 97.1% of all QA practices, and (c) the QA research primarily concerns such assessment facets as objects, agents, and instruments, while other facets remain under-explored. Based on these findings, I outline an agenda for advancing QA research to address overlooked facets and adapt to the evolving complexities of T&amp;I practices.

Authors

Institutions

Publication Details

Journal
Interpreting and Society
Published
2025-03-01
DOI
https://doi.org/10.1177/27523810251322645
Citations
3
Primary Topic
Natural Language Processing Techniques
Type
article
Field-Weighted Citation Impact
7.44
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Quality assessment in multilingual, multimodal, and multiagent translation and interpreting (QAM 3 T&I): Proposing a unifying framework for research

Chao Han
3 citations
Interpreting and Society
Natural Language Processing Techniques
7.44
article

Quality assessment in multilingual, multimodal, and multiagent translation and interpreting (QAM 3 T&I): Proposing a unifying framework for research

Chao Han
article en
3 citations

Abstract

Quality assessment (QA) plays a crucial role in translation and interpreting (T&amp;I). The rapid digitalisation of communication and the growing demand for accessibility have expanded T&amp;I services across multiple languages (multilingual), through various communication channels encompassing text, visuals, and audio (multimodal), and by different agents including humans, machines, and their hybrid forms (multiagent). This diversity in languages, modes, and agents, along with their combinations, significantly broadens the scope of QA. In this article, I first propose a unifying framework for conceptualising QA research. Then, I apply this framework to systematically analyse 306 research articles on QA, selected from 6,974 articles published in 22 representative sources between 2015 and 2024. The review reveals that: (a) most QA studies focus on language pairs involving English; (b) three assessment scenarios—machine evaluation of machine T&amp;I, human evaluation of machine T&amp;I, and human evaluation of human T&amp;I—dominate, together accounting for 97.1% of all QA practices, and (c) the QA research primarily concerns such assessment facets as objects, agents, and instruments, while other facets remain under-explored. Based on these findings, I outline an agenda for advancing QA research to address overlooked facets and adapt to the evolving complexities of T&amp;I practices.

Interpreting and SocietyVol. 5(1)
National University of Singapore (SG)
Quality Education
Openalex Percentile: Top 3%
Natural Language Processing Techniques
7.44
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.