EVALUATING THE EVALUATOR: TRANSLATION QUALITY IN THE INDUSTRY

Background. A considerable number of studies have been devoted to specialized translation quality assessment, resulting in the development of various universal or specific approaches and models. However, the industry domain remains understudied, particularly the principles, approaches, and work quality of entities providing translation quality evaluation services. This study aims to identify and evaluate the relevant principles and criteria used by collective providers of translation quality evaluation services through the lens of ISO 17100 and ISO 5060 standards. Additionally, this article focuses on evaluating specialists’ sensitivity to translation quality. Methods. The comprehensively formulated methodology encompasses a blind translator experiment incorporating two collective providers of translation quality evaluation services, comparative translation analysis and related comparative-descriptive method, as well as the method of generalization. Results. The experimental results demonstrated that Ukrainian professional service providers’ approaches to translation quality evaluation conceptually do not align with the principles outlined in ISO 17100 and ISO 5060 standards, as none of the participants categorized errors or provided translation quality evaluation according to any scale. The Ukrainian translation market shows reduced sensitivity of service providers to translation quality in terms of terminology and its consistency, translation accuracy, language norms, and other categories. The evaluators’ interventions were characterized by inconsistency, selectivity, and occasionally low quality. Conclusions. The results of this study revealed conceptual flaws in approaches to specialized translation quality evaluation in the industry domain, low sensitivity of service providers to translation quality, and a lack of awareness regarding the multifaceted nature of quality. These findings indicate the need to develop a universal translation quality evaluation system and highlight the importance of training future specialists in fundamental principles of specialized translation quality evaluation services. Keywords: translation quality, quality evaluation, blind translator experiment, evaluator.