Blinded by Context: Unveiling the Halo Effect of MLLM in AI Hiring
This study investigates the halo effect in AIdriven hiring evaluations using Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs).Through experiments with hypothetical job applications, we examined how these models' evaluations are influenced by non-job-related information, including extracurricular activities and social media images.By analyzing models' responses to Likert-scale questions across different competency dimensions, we found that AI models exhibit significant halo effects, particularly in image-based evaluations, while text-based assessments showed more resistance to bias.The findings demonstrate that supplementary multimodal information can substantially influence AI hiring decisions, highlighting potential risks in AI-based recruitment systems.
Authors
- Jae‐Kyun Ryu
- Bongwon Suh (ORCID: https://orcid.org/0000-0001-5610-9265)
- Haemin Jeon (ORCID: https://orcid.org/0000-0002-8445-0003)
- Kyusik Kim
Institutions
- Seoul National University of Education (KR)
Publication Details
- Published
- 2025-01-01
- DOI
- https://doi.org/10.18653/v1/2025.findings-acl.1338
- Primary Topic
- Reinforcement Learning in Robotics
- Type
- article
- Field-Weighted Citation Impact
- 0.00
Funders
- National Research Foundation
- Seoul National University
- Ministry of Agriculture, Food and Rural Affairs
- National Research Foundation of Korea
- Ministry of Science and ICT, South Korea
- Institute for Information and Communications Technology Promotion
- Korea Institute of Planning and Evaluation for Technology in Food, Agriculture and Forestry