Blinded by Context: Unveiling the Halo Effect of MLLM in AI Hiring

This study investigates the halo effect in AIdriven hiring evaluations using Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs).Through experiments with hypothetical job applications, we examined how these models' evaluations are influenced by non-job-related information, including extracurricular activities and social media images.By analyzing models' responses to Likert-scale questions across different competency dimensions, we found that AI models exhibit significant halo effects, particularly in image-based evaluations, while text-based assessments showed more resistance to bias.The findings demonstrate that supplementary multimodal information can substantially influence AI hiring decisions, highlighting potential risks in AI-based recruitment systems.

Authors

Institutions

Publication Details

Published
2025-01-01
DOI
https://doi.org/10.18653/v1/2025.findings-acl.1338
Primary Topic
Reinforcement Learning in Robotics
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Blinded by Context: Unveiling the Halo Effect of MLLM in AI Hiring

Jae‐Kyun Ryu, Bongwon Suh, Haemin Jeon, Kyusik Kim
Reinforcement Learning in Robotics
article

Blinded by Context: Unveiling the Halo Effect of MLLM in AI Hiring

Jae‐Kyun Ryu, Bongwon Suh, Haemin Jeon, Kyusik Kim
article en

Abstract

This study investigates the halo effect in AIdriven hiring evaluations using Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs).Through experiments with hypothetical job applications, we examined how these models' evaluations are influenced by non-job-related information, including extracurricular activities and social media images.By analyzing models' responses to Likert-scale questions across different competency dimensions, we found that AI models exhibit significant halo effects, particularly in image-based evaluations, while text-based assessments showed more resistance to bias.The findings demonstrate that supplementary multimodal information can substantially influence AI hiring decisions, highlighting potential risks in AI-based recruitment systems.

Seoul National University of Education (KR)
National Research Foundation, Seoul National University, Ministry of Agriculture, Food and Rural Affairs, National Research Foundation of Korea, Ministry of Science and ICT, South Korea, Institute for Information and Communications Technology Promotion, Korea Institute of Planning and Evaluation for Technology in Food, Agriculture and Forestry
Openalex Percentile: Top 90%
Reinforcement Learning in Robotics
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.