Enhancing Virtual Hiring Through AI-Driven Fake LipSync Detection and Career Chatbot

The paper introduces an integrated solution that can take care of two of the biggest challenges in the hiring game these days: guaranteeing that video interviews are real, i.e. interactions from a solid candidate, and providing personalized support, such as through an AI chatbot, particularly career-driven. The changing nature of the hiring process to a remote mechanism makes it critical for each candidate to experience this commitment and engagement at the same time as enhancing their experience.The specific point is the detection of Fake LipSync and Expression Tracking, which are used in conjunction with advanced technologies like AWS Rekognition for facial analysis and Wav2Vec2 for speech-to-text analysis. The system looks at the audio-video synchronization in the stored video interviews to point out differences in the spoken voices and lip movements, highlighting possible alterations or manufabricated behaviours. Along with that, there will also be an analysis of various expressions made to give recruiters some background into predisposition, honesty, and necessarily good interpersonal qualities of a potential candidate by dealing with facial landmarks and current lip mismatches of the snapshot performances.The second component, an AI-empowered Career Chatbot, processes the LLaMA language model with an integration that occurs with LangChain in order to enhance document retrieval and provide a real understanding of context. The chatbot learns with the recruitment specific domain which suggestions about jobs will suit someone the most while accommodating him to answer very frequently asked questions and giving information to prepare for interviews. Using the aim of embedding and retrieving information from relevant documents at the right time, the interaction will become more precise, contextual, yet highly improved within the candidate experience on the recruitment platforms.

Authors

Publication Details

Published
2025-05-09
DOI
https://doi.org/10.1109/ginotech63460.2025.11077047
Primary Topic
AI in Service Interactions
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Enhancing Virtual Hiring Through AI-Driven Fake LipSync Detection and Career Chatbot

Swati Shinde, Tirthesh Patange, Pratik Nikat, Chaitanya Nalawade et al.
AI in Service Interactions
article

Enhancing Virtual Hiring Through AI-Driven Fake LipSync Detection and Career Chatbot

Swati Shinde, Tirthesh Patange, Pratik Nikat, Chaitanya Nalawade, Prathamesh Pandit
article en

Abstract

The paper introduces an integrated solution that can take care of two of the biggest challenges in the hiring game these days: guaranteeing that video interviews are real, i.e. interactions from a solid candidate, and providing personalized support, such as through an AI chatbot, particularly career-driven. The changing nature of the hiring process to a remote mechanism makes it critical for each candidate to experience this commitment and engagement at the same time as enhancing their experience.The specific point is the detection of Fake LipSync and Expression Tracking, which are used in conjunction with advanced technologies like AWS Rekognition for facial analysis and Wav2Vec2 for speech-to-text analysis. The system looks at the audio-video synchronization in the stored video interviews to point out differences in the spoken voices and lip movements, highlighting possible alterations or manufabricated behaviours. Along with that, there will also be an analysis of various expressions made to give recruiters some background into predisposition, honesty, and necessarily good interpersonal qualities of a potential candidate by dealing with facial landmarks and current lip mismatches of the snapshot performances.The second component, an AI-empowered Career Chatbot, processes the LLaMA language model with an integration that occurs with LangChain in order to enhance document retrieval and provide a real understanding of context. The chatbot learns with the recruitment specific domain which suggestions about jobs will suit someone the most while accommodating him to answer very frequently asked questions and giving information to prepare for interviews. Using the aim of embedding and retrieving information from relevant documents at the right time, the interaction will become more precise, contextual, yet highly improved within the candidate experience on the recruitment platforms.

Openalex Percentile: Top 90%
AI in Service Interactions
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Enhancing Virtual Hiring Through AI-Driven Fake LipSync Detection and Career Chatbot — Swati Shinde, Tirthesh Patange, et al. · (2025) | TGRS Research Map | TGRS