Exploring Soft Skills Indicators in Multiple Mini Interviews (MMI) Scenario Responses

Multiple mini-interviews (MMIs) are a widely used and validated interview method for eliciting soft skills. By using multiple, separate, and timed interviews in which each has a distinct scenario, MMIs purportedly reduce possibilities such as a biased individual dictating results, although potentially inconsistent scoring by interviewers may still impact on fairness. However, MMIs overall can be seen as challenging to run due to the number of interviewers and assessments required. In this paper, we discuss the progress in automatically, and consistently, extracting soft skills from transcriptions of MMI responses to support such assessment. While previous research has focused on extracting soft skills from job postings and written responses, to the best of our knowledge there is no other published research on soft skill extraction from MMI responses. We begin by annotating collected MMI responses to assure presence of soft skills, then evaluate the effectiveness of combining word embeddings with classifiers to identify soft skill indicators. The most promising result, F1-Score = 0.79, compares favourably to previous literature on extracting soft skills from other datasets and is encouraging of further exploration.

Authors

Publication Details

Published
2024-11-29
DOI
https://doi.org/10.5121/csit.2024.142305
Primary Topic
Focus Groups and Qualitative Methods
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Exploring Soft Skills Indicators in Multiple Mini Interviews (MMI) Scenario Responses

Lee Gillam, Alison Callwood, Ryan Huynh
Focus Groups and Qualitative Methods
article

Exploring Soft Skills Indicators in Multiple Mini Interviews (MMI) Scenario Responses

Lee Gillam, Alison Callwood, Ryan Huynh
article en

Abstract

Multiple mini-interviews (MMIs) are a widely used and validated interview method for eliciting soft skills. By using multiple, separate, and timed interviews in which each has a distinct scenario, MMIs purportedly reduce possibilities such as a biased individual dictating results, although potentially inconsistent scoring by interviewers may still impact on fairness. However, MMIs overall can be seen as challenging to run due to the number of interviewers and assessments required. In this paper, we discuss the progress in automatically, and consistently, extracting soft skills from transcriptions of MMI responses to support such assessment. While previous research has focused on extracting soft skills from job postings and written responses, to the best of our knowledge there is no other published research on soft skill extraction from MMI responses. We begin by annotating collected MMI responses to assure presence of soft skills, then evaluate the effectiveness of combining word embeddings with classifiers to identify soft skill indicators. The most promising result, F1-Score = 0.79, compares favourably to previous literature on extracting soft skills from other datasets and is encouraging of further exploration.

Quality Education
Openalex Percentile: Top 64%
Focus Groups and Qualitative Methods
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Exploring Soft Skills Indicators in Multiple Mini Interviews (MMI) Scenario Responses — Lee Gillam, Alison Callwood, et al. · (2024) | TGRS Research Map | TGRS