Exploring image–text combinations in visual humour through large language models (LLMs)

Abstract This article aims to advance the scholarly discourse on the linguistic capabilities of Artificial Intelligence (AI) by analysing how three different Large Language models (LLMs) approach visual humour. Specifically, it focuses on meme generation and interpretation, with an emphasis on image–text combinations. In the first section, three LLMs were prompted to generate accompanying text for ten preselected images. In the second section, they were prompted to analyse one hundred human-made memes. Results show that, despite a generally positive evaluation in humour detection, applying non-literal meaning remains a challenge, even for the best-performing AI models.

Authors

Institutions

Publication Details

Journal
Digital Scholarship in the Humanities
Published
2024-11-27
DOI
https://doi.org/10.1093/llc/fqae068
Citations
3
Primary Topic
Humor Studies and Applications
Type
article
Field-Weighted Citation Impact
1.93
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Exploring image–text combinations in visual humour through large language models (LLMs)

Jose Belda-Medina, Laura Soriano-Gonzalez
3 citations
Digital Scholarship in the Humanities
Humor Studies and Applications
1.93
article

Exploring image–text combinations in visual humour through large language models (LLMs)

Jose Belda-Medina, Laura Soriano-Gonzalez
article en
3 citations

Abstract

Abstract This article aims to advance the scholarly discourse on the linguistic capabilities of Artificial Intelligence (AI) by analysing how three different Large Language models (LLMs) approach visual humour. Specifically, it focuses on meme generation and interpretation, with an emphasis on image–text combinations. In the first section, three LLMs were prompted to generate accompanying text for ten preselected images. In the second section, they were prompted to analyse one hundred human-made memes. Results show that, despite a generally positive evaluation in humour detection, applying non-literal meaning remains a challenge, even for the best-performing AI models.

Digital Scholarship in the HumanitiesVol. 40(1)
University of Alicante (ES)
Quality Education
Openalex Percentile: Top 13%
Humor Studies and Applications
1.93
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.