Comprehensive Out-of-context Misinformation Detection via Global Information Enhancement

False information that spreads rapidly on the Internet may have a negative impact on individuals, organizations, and society.Cheapfake, which refers to out-of-context misinformation, involves reusing the pairing of images and captions to support false descriptions.Out-of-context misinformation detection requires consideration of the global semantic understanding of images and intertwined contextual information.Currently, the baseline method don't extract enough global information.This paper uses visual-semantic reasoning to extract the global features of images and texts, and proposes a new detection framework that employs fake statement checking and multimodal natural language inference to determine whether the input triples are cheapfake through multiple steps.The accuracy of our method is 3.4% higher than that of the baseline method, and it also has its own advantages compared with other improved methods.

Authors

Institutions

Publication Details

Published
2024-12-20
DOI
https://doi.org/10.1145/3712623.3712660
Primary Topic
Misinformation and Its Impacts
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Comprehensive Out-of-context Misinformation Detection via Global Information Enhancement

Yong Liao, Zhenghao Luo, Meng Shen
Misinformation and Its Impacts
article

Comprehensive Out-of-context Misinformation Detection via Global Information Enhancement

Yong Liao, Zhenghao Luo, Meng Shen
article en

Abstract

False information that spreads rapidly on the Internet may have a negative impact on individuals, organizations, and society.Cheapfake, which refers to out-of-context misinformation, involves reusing the pairing of images and captions to support false descriptions.Out-of-context misinformation detection requires consideration of the global semantic understanding of images and intertwined contextual information.Currently, the baseline method don't extract enough global information.This paper uses visual-semantic reasoning to extract the global features of images and texts, and proposes a new detection framework that employs fake statement checking and multimodal natural language inference to determine whether the input triples are cheapfake through multiple steps.The accuracy of our method is 3.4% higher than that of the baseline method, and it also has its own advantages compared with other improved methods.

University of Science and Technology of China (CN)
National Key Research and Development Program of China
Reduced inequalities
Openalex Percentile: Top 56%
Misinformation and Its Impacts
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.