Explainable Camera Model Identification Employing Log-Mel Spectrograms from Videos' Audio

The Camera Model Identification (CMI) aims to identify the specific camera model used to capture an image or video, making it a fundamental challenge in multimedia forensics. An innovative CMI method is proposed that leverages both videos and log-Mel spectrograms from video audio, applying late fusion strategies using Convolutional Neural Networks whose hyperparameters are optimized through Neural Architecture Search. The method is integrated with Gradient-weighted Class Activation Mapping, which offers insights into influential spectrogram regions. A strong emphasis on high-frequency components within the audio data is observed, motivating band-pass filtering of the input spectrograms to retain high-frequency information selectively. By doing so, the classification accuracy of camera models is increased. Experiments conducted on the VISION dataset, comprising data from 35 different camera devices, demonstrate the effectiveness of the proposed model in achieving accurate and interpretable CMI.

Authors

Institutions

Publication Details

Published
2024-10-27
DOI
https://doi.org/10.1109/ieeeconf60004.2024.10942875
Primary Topic
Digital Media Forensic Detection
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Explainable Camera Model Identification Employing Log-Mel Spectrograms from Videos' Audio

Constantine Kotropoulos, Ioannis Tsingalis, Christos Korgialas
1 links
Digital Media Forensic Detection
article

Explainable Camera Model Identification Employing Log-Mel Spectrograms from Videos' Audio

Constantine Kotropoulos, Ioannis Tsingalis, Christos Korgialas
article en

Abstract

The Camera Model Identification (CMI) aims to identify the specific camera model used to capture an image or video, making it a fundamental challenge in multimedia forensics. An innovative CMI method is proposed that leverages both videos and log-Mel spectrograms from video audio, applying late fusion strategies using Convolutional Neural Networks whose hyperparameters are optimized through Neural Architecture Search. The method is integrated with Gradient-weighted Class Activation Mapping, which offers insights into influential spectrogram regions. A strong emphasis on high-frequency components within the audio data is observed, motivating band-pass filtering of the input spectrograms to retain high-frequency information selectively. By doing so, the classification accuracy of camera models is increased. Experiments conducted on the VISION dataset, comprising data from 35 different camera devices, demonstrate the effectiveness of the proposed model in achieving accurate and interpretable CMI.

Aristotle University of Thessaloniki (GR)
Openalex Percentile: Top 71%
Digital Media Forensic Detection
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Explainable Camera Model Identification Employing Log-Mel Spectrograms from Videos' Audio — Constantine Kotropoulos, Ioannis Tsingalis, et al. · (2024) | TGRS Research Map | TGRS