Explainable Camera Model Identification Employing Log-Mel Spectrograms from Videos' Audio
The Camera Model Identification (CMI) aims to identify the specific camera model used to capture an image or video, making it a fundamental challenge in multimedia forensics. An innovative CMI method is proposed that leverages both videos and log-Mel spectrograms from video audio, applying late fusion strategies using Convolutional Neural Networks whose hyperparameters are optimized through Neural Architecture Search. The method is integrated with Gradient-weighted Class Activation Mapping, which offers insights into influential spectrogram regions. A strong emphasis on high-frequency components within the audio data is observed, motivating band-pass filtering of the input spectrograms to retain high-frequency information selectively. By doing so, the classification accuracy of camera models is increased. Experiments conducted on the VISION dataset, comprising data from 35 different camera devices, demonstrate the effectiveness of the proposed model in achieving accurate and interpretable CMI.
Authors
- Constantine Kotropoulos (ORCID: https://orcid.org/0000-0001-9939-7930)
- Ioannis Tsingalis (ORCID: https://orcid.org/0000-0003-2590-325X)
- Christos Korgialas (ORCID: https://orcid.org/0000-0001-5475-0518)
Institutions
- Aristotle University of Thessaloniki (GR)
Publication Details
- Published
- 2024-10-27
- DOI
- https://doi.org/10.1109/ieeeconf60004.2024.10942875
- Primary Topic
- Digital Media Forensic Detection
- Type
- article
- Field-Weighted Citation Impact
- 0.00