Image Compressed Sensing Based on Vision-Inspired Importance Maps
This paper presents a novel image compressed sensing framework that leverages human vision-inspired importance maps to guide the compression process. Unlike traditional methods that compress images without considering perceptual relevance, our approach selectively samples pixels based on their visual saliency and geometric significance. The framework begins by generating an importance map that combines visual saliency, obtained through LayerCAM, with geometric features like edge information. These maps dictate the adaptive sampling of pixels, ensuring that the most visually important information is retained. In the decoding stage, the sampled pixels are reconstructed using prior information-based models such as the Deep Image Prior and Manifold Modeling in Embedded Space. These models effectively restore the image while preserving its critical visual characteristics. To evaluate the performance of our framework, we introduce two new similarity criteria: Weighted PSNR (WPSNR) and Weighted SSIM (WSSIM), both tailored to assess the perceptual quality of images. Our experimental results demonstrate that the proposed method outperforms conventional image compression techniques, especially in maintaining perceptual quality at low sampling rates. This framework shows great promise for applications in areas where preserving visual fidelity is crucial, such as high-quality image compression and digital brain modeling. The integration of visual importance into the compression process represents a significant advancement in the field of image processing, offering a more efficient and perceptually aware approach to image compression.
Authors
- Hideo Yokota (ORCID: https://orcid.org/0000-0003-1395-309X)
- Shigeho NODA (ORCID: https://orcid.org/0000-0002-1283-4227)
- Ruggero Micheletto (ORCID: https://orcid.org/0000-0003-1707-6493)
- Takashi Michikawa (ORCID: https://orcid.org/0000-0002-0606-668X)
- S. Yoshizawa (ORCID: https://orcid.org/0000-0001-8748-6012)
- Shunra Yoshida (ORCID: https://orcid.org/0000-0002-2320-5194)
- Zhe Sun (ORCID: https://orcid.org/0009-0006-4152-0063)
Institutions
- RIKEN Center for Advanced Photonics (JP)
- Yokohama City University (JP)
Publication Details
- Published
- 2024-10-14
- DOI
- https://doi.org/10.1109/ist63414.2024.10759151
- Citations
- 2
- Primary Topic
- Image Processing Techniques and Applications
- Type
- article
- Field-Weighted Citation Impact
- 0.64