The deep convolution network in immersive design of digital media art in smart city

The goal of the paper is to examine how convolutional neural network (CNN) is used in the immersive world of digital media art. In order to do this, this paper first explains digital media art in the context of smart cities and the use of immersive scenarios. Next, a brief analysis of the Unet network model and deep aggregation structure is provided. Then, a projector, camera, and computer-based immersive projector-camera display system is constructed. Based on the mathematical reflection model of the system, this paper discusses the method of using CNN to solve the photometric compensation of the projection picture. Meanwhile, a Projection Compensation Network (PCN) is designed, and a multi-scale perceptual loss is added to this compensation network, and the content information of the compensated image is improved by calculating the loss of feature maps of different scales. The final network is named Perceptual Loss-Projection Compensation Network (PL-PCN). Experiments are used to confirm the PL-PCN model's efficacy. The outcomes demonstrate that the SSIM and PSNR of the projected picture compensated by PL-PCN are boosted by 35.8% and 31.6%, respectively. While the RMSE is reduced by 40.9%, demonstrating an improvement in the compensated image's quality. Additionally, utilizing a CNN makes it possible to do cross-reflection compensation. Additionally, compared to the network without deep polymerization, the PL-PCN with deep polymerization structure boosts the projected image's SSIM and PSNR by 6% and 7.57%, respectively, and lowers the RMSE by 13.3% This demonstrates that the addition of deep polymerization structure can have a stronger compensatory effect. This paper can offer a theoretical framework for improving the immersive scene quality of digital media art.

Authors

Institutions

Publication Details

Journal
Scientific Reports
Published
2024-11-15
DOI
https://doi.org/10.1038/s41598-024-79742-z
Citations
3
Primary Topic
Advanced Technology in Applications
Type
article
Field-Weighted Citation Impact
2.34
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

The deep convolution network in immersive design of digital media art in smart city

Jiao Tang
3 citations
Scientific Reports
Advanced Technology in Applications
2.34
article

The deep convolution network in immersive design of digital media art in smart city

Jiao Tang
article en
3 citations

Abstract

The goal of the paper is to examine how convolutional neural network (CNN) is used in the immersive world of digital media art. In order to do this, this paper first explains digital media art in the context of smart cities and the use of immersive scenarios. Next, a brief analysis of the Unet network model and deep aggregation structure is provided. Then, a projector, camera, and computer-based immersive projector-camera display system is constructed. Based on the mathematical reflection model of the system, this paper discusses the method of using CNN to solve the photometric compensation of the projection picture. Meanwhile, a Projection Compensation Network (PCN) is designed, and a multi-scale perceptual loss is added to this compensation network, and the content information of the compensated image is improved by calculating the loss of feature maps of different scales. The final network is named Perceptual Loss-Projection Compensation Network (PL-PCN). Experiments are used to confirm the PL-PCN model's efficacy. The outcomes demonstrate that the SSIM and PSNR of the projected picture compensated by PL-PCN are boosted by 35.8% and 31.6%, respectively. While the RMSE is reduced by 40.9%, demonstrating an improvement in the compensated image's quality. Additionally, utilizing a CNN makes it possible to do cross-reflection compensation. Additionally, compared to the network without deep polymerization, the PL-PCN with deep polymerization structure boosts the projected image's SSIM and PSNR by 6% and 7.57%, respectively, and lowers the RMSE by 13.3% This demonstrates that the addition of deep polymerization structure can have a stronger compensatory effect. This paper can offer a theoretical framework for improving the immersive scene quality of digital media art.

Scientific ReportsVol. 14(1)
Sichuan University of Science and Engineering (CN)
Sustainable cities and communities
Openalex Percentile: Top 9%
Advanced Technology in Applications
2.34
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

The deep convolution network in immersive design of digital media art in smart city — Jiao Tang · Scientific Reports (2024) | TGRS Research Map | TGRS