Time Based Image Synthesis: Light and Color Conversion Using Machine Learning Techniques

The progress made in camera technology and computational imaging has been astounding when it comes to photography. A specialized neural image signal processor is currently used by many top smartphone cameras and DSLR to convert chaotic raw sensor photos into the final, polished output. A sizable dataset of image pairs-one with a noisy, short-exposure raw picture and another with a clean, long-exposure ground-truth raw image-is needed to train these neural ISPs for low-light, processing It takes a lot of effort and time to capture these aligned image pairs, and motion blur in the long-exposure ground truth frequently makes the process difficult. Artificial nighttime datasets can be used to train various image processing algorithms and neural ISPs that are more resilient and effective. In order to overcome this difficulty, we proposed a model that uses to convert image colour and lighting of a raw picture to artificially create realistic image of different time zone raw photos, brighter photos are typically easier to take, have less noise, and are less likely to suffer from motion blur. The objective of the suggested processing framework is to transform raw photographs taken during the different time into simulated images of different timing with different levels of noise and other low-light features. More ease and flexibility in training neural ISPs for time-based rendering is made possible by this artificial time- based picture dataset. Additionally, in our proposed method the performance of the trained neural ISPs can resemble that of models trained only on real different timings photos if they mix their synthetic data with a tiny percentage of real data. The potential to produce accurate raw photos of midnight and different night time in a synthetic manner holds significant implications for computational photography and image processing applications and even object recognition under difficult nocturnal conditions.

Authors

Institutions

Publication Details

Published
2024-11-13
DOI
https://doi.org/10.1109/ictacs62700.2024.10840708
Primary Topic
Advanced Image Fusion Techniques
Type
article
Field-Weighted Citation Impact
0.00
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Time Based Image Synthesis: Light and Color Conversion Using Machine Learning Techniques

Jyoti Ranjan Labh, Rakesh Dwivedi
Advanced Image Fusion Techniques
article

Time Based Image Synthesis: Light and Color Conversion Using Machine Learning Techniques

Jyoti Ranjan Labh, Rakesh Dwivedi
article en

Abstract

The progress made in camera technology and computational imaging has been astounding when it comes to photography. A specialized neural image signal processor is currently used by many top smartphone cameras and DSLR to convert chaotic raw sensor photos into the final, polished output. A sizable dataset of image pairs-one with a noisy, short-exposure raw picture and another with a clean, long-exposure ground-truth raw image-is needed to train these neural ISPs for low-light, processing It takes a lot of effort and time to capture these aligned image pairs, and motion blur in the long-exposure ground truth frequently makes the process difficult. Artificial nighttime datasets can be used to train various image processing algorithms and neural ISPs that are more resilient and effective. In order to overcome this difficulty, we proposed a model that uses to convert image colour and lighting of a raw picture to artificially create realistic image of different time zone raw photos, brighter photos are typically easier to take, have less noise, and are less likely to suffer from motion blur. The objective of the suggested processing framework is to transform raw photographs taken during the different time into simulated images of different timing with different levels of noise and other low-light features. More ease and flexibility in training neural ISPs for time-based rendering is made possible by this artificial time- based picture dataset. Additionally, in our proposed method the performance of the trained neural ISPs can resemble that of models trained only on real different timings photos if they mix their synthetic data with a tiny percentage of real data. The potential to produce accurate raw photos of midnight and different night time in a synthetic manner holds significant implications for computational photography and image processing applications and even object recognition under difficult nocturnal conditions.

Teerthanker Mahaveer University (IN)
Openalex Percentile: Top 62%
Advanced Image Fusion Techniques
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Time Based Image Synthesis: Light and Color Conversion Using Machine Learning Techniques — Jyoti Ranjan Labh, Rakesh Dwivedi · (2024) | TGRS Research Map | TGRS