HSI-SC-NeRF: NeRF-based hyperspectral 3D reconstruction using a stationary camera for agricultural applications

Introduction Advances in hyperspectral Q5 imaging (HSI) and 3D reconstruction have enabled accurate characterization of agricultural produce quality and plant phenotypes, both essential for advancing agricultural sustainability and breeding programs. However, integrating these two modalities at scale remains challenging, as conventional approaches involve complex hardware setups incompatible with automated phenotyping systems. Recent advances in neural radiance fields (NeRF) offer computationally efficient 3D reconstruction but typically require moving-camera setups, limiting throughput and reproducibility in standard indoor agricultural environments. To address these challenges, we introduce HSI-SC-NeRF, a stationary-camera multi-channel NeRF framework for high-throughput hyperspectral 3D reconstruction targeting postharvest inspection of agricultural produce. Methods Multi-view hyperspectral data is captured using a stationary camera while the object rotates within a custom-built Teflon imaging chamber providing diffuse, uniform illumination. Cameraposes are estimated via structure-from-motion using ArUco fiducial markers as persistent features, then transformed from the object frame to the camera frame through simulated pose transformation, enabling standard NeRF training on stationary camera data. A multi-channel NeRF formulation optimizes reconstruction across all hyperspectral bands jointly using a composite spectral loss, supported by a two-stage training protocol that decouples geometric initialization from radiometric refinement to improve spectral fidelity. Results On a representative sample, the reconstruction achieves a close geometric agreement with an independent reference reconstruction; across diverse agricultural samples, it achieves strong spectral fidelity across the visible and near-infrared spectrum, supporting its use in automated agricultural workflows. Discussion The full 204-band reconstruction additionally enables exploration of literature-informed wavelength bands, facilitating redeployment with faster multispectral cameras for high-throughput production environments.

Authors

Institutions

Publication Details

Journal
Frontiers in Plant Science
Published
2026-10-30
DOI
https://doi.org/10.3389/fpls.2026.1960204
Primary Topic
Spectroscopy and Chemometric Analyses
Type
article
Field-Weighted Citation Impact
0.00

Funders

Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

HSI-SC-NeRF: NeRF-based hyperspectral 3D reconstruction using a stationary camera for agricultural applications

Baskar Ganapathysubramanian, Talukder Zaki Jubery, Adarsh Krishnamurthy, Kibon Ku
4 links
Frontiers in Plant Science
Spectroscopy and Chemometric Analyses
article

HSI-SC-NeRF: NeRF-based hyperspectral 3D reconstruction using a stationary camera for agricultural applications

Baskar Ganapathysubramanian, Talukder Zaki Jubery, Adarsh Krishnamurthy, Kibon Ku
article en

Abstract

Introduction Advances in hyperspectral Q5 imaging (HSI) and 3D reconstruction have enabled accurate characterization of agricultural produce quality and plant phenotypes, both essential for advancing agricultural sustainability and breeding programs. However, integrating these two modalities at scale remains challenging, as conventional approaches involve complex hardware setups incompatible with automated phenotyping systems. Recent advances in neural radiance fields (NeRF) offer computationally efficient 3D reconstruction but typically require moving-camera setups, limiting throughput and reproducibility in standard indoor agricultural environments. To address these challenges, we introduce HSI-SC-NeRF, a stationary-camera multi-channel NeRF framework for high-throughput hyperspectral 3D reconstruction targeting postharvest inspection of agricultural produce. Methods Multi-view hyperspectral data is captured using a stationary camera while the object rotates within a custom-built Teflon imaging chamber providing diffuse, uniform illumination. Cameraposes are estimated via structure-from-motion using ArUco fiducial markers as persistent features, then transformed from the object frame to the camera frame through simulated pose transformation, enabling standard NeRF training on stationary camera data. A multi-channel NeRF formulation optimizes reconstruction across all hyperspectral bands jointly using a composite spectral loss, supported by a two-stage training protocol that decouples geometric initialization from radiometric refinement to improve spectral fidelity. Results On a representative sample, the reconstruction achieves a close geometric agreement with an independent reference reconstruction; across diverse agricultural samples, it achieves strong spectral fidelity across the visible and near-infrared spectrum, supporting its use in automated agricultural workflows. Discussion The full 204-band reconstruction additionally enables exploration of literature-informed wavelength bands, facilitating redeployment with faster multispectral cameras for high-throughput production environments.

Frontiers in Plant ScienceVol. 17
Iowa State University (US)
Directorate for Biological Sciences, National Institute of Food and Agriculture, Plant Sciences Institute, Iowa State University
Zero hunger
Openalex Percentile: Top 19%
Spectroscopy and Chemometric Analyses
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon