Estimating baselines of Raman spectra based on transformer and manually annotated data

Raman spectroscopy is a powerful and non-invasive analytical method for determining the chemical composition and molecular structure of a wide range of materials, including complex biological tissues. However, the captured signals typically suffer from interferences manifested as noise and baseline, which need to be removed for successful data analysis. Effective baseline correction is critical in quantitative analysis, as it may impact peak signature derivation. Current baseline correction methods can be labor-intensive and may require extensive parameter adjustment depending on the input spectrum characteristics. In contrast, deep learning-based baseline correction models trained across various materials, offer a promising and more versatile alternative. This study reports an approach to manually identify the ground-truth baselines for eight different biological materials through extensively tuning the parameters of three classical baseline correction methods, Modified Multi-Polynomial Fit (Modpoly), Improved Modified Multi-Polynomial Fitting (IModpoly), and Adaptive Iteratively Reweighted Penalized Least Squares (airPLS), and combining the outputs to best fit the training data. We designed a one-dimensional Transformer (1dTrans) tailored to fit Raman spectral data for estimating their baselines, and evaluated its performance against convolutional neural network (CNN), ResUNet, and three aforementioned parametric methods. The 1dTrans model achieved lower mean absolute error (MAE) and spectral angle mapper (SAM) scores when compared to the other methods in both development and evaluation of the manually labeled original raw Raman spectra, highlighting the effectiveness of the method in Raman spectra pre-processing.

Authors

Institutions

Publication Details

Journal
Spectrochimica Acta Part A Molecular and Biomolecular Spectroscopy
Published
2024-12-27
DOI
https://doi.org/10.1016/j.saa.2024.125679
Citations
6
Primary Topic
Spectroscopy Techniques in Biomedical and Chemical Research
Type
article
Field-Weighted Citation Impact
3.97
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Estimating baselines of Raman spectra based on transformer and manually annotated data

Jiangsan Zhao, Krzysztof Kuśnierek, Tomasz L. Woznicki
6 citations
Spectrochimica Acta Part A Molecular and Biomolecular Spectroscopy
Spectroscopy Techniques in Biomedical and Chemical Research
3.97
article

Estimating baselines of Raman spectra based on transformer and manually annotated data

Jiangsan Zhao, Krzysztof Kuśnierek, Tomasz L. Woznicki
article en
6 citations

Abstract

Raman spectroscopy is a powerful and non-invasive analytical method for determining the chemical composition and molecular structure of a wide range of materials, including complex biological tissues. However, the captured signals typically suffer from interferences manifested as noise and baseline, which need to be removed for successful data analysis. Effective baseline correction is critical in quantitative analysis, as it may impact peak signature derivation. Current baseline correction methods can be labor-intensive and may require extensive parameter adjustment depending on the input spectrum characteristics. In contrast, deep learning-based baseline correction models trained across various materials, offer a promising and more versatile alternative. This study reports an approach to manually identify the ground-truth baselines for eight different biological materials through extensively tuning the parameters of three classical baseline correction methods, Modified Multi-Polynomial Fit (Modpoly), Improved Modified Multi-Polynomial Fitting (IModpoly), and Adaptive Iteratively Reweighted Penalized Least Squares (airPLS), and combining the outputs to best fit the training data. We designed a one-dimensional Transformer (1dTrans) tailored to fit Raman spectral data for estimating their baselines, and evaluated its performance against convolutional neural network (CNN), ResUNet, and three aforementioned parametric methods. The 1dTrans model achieved lower mean absolute error (MAE) and spectral angle mapper (SAM) scores when compared to the other methods in both development and evaluation of the manually labeled original raw Raman spectra, highlighting the effectiveness of the method in Raman spectra pre-processing.

Spectrochimica Acta Part A Molecular and Biomolecular SpectroscopyVol. 330
Norwegian Institute of Bioeconomy Research (NO)
Openalex Percentile: Top 7%
Spectroscopy Techniques in Biomedical and Chemical Research
3.97
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.