Determining Concentration from Raman Spectroscopy with Manifold Learning and Y-shaped Conformal Autoencoders

Monitoring of chemical processes is crucial in chemical engineering, motivating sophisticated process analytical technology (PAT). In-line analytics are advantageous, with Raman spectroscopy being an established and reliable tool in various applications, from which many properties can be determined. We recently [Koronaki et al., AIChEJ 2024] proposed determining polymer particle size from Raman spectroscopic data, by combining Diffusion Maps (a manifold learning method) with a Y-shaped Conformal Autoencoder Neural Network. Herein, we extend this workflow to predict liquid concentrations, allowing also for multiple target predictions from the same model. We apply the methods on two datasets consisting of Raman measurements and concentration measurements: one from microgel polymerization and one from citric acid dissociation. The single-target concentration prediction results, where one target is determined from each model at a time, are accurate. Comparing against dedicated methods such as Indirect Hard Modeling (IHM) is not straightforward, due to the different validation strategies and the considered spectra range; nevertheless, it is fair to say that IHM performs slightly better than the proposed workflow. We further compare this approach with other regression methods, such as artificial neural networks, extreme gradient boosting and partial least squares, and the results show that the Conformal Autoencoders achieve higher predictive performance, demonstrating that the workflow can also be used for concentration determination. Finally we find that single-target concentration predictions are more accurate than the multiple target predictions for both case studies.

Authors

Publication Details

Journal
arXiv (Cornell University)
Published
2026-11-16
DOI
https://doi.org/10.48550/arxiv.2611.21196
Primary Topic
Spectroscopy and Chemometric Analyses
Type
preprint
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
NOV
preprint

Determining Concentration from Raman Spectroscopy with Manifold Learning and Y-shaped Conformal Autoencoders

Ioannis G. Kevrekidis, Eleni D. Koronaki, Alexander Mitsos, Eike Cramer et al.
arXiv (Cornell University)
Spectroscopy and Chemometric Analyses
preprint

Determining Concentration from Raman Spectroscopy with Manifold Learning and Y-shaped Conformal Autoencoders

Ioannis G. Kevrekidis, Eleni D. Koronaki, Alexander Mitsos, Eike Cramer, Anna Taka, Joern Viell
preprint en

Abstract

Monitoring of chemical processes is crucial in chemical engineering, motivating sophisticated process analytical technology (PAT). In-line analytics are advantageous, with Raman spectroscopy being an established and reliable tool in various applications, from which many properties can be determined. We recently [Koronaki et al., AIChEJ 2024] proposed determining polymer particle size from Raman spectroscopic data, by combining Diffusion Maps (a manifold learning method) with a Y-shaped Conformal Autoencoder Neural Network. Herein, we extend this workflow to predict liquid concentrations, allowing also for multiple target predictions from the same model. We apply the methods on two datasets consisting of Raman measurements and concentration measurements: one from microgel polymerization and one from citric acid dissociation. The single-target concentration prediction results, where one target is determined from each model at a time, are accurate. Comparing against dedicated methods such as Indirect Hard Modeling (IHM) is not straightforward, due to the different validation strategies and the considered spectra range; nevertheless, it is fair to say that IHM performs slightly better than the proposed workflow. We further compare this approach with other regression methods, such as artificial neural networks, extreme gradient boosting and partial least squares, and the results show that the Conformal Autoencoders achieve higher predictive performance, demonstrating that the workflow can also be used for concentration determination. Finally we find that single-target concentration predictions are more accurate than the multiple target predictions for both case studies.

arXiv (Cornell University)
Spectroscopy and Chemometric Analyses
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.

Laika access coming soon