Digital Restoration of Separations Data

In experimental separations, the acquired signal can have four common but unwanted elements: (i) high-frequency noise, (ii) drift, (iii) occasional periodic and pink noise, and (iv) a mixture of components traveling with close velocities. Additionally, separation scientists observe partially resolved peaks in chromatographic or capillary electrophoresis detector output. A protocol for digitally recovering the "true data" is provided with clear-cut details and open-access codes for formulating denoising, baseline correction, and peak resolution problems as linear or nonlinear optimizations. The smoother of Bohlmann-Whittaker denoises and preserves the total area of the signal. Fourier transform methods to detect and remove periodic noise are also proposed for erratic periodic noise problems. A peak width preserving filter, called the bilateral filter, is also given. This procedure is followed by two reliable baseline correction algorithms based on asymmetric reweighted least squares or curvature-based weights to deal with low-frequency signal variations. Once low- and high-frequency noise components are removed, a convenient peak mode location method is introduced, relying upon numerically stable second derivative calculation from Savitzky-Golay (SG) filter. Peak locations, area, height, and higher statistical moments can be derived from iterative curve fitting. The protocol shows two peak models that can model left or right skewed peaks. The new peak models are (i) a numerically stable version of the bi-directional exponentially modified Gaussian (EMG), suitable for a wide variety of real chromatograms, and (ii) the twice generalized normal model with third- and fourth-moment parameters built into it. The nonlinear least squares regression approach uses the trust-region reflective optimization method. The algorithm converges to a solution even with multiple peaks and approximate guesses of peak parameters. The protocol can be generalized to fit more than 200 peak functions in separation sciences available in literature by minor adaptations of the provided codes in the MATLAB environment.

Authors

Institutions

Publication Details

Journal
Journal of Separation Science
Published
2025-05-01
DOI
https://doi.org/10.1002/jssc.70139
Citations
4
Primary Topic
Analytical Chemistry and Chromatography
Type
article
Field-Weighted Citation Impact
3.03
Controls
|||
ALL TIME
JAN
FEB
MAR
APR
MAY
JUN
JUL
AUG
SEP
OCT
article

Digital Restoration of Separations Data

M. Farooq Wahab, Troy T. Handlovic
4 citations
Journal of Separation Science
Analytical Chemistry and Chromatography
3.03
article

Digital Restoration of Separations Data

M. Farooq Wahab, Troy T. Handlovic
article en
4 citations

Abstract

In experimental separations, the acquired signal can have four common but unwanted elements: (i) high-frequency noise, (ii) drift, (iii) occasional periodic and pink noise, and (iv) a mixture of components traveling with close velocities. Additionally, separation scientists observe partially resolved peaks in chromatographic or capillary electrophoresis detector output. A protocol for digitally recovering the "true data" is provided with clear-cut details and open-access codes for formulating denoising, baseline correction, and peak resolution problems as linear or nonlinear optimizations. The smoother of Bohlmann-Whittaker denoises and preserves the total area of the signal. Fourier transform methods to detect and remove periodic noise are also proposed for erratic periodic noise problems. A peak width preserving filter, called the bilateral filter, is also given. This procedure is followed by two reliable baseline correction algorithms based on asymmetric reweighted least squares or curvature-based weights to deal with low-frequency signal variations. Once low- and high-frequency noise components are removed, a convenient peak mode location method is introduced, relying upon numerically stable second derivative calculation from Savitzky-Golay (SG) filter. Peak locations, area, height, and higher statistical moments can be derived from iterative curve fitting. The protocol shows two peak models that can model left or right skewed peaks. The new peak models are (i) a numerically stable version of the bi-directional exponentially modified Gaussian (EMG), suitable for a wide variety of real chromatograms, and (ii) the twice generalized normal model with third- and fourth-moment parameters built into it. The nonlinear least squares regression approach uses the trust-region reflective optimization method. The algorithm converges to a solution even with multiple peaks and approximate guesses of peak parameters. The protocol can be generalized to fit more than 200 peak functions in separation sciences available in literature by minor adaptations of the provided codes in the MATLAB environment.

Journal of Separation ScienceVol. 48(5)
The University of Texas at Arlington (US)
Openalex Percentile: Top 9%
Analytical Chemistry and Chromatography
3.03
AI Navigator

Ask Laika to Summarize, Analyze, and Connect papers live on the map.

Summarize Papers & Methodologies

Extract key findings, datasets, and comparative methods across publications.

Benchmark Rankings & Visual Analytics

Rank top research institutions, authors, funders, topics, and journals by Field-Weighted Citation Impact (FWCI) and paper volume with instant charts.

Connect Distant Disciplines

Bridge topological clusters on the map to find hidden collaborative intersections.