Practical Guide to Chemometric Analysis of Optical Spectroscopic Data

Lackey, Hope E.; Sell, Richard L.; Nelson, Gilbert L.; Bryan, Thomas A.; Lines, Amanda M.; Bryan, Samuel A.

doi:10.1021/acs.jchemed.2c01112

Practical Guide to Chemometric Analysis of Optical Spectroscopic Data

Journal Article · 11 July 2023 · Journal of Chemical Education

DOI:https://doi.org/10.1021/acs.jchemed.2c01112· OSTI ID:1996916

Lackey, Hope E. ^[1]; Sell, Richard L. ^[1]; Nelson, Gilbert L. ^[2]; Bryan, Thomas A. ^[3]; Lines, Amanda M. ^[1]; ^[1]

BATTELLE (PACIFIC NW LAB)
UNIVERSITY PROGRAMS
The MathWorks, 3 Apple Hill Drive, Natick, MA 01760-2098

The methodology and mathematical treatment of several classic multivariate methods for the analysis of spectroscopic data is demonstrated in a straightforward way that can be used as a basis for teaching an undergraduate introductory course on chemometric analysis. The multivariate techniques of classical least squares (CLS), principal component regression (PCR), and partial least squares (PLS), as well as the univariate Beer’s law method have been described and compared, building students’ understanding by starting with the univariate method and progressing step by step into the multivariate methods. Equations for the production of regression vectors from training set spectral data is described and their use demonstrated for the prediction of constituent concentrations on a separate validation set of spectra. Extreme care is taken to ensure consistency in variable formatting of data matrices. This provides a key foundation to understanding how spectral data are manipulated using these different mathematical approaches for building quantitative regression models. Each method is applied to a real-world data set, and the results are discussed to show students the types of information that can be gleaned from each method. A training set comprised of 20 infrared absorbance spectra containing 3 constituents (benzene, polystyrene, and gasoline) of known composition are used to demonstrate the matrix operations for each regression method. A separate set of 12 real-world napalm samples (containing benzene, polystyrene and gasoline) are used as a validation set to demonstrate the ability to utilize the regression models on an unknown dataset. A toolbox (PNNL Chemometric Toolbox) written in MATLAB language is supplied in the Supplemental Information file and can be used as a companion for understanding the development and deployment of the chemometric algorithms described in this paper. The datasets of the infrared spectra are also supplied, allowing users to build and inspect the chemometric models on their own. Finally, the Toolbox includes scripts to assist users in loading their own datasets into MATLAB and performing CLS, PCR, and PLS on their data.

Research Organization:: Pacific Northwest National Laboratory (PNNL), Richland, WA (United States)

Sponsoring Organization:: USDOE

DOE Contract Number:: AC05-76RL01830

OSTI ID:: 1996916

Report Number(s):: PNNL-SA-178491

Journal Information:: Journal of Chemical Education, Vol. 100, Issue 7

Country of Publication:: United States

Language:: English

References (58)

Chemometrics: Views and Propositions Kowalski, B. R. Journal of Chemical Information and Modeling, Vol. 15, Issue 4 https://doi.org/10.1021/ci60004a002	journal	November 1975
Chemometrics; what do we mean with it, and what do we want from it? Wold, Svante Chemometrics and Intelligent Laboratory Systems, Vol. 30, Issue 1 https://doi.org/10.1016/0169-7439(95)00042-9	journal	November 1995
Chemometrics Lavine, Barry K.; Workman, Jerome Analytical Chemistry, Vol. 85, Issue 2 https://doi.org/10.1021/ac303193j	journal	December 2012
Chemometrics for environmental monitoring: a review Dupont, Madeleine F.; Elbourne, Aaron; Cozzolino, Daniel Analytical Methods, Vol. 12, Issue 38 https://doi.org/10.1039/D0AY01389G	journal	January 2020
Combining Chemometrics and Sensors: Toward New Applications in Monitoring and Environmental Analysis Chapman, James; Truong, Vi Khanh; Elbourne, Aaron Chemical Reviews, Vol. 120, Issue 13 https://doi.org/10.1021/acs.chemrev.9b00616	journal	May 2020
Real-Time Process Monitoring of CO₂ Capture by Aqueous AMP-PZ Using Chemometrics: Pilot Plant Demonstration Kachko, Alexandr; van der Ham, Leen V.; Geers, Leon F. G. Industrial & Engineering Chemistry Research, Vol. 54, Issue 21 https://doi.org/10.1021/acs.iecr.5b00691	journal	May 2015
Raman Scattering Techniques for Defense and Security Applications Lister, Adam P.; Sellors, William J.; Howle, Chris R. Analytical Chemistry, Vol. 93, Issue 1 https://doi.org/10.1021/acs.analchem.0c04606	journal	December 2020
Chemometrics in spectroscopy. Part 1. Classical chemometrics Geladi, Paul Spectrochimica Acta Part B: Atomic Spectroscopy, Vol. 58, Issue 5 https://doi.org/10.1016/S0584-8547(03)00037-5	journal	May 2003
Partial least-squares methods for spectral analyses. 1. Relation to other quantitative calibration methods and the extraction of qualitative information Haaland, David M.; Thomas, Edward V. Analytical Chemistry, Vol. 60, Issue 11 https://doi.org/10.1021/ac00162a020	journal	June 1988
Comparison of multivariate calibration methods for quantitative spectral analysis Thomas, Edward V.; Haaland, David M. Analytical Chemistry, Vol. 62, Issue 10 https://doi.org/10.1021/ac00209a024	journal	May 1990
An Introduction to Multivariate Calibration and Analysis Beebe, Kenneth R.; Kowalski, Bruce R. Analytical Chemistry, Vol. 59, Issue 17 https://doi.org/10.1021/ac00144a725	journal	September 1987
Principal component analysis Wold, Svante; Esbensen, Kim; Geladi, Paul Chemometrics and Intelligent Laboratory Systems, Vol. 2, Issue 1-3 https://doi.org/10.1016/0169-7439(87)80084-9	journal	August 1987
IUPAC project: A glossary of concepts and terms in chemometrics Hibbert, D. Brynn; Minkkinen, Pentti; Faber, N. M. Analytica Chimica Acta, Vol. 642, Issue 1-2 https://doi.org/10.1016/j.aca.2009.02.020	journal	May 2009
Teaching chemometrics in short course format Wise, Barry M. Journal of Chemometrics, Vol. 36, Issue 5 https://doi.org/10.1002/cem.3399	journal	April 2022
Multivariate data analysis: Its methods Mellinger, Michel Chemometrics and Intelligent Laboratory Systems, Vol. 2, Issue 1-3 https://doi.org/10.1016/0169-7439(87)80083-7	journal	August 1987
Non-destructive Spectroscopy combined with chemometrics as a tool for Green Chemical Analysis of environmental samples: A review Gredilla, Ainara; Fdez-Ortiz de Vallejuelo, Silvia; Elejoste, Nerea TrAC Trends in Analytical Chemistry, Vol. 76 https://doi.org/10.1016/j.trac.2015.11.011	journal	February 2016
Chemometrics in analytical chemistry—part II: modeling, validation, and applications Brereton, Richard G.; Jansen, Jeroen; Lopes, João Analytical and Bioanalytical Chemistry, Vol. 410, Issue 26 https://doi.org/10.1007/s00216-018-1283-4	journal	August 2018
Chemometrics applied to environmental systems Hopke, Philip K. Chemometrics and Intelligent Laboratory Systems, Vol. 149 https://doi.org/10.1016/j.chemolab.2015.07.015	journal	December 2015
How Can Chemometrics Improve Microfluidic Research? Jalali-Heravi, Mehdi; Arrastia, Mary; Gomez, Frank A. Analytical Chemistry, Vol. 87, Issue 7 https://doi.org/10.1021/ac504863y	journal	February 2015
Application of chemometric methods to XRF-data – A tutorial review Panchuk, Vitaly; Yaroshenko, Irina; Legin, Andrey Analytica Chimica Acta, Vol. 1040 https://doi.org/10.1016/j.aca.2018.05.023	journal	December 2018
Chemometrics in analytical chemistry – an overview of applications from 2014 to 2018 Santos, Mônica Cardoso; Nascimento, Paloma Andrade Martins; Guedes, Wesley Nascimento Eclética Química Journal, Vol. 44, Issue 2 https://doi.org/10.26850/1678-4618eqj.v44.2.2019.p11-25	journal	April 2019
Review of on-line and near real-time spectroscopic monitoring of processes relevant to nuclear material management Tse, P.; Bryan, S. A.; Bessen, N. P. Analytica Chimica Acta, Vol. 1107 https://doi.org/10.1016/j.aca.2020.02.008	journal	April 2020
Multivariate Curve Resolution Methods Illustrated Using Infrared Spectra of an Alcohol Dissolved in Carbon Tetrachloride Grung, Bjørn; Nodland, Egil; Førland, Geir Martin Journal of Chemical Education, Vol. 84, Issue 7 https://doi.org/10.1021/ed084p1193	journal	July 2007
Time-Resolved Step-Scan FT-IR Spectroscopy: Focus on Multivariate Curve Resolution Ruckebusch, C.; Duponchel, L.; Sombret, B. Journal of Chemical Information and Computer Sciences, Vol. 43, Issue 6 https://doi.org/10.1021/ci034094i	journal	October 2003
Chemometrics in analytical chemistry—part I: history, experimental design and data analysis tools Brereton, Richard G.; Jansen, Jeroen; Lopes, João Analytical and Bioanalytical Chemistry, Vol. 409, Issue 25 https://doi.org/10.1007/s00216-017-0517-1	journal	August 2017
Validation of chemometric models – A tutorial Westad, Frank; Marini, Federico Analytica Chimica Acta, Vol. 893 https://doi.org/10.1016/j.aca.2015.06.056	journal	September 2015
Big Data in Modern Chemical Analysis Milman, B. L.; Zhurkovich, I. K. Journal of Analytical Chemistry, Vol. 75, Issue 4 https://doi.org/10.1134/S1061934820020124	journal	April 2020
Big (Bio)Chemical Data Mining Using Chemometric Methods: A Need for Chemists Parastar, Hadi; Tauler, Roma Angewandte Chemie International Edition, Vol. 61, Issue 44 https://doi.org/10.1002/anie.201801134	journal	September 2022
New data preprocessing trends based on ensemble of multiple preprocessing techniques Mishra, Puneet; Biancolillo, Alessandra; Roger, Jean Michel TrAC Trends in Analytical Chemistry, Vol. 132 https://doi.org/10.1016/j.trac.2020.116045	journal	November 2020
Experimental Design, Near-Infrared Spectroscopy, and Multivariate Calibration: An Advanced Project in a Chemometrics Course de Oliveira, Rodrigo R.; das Neves, Luiz S.; de Lima, Kássio M. G. Journal of Chemical Education, Vol. 89, Issue 12 https://doi.org/10.1021/ed200765j	journal	October 2012
Uniform experimental design in chemometrics Xu, Qing-Song; Xu, Yuan-Da; Li, Lan Journal of Chemometrics, Vol. 32, Issue 11 https://doi.org/10.1002/cem.3020	journal	February 2018
The origins of Beer's law Pfeiffer, Heinz G.; Liebhafsky, Herman A. Journal of Chemical Education, Vol. 28, Issue 3 https://doi.org/10.1021/ed028p123	journal	March 1951
Bestimmung der Absorption des rothen Lichts in farbigen Flüssigkeiten No authors listed Annalen der Physik und Chemie, Vol. 162, Issue 5 https://doi.org/10.1002/andp.18521620505	journal	January 1852
Spectroscopic monitoring of spent nuclear fuel reprocessing streams: an evaluation of spent fuel solutions via Raman, visible, and near-infrared spectroscopy Bryan, S. A.; Levitskaia, Tatiana G.; Johnsen, A. M. Radiochimica Acta, Vol. 99, Issue 9 https://doi.org/10.1524/ract.2011.1865	journal	September 2011
In Situ Spectroscopic Analysis and Quantification of [Tc(CO) ₃ ] ⁺ in Hanford Tank Waste Branch, Shirmir D.; French, Amanda D.; Lines, Amanda M. Environmental Science & Technology, Vol. 52, Issue 14 https://doi.org/10.1021/acs.est.7b05840	journal	June 2018
SIMPLS: An alternative approach to partial least squares regression de Jong, Sijmen Chemometrics and Intelligent Laboratory Systems, Vol. 18, Issue 3 https://doi.org/10.1016/0169-7439(93)85002-X	journal	March 1993
Partial least-squares regression: a tutorial Geladi, Paul; Kowalski, Bruce R. Analytica Chimica Acta, Vol. 185 https://doi.org/10.1016/0003-2670(86)80028-9	journal	January 1986
To See the World in a Grain of Sand: Recognizing the Origin of Sand Specimens by Diffuse Reflectance Infrared Fourier Transform Spectroscopy and Multivariate Exploratory Data Analysis De Lorenzi Pezzolo, Alessandra Journal of Chemical Education, Vol. 88, Issue 9 https://doi.org/10.1021/ed9000409	journal	July 2011
From Periodic Properties to a Periodic Table Arrangement Besalú, Emili Journal of Chemical Education, Vol. 90, Issue 8 https://doi.org/10.1021/ed3004534	journal	June 2013
Characterization of Carotenoids from Pineapples: An Integrated and Modular Experiment for Practical Learning of UV–vis Spectroscopy, Chromatography, Mass Spectrometry, and Chemometrics Chutakool, Worakan; Praneenararat, Thanit Journal of Chemical Education, Vol. 99, Issue 5 https://doi.org/10.1021/acs.jchemed.1c01021	journal	April 2022
Introducing Chemometrics to the Analytical Curriculum: Combining Theory and Lab Experience Gilbert, Michael K.; Luttrell, Robert D.; Stout, David Journal of Chemical Education, Vol. 85, Issue 1 https://doi.org/10.1021/ed085p135	journal	January 2008
An Advanced Analytical Chemistry Experiment Using Gas Chromatography−Mass Spectrometry, MATLAB, and Chemometrics To Predict Biodiesel Blend Percent Composition Pierce, Karisa M.; Schale, Stephen P.; Le, Trang M. Journal of Chemical Education, Vol. 88, Issue 6 https://doi.org/10.1021/ed100917x	journal	March 2011
Teaching chemometrics: A course on application of mathematical techniques to chemistry Delaney, Michael F.; Warren, F. Vincent Journal of Chemical Education, Vol. 58, Issue 8 https://doi.org/10.1021/ed058p646	journal	August 1981
Introducing Chemometrics to Graduate Students Öberg, Tomas Journal of Chemical Education, Vol. 83, Issue 8 https://doi.org/10.1021/ed083p1178	journal	August 2006
Leveraging Multiple Raman Excitation Wavelength Systems for Process Monitoring of Nuclear Waste Streams Felmy, Heather M.; Lackey, Hope E.; Medina, Adan Schafer ACS ES&T Water, Vol. 2, Issue 3 https://doi.org/10.1021/acsestwater.1c00408	journal	February 2022
Combined Raman and Turbidity Probe for Real-Time Analysis of Variable Turbidity Streams Lines, Amanda M.; Bello, Job M.; Gasbarro, Christina Analytical Chemistry, Vol. 94, Issue 8 https://doi.org/10.1021/acs.analchem.1c05228	journal	February 2022
Raman Spectroscopy Coupled with Chemometric Analysis for Speciation and Quantitative Analysis of Aqueous Phosphoric Acid Systems Clifford, Andrew J.; Lackey, Hope E.; Nelson, Gilbert L. Analytical Chemistry, Vol. 93, Issue 14 https://doi.org/10.1021/acs.analchem.1c00244	journal	March 2021
On-Line Monitoring of Gas-Phase Molecular Iodine Using Raman and Fluorescence Spectroscopy Paired with Chemometric Analysis Felmy, Heather M.; Clifford, Andrew J.; Medina, Adan Schafer Environmental Science & Technology, Vol. 55, Issue 6 https://doi.org/10.1021/acs.est.0c06137	journal	January 2021
Enabling Microscale Processing: Combined Raman and Absorbance Spectroscopy for Microfluidic On-Line Monitoring Nelson, Gilbert L.; Lackey, Hope E.; Bello, Job M. Analytical Chemistry, Vol. 93, Issue 3 https://doi.org/10.1021/acs.analchem.0c04225	journal	December 2020
Absolute Band Intensity of the Iodine Monochloride Fundamental Mode for Infrared Sensing and Quantitative Analysis Hughey, Kendall D.; Bradley, Ashley M.; Tonkyn, Russell G. The Journal of Physical Chemistry A, Vol. 124, Issue 46 https://doi.org/10.1021/acs.jpca.0c07353	journal	November 2020
Sensor Fusion: Comprehensive Real-Time, On-Line Monitoring for Process Control via Visible, Near-Infrared, and Raman Spectroscopy Lines, Amanda M.; Hall, Gabriel B.; Asmussen, Susan ACS Sensors, Vol. 5, Issue 8 https://doi.org/10.1021/acssensors.0c00659	journal	July 2020
Reimagining pH Measurement: Utilizing Raman Spectroscopy for Enhanced Accuracy in Phosphoric Acid Systems Lackey, Hope E.; Nelson, Gilbert L.; Lines, Amanda M. Analytical Chemistry, Vol. 92, Issue 8 https://doi.org/10.1021/acs.analchem.9b05708	journal	March 2020
Online, Real-Time Analysis of Highly Complex Processing Streams: Quantification of Analytes in Hanford Tank Sample Lines, A. M.; Tse, P.; Felmy, H. M. Industrial & Engineering Chemistry Research, Vol. 58, Issue 47 https://doi.org/10.1021/acs.iecr.9b03636	journal	October 2019
Online Monitoring of Solutions Within Microfluidic Chips: Simultaneous Raman and UV–Vis Absorption Spectroscopies Nelson, Gilbert L.; Lines, Amanda M.; Bello, Job M. ACS Sensors, Vol. 4, Issue 9 https://doi.org/10.1021/acssensors.9b00736	journal	August 2019
Micro-Raman Technology to Interrogate Two-Phase Extraction on a Microfluidic Device Nelson, Gilbert L.; Asmussen, Susan E.; Lines, Amanda M. Analytical Chemistry, Vol. 90, Issue 14 https://doi.org/10.1021/acs.analchem.7b04330	journal	May 2018
Development and testing of a novel micro-Raman probe and application of calibration method for the quantitative analysis of microfluidic nitric acid streams Nelson, Gilbert L.; Lines, Amanda M.; Casella, Amanda J. The Analyst, Vol. 143, Issue 5 https://doi.org/10.1039/C7AN01761H	journal	January 2018
Multivariate Analysis To Quantify Species in the Presence of Direct Interferents: Micro-Raman Analysis of HNO ₃ in Microfluidic Devices Lines, Amanda M.; Nelson, Gilbert L.; Casella, Amanda J. Analytical Chemistry, Vol. 90, Issue 4 https://doi.org/10.1021/acs.analchem.7b03833	journal	January 2018
Multivariate Analysis for Quantification of Plutonium(IV) in Nitric Acid Based on Absorption Spectra Lines, Amanda M.; Adami, Susan R.; Sinkov, Sergey I. Analytical Chemistry, Vol. 89, Issue 17 https://doi.org/10.1021/acs.analchem.7b02161	journal	August 2017

Similar Records

pnnl/Chemometric_Toolbox

Software · 2022 · OSTI ID:2375315

Smith, Ian

Near Infrared Spectroscopy Calibration for Wood Chemistry: Which Chemometric Technique Is Best for Prediction and Interpretation?

Journal Article · 2014 · Sensors · OSTI ID:1628544

Via, Brian; Zhou, Chengfeng; Acquah, Gifty; +2 more

Quantification of Raman-Interfering Polyoxoanions for Process Analysis: Comparison of Different Chemometric Models and a Demonstration on Real Hanford Waste

Journal Article · 2021 · Environmental Science and Technology · OSTI ID:1829446

Tse, Poki; Shafer, Jenifer; Bryan, Samuel A.; +1 more

Related Subjects

Upper-Division Undergraduate
Analytical Chemistry
Chemoinformatics
Interdisciplinary / Multidisciplinary
Computer-Based Learning
Problem Solving / Decision Making
Chemometrics
Spectroscopy

Practical Guide to Chemometric Analysis of Optical Spectroscopic Data

Citation Formats

References (58)

Similar Records

Related Subjects