Practical Guide to Chemometric Analysis of Optical Spectroscopic Data

Lackey, Hope E.; Sell, Richard L.; Nelson, Gilbert L.; Bryan, Thomas A.; Lines, Amanda M.; Bryan, Samuel A.

doi:10.1021/acs.jchemed.2c01112

Practical Guide to Chemometric Analysis of Optical Spectroscopic Data

Journal Article · Tue Jul 11 00:00:00 EDT 2023 · Journal of Chemical Education

DOI:https://doi.org/10.1021/acs.jchemed.2c01112· OSTI ID:1996916

Lackey, Hope E. ^[1]; Sell, Richard L. ^[1]; Nelson, Gilbert L. ^[2]; Bryan, Thomas A. ^[3]; Lines, Amanda M. ^[1]; ^[1]

BATTELLE (PACIFIC NW LAB)
UNIVERSITY PROGRAMS
The MathWorks, 3 Apple Hill Drive, Natick, MA 01760-2098

The methodology and mathematical treatment of several classic multivariate methods for the analysis of spectroscopic data is demonstrated in a straightforward way that can be used as a basis for teaching an undergraduate introductory course on chemometric analysis. The multivariate techniques of classical least squares (CLS), principal component regression (PCR), and partial least squares (PLS), as well as the univariate Beer’s law method have been described and compared, building students’ understanding by starting with the univariate method and progressing step by step into the multivariate methods. Equations for the production of regression vectors from training set spectral data is described and their use demonstrated for the prediction of constituent concentrations on a separate validation set of spectra. Extreme care is taken to ensure consistency in variable formatting of data matrices. This provides a key foundation to understanding how spectral data are manipulated using these different mathematical approaches for building quantitative regression models. Each method is applied to a real-world data set, and the results are discussed to show students the types of information that can be gleaned from each method. A training set comprised of 20 infrared absorbance spectra containing 3 constituents (benzene, polystyrene, and gasoline) of known composition are used to demonstrate the matrix operations for each regression method. A separate set of 12 real-world napalm samples (containing benzene, polystyrene and gasoline) are used as a validation set to demonstrate the ability to utilize the regression models on an unknown dataset. A toolbox (PNNL Chemometric Toolbox) written in MATLAB language is supplied in the Supplemental Information file and can be used as a companion for understanding the development and deployment of the chemometric algorithms described in this paper. The datasets of the infrared spectra are also supplied, allowing users to build and inspect the chemometric models on their own. Finally, the Toolbox includes scripts to assist users in loading their own datasets into MATLAB and performing CLS, PCR, and PLS on their data.

Research Organization:: Pacific Northwest National Laboratory (PNNL), Richland, WA (United States)

Sponsoring Organization:: USDOE

DOE Contract Number:: AC05-76RL01830

OSTI ID:: 1996916

Report Number(s):: PNNL-SA-178491

Journal Information:: Journal of Chemical Education, Journal Name: Journal of Chemical Education Journal Issue: 7 Vol. 100

Country of Publication:: United States

Language:: English

References (58)

From Periodic Properties to a Periodic Table Arrangement Besalú, Emili Journal of Chemical Education, Vol. 90, Issue 8 https://doi.org/10.1021/ed3004534	journal	June 2013
Chemometrics; what do we mean with it, and what do we want from it? Wold, Svante Chemometrics and Intelligent Laboratory Systems, Vol. 30, Issue 1 https://doi.org/10.1016/0169-7439(95)00042-9	journal	November 1995
Combining Chemometrics and Sensors: Toward New Applications in Monitoring and Environmental Analysis Chapman, James; Truong, Vi Khanh; Elbourne, Aaron Chemical Reviews, Vol. 120, Issue 13 https://doi.org/10.1021/acs.chemrev.9b00616	journal	May 2020
Development and testing of a novel micro-Raman probe and application of calibration method for the quantitative analysis of microfluidic nitric acid streams Nelson, Gilbert L.; Lines, Amanda M.; Casella, Amanda J. The Analyst, Vol. 143, Issue 5 https://doi.org/10.1039/C7AN01761H	journal	January 2018
Chemometrics in analytical chemistry—part II: modeling, validation, and applications Brereton, Richard G.; Jansen, Jeroen; Lopes, João Analytical and Bioanalytical Chemistry, Vol. 410, Issue 26 https://doi.org/10.1007/s00216-018-1283-4	journal	August 2018
Introducing Chemometrics to Graduate Students Öberg, Tomas Journal of Chemical Education, Vol. 83, Issue 8 https://doi.org/10.1021/ed083p1178	journal	August 2006
Raman Spectroscopy Coupled with Chemometric Analysis for Speciation and Quantitative Analysis of Aqueous Phosphoric Acid Systems Clifford, Andrew J.; Lackey, Hope E.; Nelson, Gilbert L. Analytical Chemistry, Vol. 93, Issue 14 https://doi.org/10.1021/acs.analchem.1c00244	journal	March 2021
Enabling Microscale Processing: Combined Raman and Absorbance Spectroscopy for Microfluidic On-Line Monitoring Nelson, Gilbert L.; Lackey, Hope E.; Bello, Job M. Analytical Chemistry, Vol. 93, Issue 3 https://doi.org/10.1021/acs.analchem.0c04225	journal	December 2020
Review of on-line and near real-time spectroscopic monitoring of processes relevant to nuclear material management Tse, P.; Bryan, S. A.; Bessen, N. P. Analytica Chimica Acta, Vol. 1107 https://doi.org/10.1016/j.aca.2020.02.008	journal	April 2020
Big Data in Modern Chemical Analysis Milman, B. L.; Zhurkovich, I. K. Journal of Analytical Chemistry, Vol. 75, Issue 4 https://doi.org/10.1134/S1061934820020124	journal	April 2020
Leveraging Multiple Raman Excitation Wavelength Systems for Process Monitoring of Nuclear Waste Streams Felmy, Heather M.; Lackey, Hope E.; Medina, Adan Schafer ACS ES&T Water, Vol. 2, Issue 3 https://doi.org/10.1021/acsestwater.1c00408	journal	February 2022
Partial least-squares regression: a tutorial Geladi, Paul; Kowalski, Bruce R. Analytica Chimica Acta, Vol. 185 https://doi.org/10.1016/0003-2670(86)80028-9	journal	January 1986
Comparison of multivariate calibration methods for quantitative spectral analysis Thomas, Edward V.; Haaland, David M. Analytical Chemistry, Vol. 62, Issue 10 https://doi.org/10.1021/ac00209a024	journal	May 1990
An Introduction to Multivariate Calibration and Analysis Beebe, Kenneth R.; Kowalski, Bruce R. Analytical Chemistry, Vol. 59, Issue 17 https://doi.org/10.1021/ac00144a725	journal	September 1987
Real-Time Process Monitoring of CO₂ Capture by Aqueous AMP-PZ Using Chemometrics: Pilot Plant Demonstration Kachko, Alexandr; van der Ham, Leen V.; Geers, Leon F. G. Industrial & Engineering Chemistry Research, Vol. 54, Issue 21 https://doi.org/10.1021/acs.iecr.5b00691	journal	May 2015
Introducing Chemometrics to the Analytical Curriculum: Combining Theory and Lab Experience Gilbert, Michael K.; Luttrell, Robert D.; Stout, David Journal of Chemical Education, Vol. 85, Issue 1 https://doi.org/10.1021/ed085p135	journal	January 2008
Bestimmung der Absorption des rothen Lichts in farbigen Flüssigkeiten No authors listed Annalen der Physik und Chemie, Vol. 162, Issue 5 https://doi.org/10.1002/andp.18521620505	journal	January 1852
Chemometrics for environmental monitoring: a review Dupont, Madeleine F.; Elbourne, Aaron; Cozzolino, Daniel Analytical Methods, Vol. 12, Issue 38 https://doi.org/10.1039/D0AY01389G	journal	January 2020
Online Monitoring of Solutions Within Microfluidic Chips: Simultaneous Raman and UV–Vis Absorption Spectroscopies Nelson, Gilbert L.; Lines, Amanda M.; Bello, Job M. ACS Sensors, Vol. 4, Issue 9 https://doi.org/10.1021/acssensors.9b00736	journal	August 2019
Uniform experimental design in chemometrics Xu, Qing-Song; Xu, Yuan-Da; Li, Lan Journal of Chemometrics, Vol. 32, Issue 11 https://doi.org/10.1002/cem.3020	journal	February 2018
Reimagining pH Measurement: Utilizing Raman Spectroscopy for Enhanced Accuracy in Phosphoric Acid Systems Lackey, Hope E.; Nelson, Gilbert L.; Lines, Amanda M. Analytical Chemistry, Vol. 92, Issue 8 https://doi.org/10.1021/acs.analchem.9b05708	journal	March 2020
Partial least-squares methods for spectral analyses. 1. Relation to other quantitative calibration methods and the extraction of qualitative information Haaland, David M.; Thomas, Edward V. Analytical Chemistry, Vol. 60, Issue 11 https://doi.org/10.1021/ac00162a020	journal	June 1988
Application of chemometric methods to XRF-data – A tutorial review Panchuk, Vitaly; Yaroshenko, Irina; Legin, Andrey Analytica Chimica Acta, Vol. 1040 https://doi.org/10.1016/j.aca.2018.05.023	journal	December 2018
In Situ Spectroscopic Analysis and Quantification of [Tc(CO) ₃ ] ⁺ in Hanford Tank Waste Branch, Shirmir D.; French, Amanda D.; Lines, Amanda M. Environmental Science & Technology, Vol. 52, Issue 14 https://doi.org/10.1021/acs.est.7b05840	journal	June 2018
To See the World in a Grain of Sand: Recognizing the Origin of Sand Specimens by Diffuse Reflectance Infrared Fourier Transform Spectroscopy and Multivariate Exploratory Data Analysis De Lorenzi Pezzolo, Alessandra Journal of Chemical Education, Vol. 88, Issue 9 https://doi.org/10.1021/ed9000409	journal	July 2011
Spectroscopic monitoring of spent nuclear fuel reprocessing streams: an evaluation of spent fuel solutions via Raman, visible, and near-infrared spectroscopy Bryan, S. A.; Levitskaia, Tatiana G.; Johnsen, A. M. Radiochimica Acta, Vol. 99, Issue 9 https://doi.org/10.1524/ract.2011.1865	journal	September 2011
Chemometrics Lavine, Barry K.; Workman, Jerome Analytical Chemistry, Vol. 85, Issue 2 https://doi.org/10.1021/ac303193j	journal	December 2012
Online, Real-Time Analysis of Highly Complex Processing Streams: Quantification of Analytes in Hanford Tank Sample Lines, A. M.; Tse, P.; Felmy, H. M. Industrial & Engineering Chemistry Research, Vol. 58, Issue 47 https://doi.org/10.1021/acs.iecr.9b03636	journal	October 2019
Chemometrics in analytical chemistry—part I: history, experimental design and data analysis tools Brereton, Richard G.; Jansen, Jeroen; Lopes, João Analytical and Bioanalytical Chemistry, Vol. 409, Issue 25 https://doi.org/10.1007/s00216-017-0517-1	journal	August 2017
Combined Raman and Turbidity Probe for Real-Time Analysis of Variable Turbidity Streams Lines, Amanda M.; Bello, Job M.; Gasbarro, Christina Analytical Chemistry, Vol. 94, Issue 8 https://doi.org/10.1021/acs.analchem.1c05228	journal	February 2022
Validation of chemometric models – A tutorial Westad, Frank; Marini, Federico Analytica Chimica Acta, Vol. 893 https://doi.org/10.1016/j.aca.2015.06.056	journal	September 2015
Multivariate data analysis: Its methods Mellinger, Michel Chemometrics and Intelligent Laboratory Systems, Vol. 2, Issue 1-3 https://doi.org/10.1016/0169-7439(87)80083-7	journal	August 1987
Non-destructive Spectroscopy combined with chemometrics as a tool for Green Chemical Analysis of environmental samples: A review Gredilla, Ainara; Fdez-Ortiz de Vallejuelo, Silvia; Elejoste, Nerea TrAC Trends in Analytical Chemistry, Vol. 76 https://doi.org/10.1016/j.trac.2015.11.011	journal	February 2016
IUPAC project: A glossary of concepts and terms in chemometrics Hibbert, D. Brynn; Minkkinen, Pentti; Faber, N. M. Analytica Chimica Acta, Vol. 642, Issue 1-2 https://doi.org/10.1016/j.aca.2009.02.020	journal	May 2009
New data preprocessing trends based on ensemble of multiple preprocessing techniques Mishra, Puneet; Biancolillo, Alessandra; Roger, Jean Michel TrAC Trends in Analytical Chemistry, Vol. 132 https://doi.org/10.1016/j.trac.2020.116045	journal	November 2020
Chemometrics in spectroscopy. Part 1. Classical chemometrics Geladi, Paul Spectrochimica Acta Part B: Atomic Spectroscopy, Vol. 58, Issue 5 https://doi.org/10.1016/S0584-8547(03)00037-5	journal	May 2003
Absolute Band Intensity of the Iodine Monochloride Fundamental Mode for Infrared Sensing and Quantitative Analysis Hughey, Kendall D.; Bradley, Ashley M.; Tonkyn, Russell G. The Journal of Physical Chemistry A, Vol. 124, Issue 46 https://doi.org/10.1021/acs.jpca.0c07353	journal	November 2020
Raman Scattering Techniques for Defense and Security Applications Lister, Adam P.; Sellors, William J.; Howle, Chris R. Analytical Chemistry, Vol. 93, Issue 1 https://doi.org/10.1021/acs.analchem.0c04606	journal	December 2020
Micro-Raman Technology to Interrogate Two-Phase Extraction on a Microfluidic Device Nelson, Gilbert L.; Asmussen, Susan E.; Lines, Amanda M. Analytical Chemistry, Vol. 90, Issue 14 https://doi.org/10.1021/acs.analchem.7b04330	journal	May 2018
Chemometrics in analytical chemistry – an overview of applications from 2014 to 2018 Santos, Mônica Cardoso; Nascimento, Paloma Andrade Martins; Guedes, Wesley Nascimento Eclética Química Journal, Vol. 44, Issue 2 https://doi.org/10.26850/1678-4618eqj.v44.2.2019.p11-25	journal	April 2019
Characterization of Carotenoids from Pineapples: An Integrated and Modular Experiment for Practical Learning of UV–vis Spectroscopy, Chromatography, Mass Spectrometry, and Chemometrics Chutakool, Worakan; Praneenararat, Thanit Journal of Chemical Education, Vol. 99, Issue 5 https://doi.org/10.1021/acs.jchemed.1c01021	journal	April 2022
How Can Chemometrics Improve Microfluidic Research? Jalali-Heravi, Mehdi; Arrastia, Mary; Gomez, Frank A. Analytical Chemistry, Vol. 87, Issue 7 https://doi.org/10.1021/ac504863y	journal	February 2015
SIMPLS: An alternative approach to partial least squares regression de Jong, Sijmen Chemometrics and Intelligent Laboratory Systems, Vol. 18, Issue 3 https://doi.org/10.1016/0169-7439(93)85002-X	journal	March 1993
Chemometrics applied to environmental systems Hopke, Philip K. Chemometrics and Intelligent Laboratory Systems, Vol. 149 https://doi.org/10.1016/j.chemolab.2015.07.015	journal	December 2015
On-Line Monitoring of Gas-Phase Molecular Iodine Using Raman and Fluorescence Spectroscopy Paired with Chemometric Analysis Felmy, Heather M.; Clifford, Andrew J.; Medina, Adan Schafer Environmental Science & Technology, Vol. 55, Issue 6 https://doi.org/10.1021/acs.est.0c06137	journal	January 2021
An Advanced Analytical Chemistry Experiment Using Gas Chromatography−Mass Spectrometry, MATLAB, and Chemometrics To Predict Biodiesel Blend Percent Composition Pierce, Karisa M.; Schale, Stephen P.; Le, Trang M. Journal of Chemical Education, Vol. 88, Issue 6 https://doi.org/10.1021/ed100917x	journal	March 2011
Multivariate Analysis for Quantification of Plutonium(IV) in Nitric Acid Based on Absorption Spectra Lines, Amanda M.; Adami, Susan R.; Sinkov, Sergey I. Analytical Chemistry, Vol. 89, Issue 17 https://doi.org/10.1021/acs.analchem.7b02161	journal	August 2017
Multivariate Curve Resolution Methods Illustrated Using Infrared Spectra of an Alcohol Dissolved in Carbon Tetrachloride Grung, Bjørn; Nodland, Egil; Førland, Geir Martin Journal of Chemical Education, Vol. 84, Issue 7 https://doi.org/10.1021/ed084p1193	journal	July 2007
Time-Resolved Step-Scan FT-IR Spectroscopy: Focus on Multivariate Curve Resolution Ruckebusch, C.; Duponchel, L.; Sombret, B. Journal of Chemical Information and Computer Sciences, Vol. 43, Issue 6 https://doi.org/10.1021/ci034094i	journal	October 2003
Teaching chemometrics in short course format Wise, Barry M. Journal of Chemometrics, Vol. 36, Issue 5 https://doi.org/10.1002/cem.3399	journal	April 2022
Sensor Fusion: Comprehensive Real-Time, On-Line Monitoring for Process Control via Visible, Near-Infrared, and Raman Spectroscopy Lines, Amanda M.; Hall, Gabriel B.; Asmussen, Susan ACS Sensors, Vol. 5, Issue 8 https://doi.org/10.1021/acssensors.0c00659	journal	July 2020
Multivariate Analysis To Quantify Species in the Presence of Direct Interferents: Micro-Raman Analysis of HNO ₃ in Microfluidic Devices Lines, Amanda M.; Nelson, Gilbert L.; Casella, Amanda J. Analytical Chemistry, Vol. 90, Issue 4 https://doi.org/10.1021/acs.analchem.7b03833	journal	January 2018
Experimental Design, Near-Infrared Spectroscopy, and Multivariate Calibration: An Advanced Project in a Chemometrics Course de Oliveira, Rodrigo R.; das Neves, Luiz S.; de Lima, Kássio M. G. Journal of Chemical Education, Vol. 89, Issue 12 https://doi.org/10.1021/ed200765j	journal	October 2012
Big (Bio)Chemical Data Mining Using Chemometric Methods: A Need for Chemists Parastar, Hadi; Tauler, Roma Angewandte Chemie International Edition, Vol. 61, Issue 44 https://doi.org/10.1002/anie.201801134	journal	September 2022
Teaching chemometrics: A course on application of mathematical techniques to chemistry Delaney, Michael F.; Warren, F. Vincent Journal of Chemical Education, Vol. 58, Issue 8 https://doi.org/10.1021/ed058p646	journal	August 1981
Chemometrics: Views and Propositions Kowalski, B. R. Journal of Chemical Information and Modeling, Vol. 15, Issue 4 https://doi.org/10.1021/ci60004a002	journal	November 1975
Principal component analysis Wold, Svante; Esbensen, Kim; Geladi, Paul Chemometrics and Intelligent Laboratory Systems, Vol. 2, Issue 1-3 https://doi.org/10.1016/0169-7439(87)80084-9	journal	August 1987
The origins of Beer's law Pfeiffer, Heinz G.; Liebhafsky, Herman A. Journal of Chemical Education, Vol. 28, Issue 3 https://doi.org/10.1021/ed028p123	journal	March 1951

Similar Records

pnnl/Chemometric_Toolbox

Software · Mon Sep 12 20:00:00 EDT 2022 · OSTI ID:code-92291

Near Infrared Spectroscopy Calibration for Wood Chemistry: Which Chemometric Technique Is Best for Prediction and Interpretation?

Journal Article · Fri Jul 25 00:00:00 EDT 2014 · Sensors · OSTI ID:1628544

Partial least-squares methods for spectral analyses. 2. Application to simulated and glass spectral data

Journal Article · Wed Jun 01 00:00:00 EDT 1988 · Anal. Chem.; (United States) · OSTI ID:6926307

Related Subjects

Upper-Division Undergraduate
Analytical Chemistry
Chemoinformatics
Interdisciplinary / Multidisciplinary
Computer-Based Learning
Problem Solving / Decision Making
Chemometrics
Spectroscopy

Practical Guide to Chemometric Analysis of Optical Spectroscopic Data

Citation Formats

References (58)

Similar Records

Related Subjects