skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: An ensemble model of QSAR tools for regulatory risk assessment

Abstract

Quantitative structure activity relationships (QSARs) are theoretical models that relate a quantitative measure of chemical structure to a physical property or a biological effect. QSAR predictions can be used for chemical risk assessment for protection of human and environmental health, which makes them interesting to regulators, especially in the absence of experimental data. For compatibility with regulatory use, QSAR models should be transparent, reproducible and optimized to minimize the number of false negatives. In silico QSAR tools are gaining wide acceptance as a faster alternative to otherwise time-consuming clinical and animal testing methods. However, different QSAR tools often make conflicting predictions for a given chemical and may also vary in their predictive performance across different chemical datasets. In a regulatory context, conflicting predictions raise interpretation, validation and adequacy concerns. To address these concerns, ensemble learning techniques in the machine learning paradigm can be used to integrate predictions from multiple tools. By leveraging various underlying QSAR algorithms and training datasets, the resulting consensus prediction should yield better overall predictive ability. We present a novel ensemble QSAR model using Bayesian classification. The model allows for varying a cut-off parameter that allows for a selection in the desirable trade-off between model sensitivity andmore » specificity. The predictive performance of the ensemble model is compared with four in silico tools (Toxtree, Lazar, OECD Toolbox, and Danish QSAR) to predict carcinogenicity for a dataset of air toxins (332 chemicals) and a subset of the gold carcinogenic potency database (480 chemicals). Leave-one-out cross validation results show that the ensemble model achieves the best trade-off between sensitivity and specificity (accuracy: 83.8 % and 80.4 %, and balanced accuracy: 80.6 % and 80.8 %) and highest inter-rater agreement [kappa (κ): 0.63 and 0.62] for both the datasets. The ROC curves demonstrate the utility of the cut-off feature in the predictive ability of the ensemble model. In conclusion, this feature provides an additional control to the regulators in grading a chemical based on the severity of the toxic endpoint under study.« less

Authors:
ORCiD logo [1];  [2];  [3];  [2]
  1. National Center for Computational Toxicology (ORISE Fellow), Research Triangle Park, NC (United States)
  2. Marquette Univ., Milwaukee, WI (United States)
  3. Georgetown Univ. Medical Center, Washington, D.C. (United States)
Publication Date:
Research Org.:
Oak Ridge Inst. for Science and Education (ORISE), Oak Ridge, TN (United States)
Sponsoring Org.:
USDOE
OSTI Identifier:
1375955
Resource Type:
Journal Article: Accepted Manuscript
Journal Name:
Journal of Cheminformatics
Additional Journal Information:
Journal Volume: 8; Journal Issue: 1; Journal ID: ISSN 1758-2946
Publisher:
Chemistry Central Ltd.
Country of Publication:
United States
Language:
English
Subject:
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CHEMISTRY; 97 MATHEMATICS AND COMPUTING; Computational toxicology; In silico QSAR tools; Hybrid QSAR models; Ensemble models; Risk assessment

Citation Formats

Pradeep, Prachi, Povinelli, Richard J., White, Shannon, and Merrill, Stephen J. An ensemble model of QSAR tools for regulatory risk assessment. United States: N. p., 2016. Web. doi:10.1186/s13321-016-0164-0.
Pradeep, Prachi, Povinelli, Richard J., White, Shannon, & Merrill, Stephen J. An ensemble model of QSAR tools for regulatory risk assessment. United States. doi:10.1186/s13321-016-0164-0.
Pradeep, Prachi, Povinelli, Richard J., White, Shannon, and Merrill, Stephen J. Thu . "An ensemble model of QSAR tools for regulatory risk assessment". United States. doi:10.1186/s13321-016-0164-0. https://www.osti.gov/servlets/purl/1375955.
@article{osti_1375955,
title = {An ensemble model of QSAR tools for regulatory risk assessment},
author = {Pradeep, Prachi and Povinelli, Richard J. and White, Shannon and Merrill, Stephen J.},
abstractNote = {Quantitative structure activity relationships (QSARs) are theoretical models that relate a quantitative measure of chemical structure to a physical property or a biological effect. QSAR predictions can be used for chemical risk assessment for protection of human and environmental health, which makes them interesting to regulators, especially in the absence of experimental data. For compatibility with regulatory use, QSAR models should be transparent, reproducible and optimized to minimize the number of false negatives. In silico QSAR tools are gaining wide acceptance as a faster alternative to otherwise time-consuming clinical and animal testing methods. However, different QSAR tools often make conflicting predictions for a given chemical and may also vary in their predictive performance across different chemical datasets. In a regulatory context, conflicting predictions raise interpretation, validation and adequacy concerns. To address these concerns, ensemble learning techniques in the machine learning paradigm can be used to integrate predictions from multiple tools. By leveraging various underlying QSAR algorithms and training datasets, the resulting consensus prediction should yield better overall predictive ability. We present a novel ensemble QSAR model using Bayesian classification. The model allows for varying a cut-off parameter that allows for a selection in the desirable trade-off between model sensitivity and specificity. The predictive performance of the ensemble model is compared with four in silico tools (Toxtree, Lazar, OECD Toolbox, and Danish QSAR) to predict carcinogenicity for a dataset of air toxins (332 chemicals) and a subset of the gold carcinogenic potency database (480 chemicals). Leave-one-out cross validation results show that the ensemble model achieves the best trade-off between sensitivity and specificity (accuracy: 83.8 % and 80.4 %, and balanced accuracy: 80.6 % and 80.8 %) and highest inter-rater agreement [kappa (κ): 0.63 and 0.62] for both the datasets. The ROC curves demonstrate the utility of the cut-off feature in the predictive ability of the ensemble model. In conclusion, this feature provides an additional control to the regulators in grading a chemical based on the severity of the toxic endpoint under study.},
doi = {10.1186/s13321-016-0164-0},
journal = {Journal of Cheminformatics},
number = 1,
volume = 8,
place = {United States},
year = {Thu Sep 22 00:00:00 EDT 2016},
month = {Thu Sep 22 00:00:00 EDT 2016}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record

Citation Metrics:
Cited by: 5 works
Citation information provided by
Web of Science

Save / Share: