An ensemble model of QSAR tools for regulatory risk assessment
- National Center for Computational Toxicology (ORISE Fellow), Research Triangle Park, NC (United States)
- Marquette Univ., Milwaukee, WI (United States)
- Georgetown Univ. Medical Center, Washington, D.C. (United States)
Quantitative structure activity relationships (QSARs) are theoretical models that relate a quantitative measure of chemical structure to a physical property or a biological effect. QSAR predictions can be used for chemical risk assessment for protection of human and environmental health, which makes them interesting to regulators, especially in the absence of experimental data. For compatibility with regulatory use, QSAR models should be transparent, reproducible and optimized to minimize the number of false negatives. In silico QSAR tools are gaining wide acceptance as a faster alternative to otherwise time-consuming clinical and animal testing methods. However, different QSAR tools often make conflicting predictions for a given chemical and may also vary in their predictive performance across different chemical datasets. In a regulatory context, conflicting predictions raise interpretation, validation and adequacy concerns. To address these concerns, ensemble learning techniques in the machine learning paradigm can be used to integrate predictions from multiple tools. By leveraging various underlying QSAR algorithms and training datasets, the resulting consensus prediction should yield better overall predictive ability. We present a novel ensemble QSAR model using Bayesian classification. The model allows for varying a cut-off parameter that allows for a selection in the desirable trade-off between model sensitivity and specificity. The predictive performance of the ensemble model is compared with four in silico tools (Toxtree, Lazar, OECD Toolbox, and Danish QSAR) to predict carcinogenicity for a dataset of air toxins (332 chemicals) and a subset of the gold carcinogenic potency database (480 chemicals). Leave-one-out cross validation results show that the ensemble model achieves the best trade-off between sensitivity and specificity (accuracy: 83.8 % and 80.4 %, and balanced accuracy: 80.6 % and 80.8 %) and highest inter-rater agreement [kappa (κ): 0.63 and 0.62] for both the datasets. The ROC curves demonstrate the utility of the cut-off feature in the predictive ability of the ensemble model. In conclusion, this feature provides an additional control to the regulators in grading a chemical based on the severity of the toxic endpoint under study.
- Research Organization:
- Oak Ridge Institute for Science and Education (ORISE), Oak Ridge, TN (United States)
- Sponsoring Organization:
- USDOE
- OSTI ID:
- 1375955
- Journal Information:
- Journal of Cheminformatics, Vol. 8, Issue 1; ISSN 1758-2946
- Publisher:
- Chemistry Central Ltd.Copyright Statement
- Country of Publication:
- United States
- Language:
- English
Web of Science
Mixtures of QSAR models: Learning application domains of p K predicto rs
|
journal | April 2020 |
QSAR classification and regression models for β-secretase inhibitors using relative distance matrices
|
journal | March 2018 |
QSAR/QSPR models based on quantum chemistry for risk assessment of pesticides according to current European legislation
|
journal | November 2019 |
Decision tree models to classify nanomaterials according to the DF4nanoGrouping scheme
|
journal | December 2017 |
Comprehensive ensemble in QSAR prediction for drug discovery
|
journal | October 2019 |
Similar Records
A novel QSAR model of Salmonella mutagenicity and its application in the safety assessment of drug impurities
Identification of putative estrogen receptor-mediated endocrine disrupting chemicals using QSAR- and structure-based virtual screening approaches