Model Calibration with Censored Data

Cao, Fang; Ba, Shan; Brenneman, William A.; Joseph, V. Roshan

doi:10.1080/00401706.2017.1345704

Title: Model Calibration with Censored Data

Abstract

Here, the purpose of model calibration is to make the model predictions closer to reality. The classical Kennedy-O'Hagan approach is widely used for model calibration, which can account for the inadequacy of the computer model while simultaneously estimating the unknown calibration parameters. In many applications, the phenomenon of censoring occurs when the exact outcome of the physical experiment is not observed, but is only known to fall within a certain region. In such cases, the Kennedy-O'Hagan approach cannot be used directly, and we propose a method to incorporate the censoring information when performing model calibration. The method is applied to study the compression phenomenon of liquid inside a bottle. The results show significant improvement over the traditional calibration methods, especially when the number of censored observations is large.

Authors:

Cao, Fang ^[1]; Ba, Shan ^[2]; Brenneman, William A. ^[2]; Joseph, V. Roshan ^[1]

Georgia Inst. of Technology, Atlanta, GA (United States)
Procter & Gamble Co., Mason, OH (United States)

Publication Date:: Wed Jun 28 00:00:00 EDT 2017

Research Org.:: Georgia Institute of Technology, Atlanta, GA (United States)

Sponsoring Org.:: USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR)

OSTI Identifier:: 1405186

Report Number(s):: DOE-GT-0010548-11
Journal ID: ISSN 0040-1706; FG02-13ER26159

Grant/Contract Number:: SC0010548

Resource Type:: Accepted Manuscript

Journal Name:: Technometrics

Additional Journal Information:: Journal Volume: 60; Journal Issue: 2; Journal ID: ISSN 0040-1706

Publisher:: Taylor & Francis

Country of Publication:: United States

Language:: English

Subject:: 97 MATHEMATICS AND COMPUTING; Bayesian calibration; Computer experiments; Gaussian process; Model discrepancy

Citation Formats


                    Cao, Fang, Ba, Shan, Brenneman, William A., and Joseph, V. Roshan. Model Calibration with Censored Data.  United States: N. p., 2017. 
Web.  doi:10.1080/00401706.2017.1345704.

Copy to clipboard


                    Cao, Fang, Ba, Shan, Brenneman, William A., & Joseph, V. Roshan. Model Calibration with Censored Data.  United States.  https://doi.org/10.1080/00401706.2017.1345704

Copy to clipboard


                    Cao, Fang, Ba, Shan, Brenneman, William A., and Joseph, V. Roshan. Wed .  
"Model Calibration with Censored Data".  United States.  https://doi.org/10.1080/00401706.2017.1345704.  https://www.osti.gov/servlets/purl/1405186.

Copy to clipboard


                    
@article{osti_1405186,

  title        = {Model Calibration with Censored Data},

  author       = {Cao, Fang and Ba, Shan and Brenneman, William A. and Joseph, V. Roshan},

  abstractNote = {Here, the purpose of model calibration is to make the model predictions closer to reality. The classical Kennedy-O'Hagan approach is widely used for model calibration, which can account for the inadequacy of the computer model while simultaneously estimating the unknown calibration parameters. In many applications, the phenomenon of censoring occurs when the exact outcome of the physical experiment is not observed, but is only known to fall within a certain region. In such cases, the Kennedy-O'Hagan approach cannot be used directly, and we propose a method to incorporate the censoring information when performing model calibration. The method is applied to study the compression phenomenon of liquid inside a bottle. The results show significant improvement over the traditional calibration methods, especially when the number of censored observations is large.},

  doi          = {10.1080/00401706.2017.1345704},

  journal      = {Technometrics},

  number       = 2,

  volume       = 60,

  place        = {United States},

  year         = {Wed Jun 28 00:00:00 EDT 2017},

  month        = {Wed Jun 28 00:00:00 EDT 2017}

}

Copy to clipboard

Journal Article:

Free Publicly Available Full Text

Accepted Manuscript (DOE)

Publisher's Version of Record

https://doi.org/10.1080/00401706.2017.1345704

Other availability

Search WorldCat to find libraries that may hold this journal

Citation Metrics:

Cited by: 5 works

Citation information provided by
Web of Science

Figures / Tables:

Figure 1:: Two samples with pictures taken at initial placement, 120 days and 240 days

All figures and tables (6 total)

Save / Share:

Export Metadata

Save to My Library

Works referenced in this record:

Gravitational Collapse of Colloidal Gels
journal, June 2005

Manley, S.; Skotheim, J. M.; Mahadevan, L.
Physical Review Letters, Vol. 94, Issue 21
DOI: 10.1103/PhysRevLett.94.218302

Computer Model Calibration Using High-Dimensional Output
journal, June 2008

Higdon, Dave; Gattiker, James; Williams, Brian
Journal of the American Statistical Association, Vol. 103, Issue 482
DOI: 10.1198/016214507000000888

Bayesian Calibration of Inexact Computer Models
journal, July 2016

Plumlee, Matthew
Journal of the American Statistical Association, Vol. 112, Issue 519
DOI: 10.1080/01621459.2016.1211016

Engineering-Driven Statistical Adjustment and Calibration
journal, April 2015

Joseph, V. Roshan; Yan, Huan
Technometrics, Vol. 57, Issue 2
DOI: 10.1080/00401706.2014.902773

Numerical Computation of Multivariate Normal Probabilities
journal, June 1992

Genz, Alan
Journal of Computational and Graphical Statistics, Vol. 1, Issue 2
DOI: 10.1080/10618600.1992.10477010

Surrogate Preposterior Analyses for Predicting and Enhancing Identifiability in Model Calibration
journal, January 2015

Jiang, Zhen; Apley, Daniel W.; Chen, Wei
International Journal for Uncertainty Quantification, Vol. 5, Issue 4
DOI: 10.1615/Int.J.UncertaintyQuantification.2015012627

Some results on the multivariate truncated normal distribution
journal, May 2005

Horrace, William C.
Journal of Multivariate Analysis, Vol. 94, Issue 1
DOI: 10.1016/j.jmva.2004.10.007

Bayesian Computation Using Design of Experiments-Based Interpolation Technique
journal, August 2012

Joseph, V. Roshan
Technometrics, Vol. 54, Issue 3
DOI: 10.1080/00401706.2012.680399

Bayesian calibration of computer models
journal, August 2001

Kennedy, Marc C.; O'Hagan, Anthony
Journal of the Royal Statistical Society: Series B (Statistical Methodology), Vol. 63, Issue 3
DOI: 10.1111/1467-9868.00294

On Moments of Folded and Truncated Multivariate Normal Distributions
journal, October 2017

Kan, Raymond; Robotti, Cesare
Journal of Computational and Graphical Statistics, Vol. 26, Issue 4
DOI: 10.1080/10618600.2017.1322092

Bayesian Additive Regression Tree Calibration of Complex High-Dimensional Computer Models
journal, April 2016

Pratola, M. T.; Higdon, D. M.
Technometrics, Vol. 58, Issue 2
DOI: 10.1080/00401706.2015.1049749

Numerical Computation of Multivariate Normal Probabilities
journal, June 1992

Genz, Alan
Journal of Computational and Graphical Statistics, Vol. 1, Issue 2
DOI: 10.2307/1390838

The Normal Law Under Linear Restrictions: Simulation and Estimation via Minimax Tilting
text, January 2016

Botev, Z. I.
arXiv
DOI: 10.48550/arxiv.1603.04166

Model Calibration Through Minimal Adjustments
journal, October 2014

Chang, Chia-Jung; Joseph, V. Roshan
Technometrics, Vol. 56, Issue 4
DOI: 10.1080/00401706.2013.850113

A Framework for Validation of Computer Models
journal, May 2007

Bayarri, Maria J.; Berger, James O.; Paulo, Rui
Technometrics, Vol. 49, Issue 2
DOI: 10.1198/004017007000000092

The normal law under linear restrictions: simulation and estimation via minimax tilting
journal, February 2016

Botev, Z. I.
Journal of the Royal Statistical Society: Series B (Statistical Methodology), Vol. 79, Issue 1
DOI: 10.1111/rssb.12162

Tobit models: A survey
journal, January 1984

Amemiya, Takeshi
Journal of Econometrics, Vol. 24, Issue 1-2
DOI: 10.1016/0304-4076(84)90074-5

Efficient Calibration for Imperfect Computer Models
preprint, January 2015

Tuo, Rui; Wu, C. F. Jeff
arXiv
DOI: 10.48550/arxiv.1507.07280

Gaussian predictive process models for large spatial data sets
journal, September 2008

Banerjee, Sudipto; Gelfand, Alan E.; Finley, Andrew O.
Journal of the Royal Statistical Society: Series B (Statistical Methodology), Vol. 70, Issue 4
DOI: 10.1111/j.1467-9868.2008.00663.x

Efficient calibration for imperfect computer models
journal, December 2015

Tuo, Rui; Wu, C. F. Jeff
The Annals of Statistics, Vol. 43, Issue 6
DOI: 10.1214/15-AOS1314

Prediction and Computer Model Calibration Using Outputs From Multifidelity Simulators
journal, November 2013

Goh, Joslin; Bingham, Derek; Holloway, James Paul
Technometrics, Vol. 55, Issue 4
DOI: 10.1080/00401706.2013.838910

Bayesian Validation of Computer Models
journal, November 2009

Wang, Shuchun; Chen, Wei; Tsui, Kwok-Leung
Technometrics, Vol. 51, Issue 4
DOI: 10.1198/TECH.2009.07011

Figures / Tables found in this record:

Figures/Tables have been extracted from DOE-funded journal article accepted manuscripts.

Similar Records in DOE PAGES and OSTI.GOV collections:

Bayesian calibration of thermodynamic models for the uptake of CO2 in supported amine sorbents using ab initio priors

Journal Article Mebane, David S. ; Bhat, K. Sham ; Kress, Joel D. ; ... - Journal of Materials Chemistry A

A statistical methodology was applied to the simultaneous calibration and validation of thermodynamic models for the uptake of CO{sub 2} in mesoporous silica-supported amines. The methodology is Bayesian, and follows the procedure introduced by Kennedy and O'Hagan. One key aspect of the application presented is the use of quantum chemical calculations to define prior probability distributions for physical model parameters. Inclusion of this prior information proved to be crucial to the identifiability of model parameters against experimental thermogravimetric data. Through the statistical analysis, a quantitative assessment of the accuracy of various quantum chemical methods is produced. Another important aspect ofmore »« less
https://doi.org/10.1039/C3CP42963F
Bayesian calibration of thermodynamic models for the uptake of CO{sub 2} in supported amine sorbents using ab initio priors

Journal Article Mebane, David S ; Bhat, K Sham ; Kress, Joel D ; ... - PHYSICAL CHEMISTRY CHEMICAL PHYSICS

A statistical methodology was applied to the simultaneous calibration and validation of thermodynamic models for the uptake of CO{sub 2} in mesoporous silica-supported amines. The methodology is Bayesian, and follows the procedure introduced by Kennedy and O'Hagan. One key aspect of the application presented is the use of quantum chemical calculations to define prior probability distributions for physical model parameters. Inclusion of this prior information proved to be crucial to the identifiability of model parameters against experimental thermogravimetric data. Through the statistical analysis, a quantitative assessment of the accuracy of various quantum chemical methods is produced. Another important aspect ofmore »« less
https://doi.org/10.1039/c3cp42963f
DISCRIMINATION CALIBRATION ANALYSIS METHODS FOR REGIONAL STATIONS

Conference Anderson, Dale N. ; Fagan, Deborah K. ; Taylor, Steve R. ; ...

For event discrimination, operational implementation of a regional seismic station requires three sequential calibration analyses. 1) Magnitude, distance and amplitude corrections (MDAC) made to observed regional amplitudes are necessary so that what remains in the corrected amplitude is mostly information about the seismic source-type. Corrected amplitudes can be used in ratios to discriminate between earthquakes and explosions. Calibration of MDAC can be accomplished with empirical Bayes estimation, which naturally provides metrics to determine when adequate calibration data have been acquired, and provides statistical assurance that the errors associated with MDAC calibration are negligible in future operational discrimination analysis. 2) MDACmore »« less
Comparing two correlated C indices with right‐censored survival outcome: a one‐shot nonparametric approach

Journal Article Kang, Le ; Chen, Weijie ; Petrick, Nicholas A. ; ... - Statistics in Medicine

The area under the receiver operating characteristic curve is often used as a summary index of the diagnostic ability in evaluating biomarkers when the clinical outcome (truth) is binary. When the clinical outcome is right‐censored survival time, the C index, motivated as an extension of area under the receiver operating characteristic curve, has been proposed by Harrell as a measure of concordance between a predictive biomarker and the right‐censored survival outcome. In this work, we investigate methods for statistical comparison of two diagnostic or predictive systems, of which they could either be two biomarkers or two fixed algorithms, in termsmore »« less
Cited by 229
https://doi.org/10.1002/sim.6370
A semiparametric approach to hazard estimation with randomly right-censored observations

Miscellaneous Kouassi, D A

One method for estimating a hazard function h(t) is to assume that it is a member of a known parametric family and can be expressed as h(t;[theta]), where [theta] is an unknown parameter. Usually, [theta] is estimated by the maximum likelihood method. Its estimator [cflx [theta]] is used in h(t;[cflx [theta]]) to obtain a parametric estimator of h(t). h(t) can be estimated nonparametrically by a kernel estimator [cflx h](t). The idea proposed in this dissertation is to fit a combination of parametric and nonparametric estimators, h[sub [alpha]](t;[cflx [theta]]) + (1 [minus] [alpha])[cflx h](t), where the weight [alpha][element of][0,1] is unknown,more »« less

Other research related to this record: