Bootstrap performance profiles in stochastic algorithms assessment
- Instituto de Ciências Biomédicas Abel Salazar, Universidade do Porto, 4099-002 Porto, Portugal, pnoliveira@icbas.up.pt (Portugal)
Optimization with stochastic algorithms has become a relevant research field. Due to its stochastic nature, its assessment is not straightforward and involves integrating accuracy and precision. Performance profiles for the mean do not show the trade-off between accuracy and precision, and parametric stochastic profiles require strong distributional assumptions and are limited to the mean performance for a large number of runs. In this work, bootstrap performance profiles are used to compare stochastic algorithms for different statistics. This technique allows the estimation of the sampling distribution of almost any statistic even with small samples. Multiple comparison profiles are presented for more than two algorithms. The advantages and drawbacks of each assessment methodology are discussed.
- OSTI ID:
- 22391050
- Journal Information:
- AIP Conference Proceedings, Vol. 1648, Issue 1; Conference: ICNAAM-2014: International Conference on Numerical Analysis and Applied Mathematics 2014, Rhodes (Greece), 22-28 Sep 2014; Other Information: (c) 2015 AIP Publishing LLC; Country of input: International Atomic Energy Agency (IAEA); ISSN 0094-243X
- Country of Publication:
- United States
- Language:
- English
Similar Records
A stochastic EM estimator in the presence of missing data - theory and applications
An approach to assessing stochastic radiogenic risk in medical imaging