Hyperparameter autotuning of programs with HybridTuner

Sauk, Benjamin; Sahinidis, Nikolaos V.

doi:10.1007/s10472-022-09793-3

Hyperparameter autotuning of programs with HybridTuner

Journal Article · 18 May 2022 · Annals of Mathematics and Artificial Intelligence

DOI:https://doi.org/10.1007/s10472-022-09793-3· OSTI ID:1981485

Sauk, Benjamin;

Not provided.

Research Organization:: Carnegie Mellon Univ., Pittsburgh, PA (United States)

Sponsoring Organization:: USDOE

OSTI ID:: 1981485

Journal Information:: Annals of Mathematics and Artificial Intelligence, Journal Name: Annals of Mathematics and Artificial Intelligence Journal Issue: 2-3 Vol. 91; ISSN 1012-2443

Publisher:: Springer

Country of Publication:: United States

Language:: English

References (30)

A hybrid simplex search and particle swarm optimization for unconstrained optimization Fan, Shu-Kai S.; Zahara, Erwie European Journal of Operational Research, Vol. 181, Issue 2 https://doi.org/10.1016/j.ejor.2006.06.034	journal	September 2007
A Simplex Method for Function Minimization Nelder, J. A.; Mead, R. The Computer Journal, Vol. 7, Issue 4 https://doi.org/10.1093/comjnl/7.4.308	journal	January 1965
The irace package: Iterated racing for automatic algorithm configuration López-Ibáñez, Manuel; Dubois-Lacoste, Jérémie; Pérez Cáceres, Leslie Operations Research Perspectives, Vol. 3 https://doi.org/10.1016/j.orp.2016.09.002	journal	January 2016
Asynchronous parallel hybrid optimization combining DIRECT and GSS Griffin, Joshua D.; Kolda, Tamara G. Optimization Methods and Software, Vol. 25, Issue 5 https://doi.org/10.1080/10556780903039893	journal	October 2010
Sequential Model-Based Optimization for General Algorithm Configuration Hutter, Frank; Hoos, Holger H.; Leyton-Brown, Kevin Lecture Notes in Computer Science https://doi.org/10.1007/978-3-642-25566-3_40	book	January 2011
Autotuning GPU Compiler Parameters Using OpenTuner Bruel, Pedro; Amarís, Marcos; Goldman, Alfredo Anais do XVI Simpósio em Sistemas Computacionais de Alto Desempenho (WSCAD 2015) https://doi.org/10.5753/wscad.2015.14268	conference	October 2015
ParamILS: An Automatic Algorithm Configuration Framework Hutter, F.; Hoos, H. H.; Leyton-Brown, K. Journal of Artificial Intelligence Research, Vol. 36 https://doi.org/10.1613/jair.2861	journal	October 2009
Algorithm 856: APPSPACK 4.0: asynchronous parallel pattern search for derivative-free optimization Gray, Genetha A.; Kolda, Tamara G. ACM Transactions on Mathematical Software, Vol. 32, Issue 3 https://doi.org/10.1145/1163641.1163647	journal	September 2006
Active Harmony: Towards Automated Performance Tuning Tapus, C.; Hollingsworth, J. K. ACM/IEEE SC 2002 Conference (SC'02) https://doi.org/10.1109/SC.2002.10062	conference	January 2002
Automated empirical optimizations of software and the ATLAS project Clint Whaley, R.; Petitet, Antoine; Dongarra, Jack J. Parallel Computing, Vol. 27, Issue 1-2 https://doi.org/10.1016/S0167-8191(00)00087-9	journal	January 2001
UOBYQA: unconstrained optimization by quadratic approximation Powell, M. J. D. Mathematical Programming, Vol. 92, Issue 3 https://doi.org/10.1007/s101070100290	journal	May 2002
A Survey on Compiler Autotuning using Machine Learning Ashouri, Amir H.; Killian, William; Cavazos, John ACM Computing Surveys, Vol. 51, Issue 5 https://doi.org/10.1145/3197978	journal	January 2019
Derivative-free optimization: a review of algorithms and comparison of software implementations Rios, Luis Miguel; Sahinidis, Nikolaos V. Journal of Global Optimization, Vol. 56, Issue 3 https://doi.org/10.1007/s10898-012-9951-y	journal	July 2012
Cobayn Ashouri, Amir Hossein; Mariani, Giovanni; Palermo, Gianluca ACM Transactions on Architecture and Code Optimization, Vol. 13, Issue 2 https://doi.org/10.1145/2928270	journal	June 2016
XSEDE: Accelerating Scientific Discovery Towns, John; Cockerill, Timothy; Dahan, Maytal Computing in Science & Engineering, Vol. 16, Issue 5 https://doi.org/10.1109/MCSE.2014.80	journal	September 2014
Bridges: a uniquely flexible HPC resource for new communities and data analytics Nystrom, Nicholas A.; Levine, Michael J.; Roskies, Ralph Z. Proceedings of the 2015 XSEDE Conference on Scientific Advancements Enabled by Enhanced Cyberinfrastructure - XSEDE '15 https://doi.org/10.1145/2792745.2792775	conference	January 2015
Extreme compass and Dynamic Multi-Armed Bandits for Adaptive Operator Selection Maturana, Jorge; Fialho, Alvaro; Saubion, Frederic 2009 IEEE Congress on Evolutionary Computation https://doi.org/10.1109/CEC.2009.4982970	conference	May 2009
OpenTuner: an extensible framework for program autotuning Ansel, Jason; Kamil, Shoaib; Veeramachaneni, Kalyan Proceedings of the 23rd international conference on Parallel architectures and compilation - PACT '14 https://doi.org/10.1145/2628071.2628092	conference	January 2014
SNOBFIT -- Stable Noisy Optimization by Branch and Fit Huyer, Waltraud; Neumaier, Arnold ACM Transactions on Mathematical Software, Vol. 35, Issue 2 https://doi.org/10.1145/1377612.1377613	journal	July 2008
On the efficiency of nature-inspired metaheuristics in expensive global optimization with limited budget Sergeyev, Ya. D.; Kvasov, D. E.; Mukhametzhanov, M. S. Scientific Reports, Vol. 8, Issue 1 https://doi.org/10.1038/s41598-017-18940-4	journal	January 2018
Tuning BARON using derivative-free optimization algorithms Liu, Jianfeng; Ploskas, Nikolaos; Sahinidis, Nikolaos V. Journal of Global Optimization, Vol. 74, Issue 4 https://doi.org/10.1007/s10898-018-0640-3	journal	March 2018
An Improved Magma Gemm For Fermi Graphics Processing Units Nath, Rajib; Tomov, Stanimire; Dongarra, Jack The International Journal of High Performance Computing Applications, Vol. 24, Issue 4 https://doi.org/10.1177/1094342010385729	journal	September 2010
Equation of State Calculations by Fast Computing Machines Metropolis, Nicholas; Rosenbluth, Arianna W.; Rosenbluth, Marshall N. The Journal of Chemical Physics, Vol. 21, Issue 6 https://doi.org/10.1063/1.1699114	journal	June 1953
Continuous learning of compiler heuristics Tartara, Michele; Crespi Reghizzi, Stefano ACM Transactions on Architecture and Code Optimization, Vol. 9, Issue 4 https://doi.org/10.1145/2400682.2400705	journal	January 2013
Fast implementation of DGEMM on Fermi GPU Tan, Guangming; Li, Linchuan; Triechle, Sean Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis on - SC '11 https://doi.org/10.1145/2063384.2063431	conference	January 2011
Analyzing bandit-based adaptive operator selection mechanisms Fialho, Álvaro; Da Costa, Luis; Schoenauer, Marc Annals of Mathematics and Artificial Intelligence, Vol. 60, Issue 1-2 https://doi.org/10.1007/s10472-010-9213-y	journal	September 2010
A particle swarm pattern search method for bound constrained global optimization Vaz, A. Ismael F.; Vicente, Luís N. Journal of Global Optimization, Vol. 39, Issue 2 https://doi.org/10.1007/s10898-007-9133-5	journal	February 2007
Review and comparison of algorithms and software for mixed-integer derivative-free optimization Ploskas, Nikolaos; Sahinidis, Nikolaos V. Journal of Global Optimization, Vol. 82, Issue 3 https://doi.org/10.1007/s10898-021-01085-0	journal	September 2021
GPU parameter tuning for tall and skinny dense linear least squares problems Sauk, Benjamin; Ploskas, Nikolaos; Sahinidis, Nikolaos Optimization Methods and Software, Vol. 35, Issue 3 https://doi.org/10.1080/10556788.2018.1527331	journal	October 2018
PetaBricks: a language and compiler for algorithmic choice Ansel, Jason; Chan, Cy; Wong, Yee Lok Proceedings of the 2009 ACM SIGPLAN conference on Programming language design and implementation - PLDI '09 https://doi.org/10.1145/1542476.1542481	conference	January 2009

Similar Records

Autotune

Software · 2015 · OSTI ID:1232356

Autotune

Software · 2015 · OSTI ID:code-3529

ECabc: A feature tuning program focused on Artificial Neural Network hyperparameters

Journal Article · 2019 · Journal of Open Source Software · OSTI ID:2283733

Related Subjects

Computer Science
Mathematics

Hyperparameter autotuning of programs with HybridTuner

Citation Formats

References (30)

Similar Records

Related Subjects