Hyperparameter autotuning of programs with HybridTuner

Sauk, Benjamin; Sahinidis, Nikolaos V.

doi:10.1007/s10472-022-09793-3

Hyperparameter autotuning of programs with HybridTuner

Journal Article · 18 May 2022 · Annals of Mathematics and Artificial Intelligence

DOI:https://doi.org/10.1007/s10472-022-09793-3· OSTI ID:1981485

Sauk, Benjamin;

Not provided.

Research Organization:: Carnegie Mellon Univ., Pittsburgh, PA (United States)

Sponsoring Organization:: USDOE

OSTI ID:: 1981485

Journal Information:: Annals of Mathematics and Artificial Intelligence, Vol. 91, Issue 2-3; ISSN 1012-2443

Publisher:: Springer

Country of Publication:: United States

Language:: English

References (29)

ParamILS: An Automatic Algorithm Configuration Framework Hutter, F.; Hoos, H. H.; Leyton-Brown, K. Journal of Artificial Intelligence Research, Vol. 36 https://doi.org/10.1613/jair.2861	journal	October 2009
PetaBricks: a language and compiler for algorithmic choice Ansel, Jason; Chan, Cy; Wong, Yee Lok Proceedings of the 2009 ACM SIGPLAN conference on Programming language design and implementation - PLDI '09 https://doi.org/10.1145/1542476.1542481	conference	January 2009
Bridges: a uniquely flexible HPC resource for new communities and data analytics Nystrom, Nicholas A.; Levine, Michael J.; Roskies, Ralph Z. Proceedings of the 2015 XSEDE Conference on Scientific Advancements Enabled by Enhanced Cyberinfrastructure - XSEDE '15 https://doi.org/10.1145/2792745.2792775	conference	January 2015
Derivative-free optimization: a review of algorithms and comparison of software implementations Rios, Luis Miguel; Sahinidis, Nikolaos V. Journal of Global Optimization, Vol. 56, Issue 3 https://doi.org/10.1007/s10898-012-9951-y	journal	July 2012
A hybrid simplex search and particle swarm optimization for unconstrained optimization Fan, Shu-Kai S.; Zahara, Erwie European Journal of Operational Research, Vol. 181, Issue 2 https://doi.org/10.1016/j.ejor.2006.06.034	journal	September 2007
Fast implementation of DGEMM on Fermi GPU Tan, Guangming; Li, Linchuan; Triechle, Sean Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis on - SC '11 https://doi.org/10.1145/2063384.2063431	conference	January 2011
Algorithm 856: APPSPACK 4.0: asynchronous parallel pattern search for derivative-free optimization Gray, Genetha A.; Kolda, Tamara G. ACM Transactions on Mathematical Software, Vol. 32, Issue 3 https://doi.org/10.1145/1163641.1163647	journal	September 2006
Sequential Model-Based Optimization for General Algorithm Configuration Hutter, Frank; Hoos, Holger H.; Leyton-Brown, Kevin Lecture Notes in Computer Science https://doi.org/10.1007/978-3-642-25566-3_40	book	January 2011
Active Harmony: Towards Automated Performance Tuning Tapus, C.; Hollingsworth, J. K. ACM/IEEE SC 2002 Conference (SC'02) https://doi.org/10.1109/SC.2002.10062	conference	January 2002
An Improved Magma Gemm For Fermi Graphics Processing Units Nath, Rajib; Tomov, Stanimire; Dongarra, Jack The International Journal of High Performance Computing Applications, Vol. 24, Issue 4 https://doi.org/10.1177/1094342010385729	journal	September 2010
A Survey on Compiler Autotuning using Machine Learning Ashouri, Amir H.; Killian, William; Cavazos, John ACM Computing Surveys, Vol. 51, Issue 5 https://doi.org/10.1145/3197978	journal	January 2019
Continuous learning of compiler heuristics Tartara, Michele; Crespi Reghizzi, Stefano ACM Transactions on Architecture and Code Optimization, Vol. 9, Issue 4 https://doi.org/10.1145/2400682.2400705	journal	January 2013
Review and comparison of algorithms and software for mixed-integer derivative-free optimization Ploskas, Nikolaos; Sahinidis, Nikolaos V. Journal of Global Optimization, Vol. 82, Issue 3 https://doi.org/10.1007/s10898-021-01085-0	journal	September 2021
A particle swarm pattern search method for bound constrained global optimization Vaz, A. Ismael F.; Vicente, Luís N. Journal of Global Optimization, Vol. 39, Issue 2 https://doi.org/10.1007/s10898-007-9133-5	journal	February 2007
Extreme compass and Dynamic Multi-Armed Bandits for Adaptive Operator Selection Maturana, Jorge; Fialho, Alvaro; Saubion, Frederic 2009 IEEE Congress on Evolutionary Computation https://doi.org/10.1109/CEC.2009.4982970	conference	May 2009
On the efficiency of nature-inspired metaheuristics in expensive global optimization with limited budget Sergeyev, Ya. D.; Kvasov, D. E.; Mukhametzhanov, M. S. Scientific Reports, Vol. 8, Issue 1 https://doi.org/10.1038/s41598-017-18940-4	journal	January 2018
XSEDE: Accelerating Scientific Discovery Towns, John; Cockerill, Timothy; Dahan, Maytal Computing in Science & Engineering, Vol. 16, Issue 5 https://doi.org/10.1109/MCSE.2014.80	journal	September 2014
Asynchronous parallel hybrid optimization combining DIRECT and GSS Griffin, Joshua D.; Kolda, Tamara G. Optimization Methods and Software, Vol. 25, Issue 5 https://doi.org/10.1080/10556780903039893	journal	October 2010
Automated empirical optimizations of software and the ATLAS project Clint Whaley, R.; Petitet, Antoine; Dongarra, Jack J. Parallel Computing, Vol. 27, Issue 1-2 https://doi.org/10.1016/S0167-8191(00)00087-9	journal	January 2001
Autotuning GPU Compiler Parameters Using OpenTuner Bruel, Pedro; Amarís, Marcos; Goldman, Alfredo Anais do XVI Simpósio em Sistemas Computacionais de Alto Desempenho (WSCAD 2015) https://doi.org/10.5753/wscad.2015.14268	conference	October 2015
A Simplex Method for Function Minimization Nelder, J. A.; Mead, R. The Computer Journal, Vol. 7, Issue 4 https://doi.org/10.1093/comjnl/7.4.308	journal	January 1965
The irace package: Iterated racing for automatic algorithm configuration López-Ibáñez, Manuel; Dubois-Lacoste, Jérémie; Pérez Cáceres, Leslie Operations Research Perspectives, Vol. 3 https://doi.org/10.1016/j.orp.2016.09.002	journal	January 2016
GPU parameter tuning for tall and skinny dense linear least squares problems Sauk, Benjamin; Ploskas, Nikolaos; Sahinidis, Nikolaos Optimization Methods and Software, Vol. 35, Issue 3 https://doi.org/10.1080/10556788.2018.1527331	journal	October 2018
Equation of State Calculations by Fast Computing Machines Metropolis, Nicholas; Rosenbluth, Arianna W.; Rosenbluth, Marshall N. The Journal of Chemical Physics, Vol. 21, Issue 6 https://doi.org/10.1063/1.1699114	journal	June 1953
OpenTuner: an extensible framework for program autotuning Ansel, Jason; Kamil, Shoaib; Veeramachaneni, Kalyan Proceedings of the 23rd international conference on Parallel architectures and compilation - PACT '14 https://doi.org/10.1145/2628071.2628092	conference	January 2014
Cobayn Ashouri, Amir Hossein; Mariani, Giovanni; Palermo, Gianluca ACM Transactions on Architecture and Code Optimization, Vol. 13, Issue 2 https://doi.org/10.1145/2928270	journal	June 2016
Analyzing bandit-based adaptive operator selection mechanisms Fialho, Álvaro; Da Costa, Luis; Schoenauer, Marc Annals of Mathematics and Artificial Intelligence, Vol. 60, Issue 1-2 https://doi.org/10.1007/s10472-010-9213-y	journal	September 2010
Tuning BARON using derivative-free optimization algorithms Liu, Jianfeng; Ploskas, Nikolaos; Sahinidis, Nikolaos V. Journal of Global Optimization, Vol. 74, Issue 4 https://doi.org/10.1007/s10898-018-0640-3	journal	March 2018
SNOBFIT -- Stable Noisy Optimization by Branch and Fit Huyer, Waltraud; Neumaier, Arnold ACM Transactions on Mathematical Software, Vol. 35, Issue 2 https://doi.org/10.1145/1377612.1377613	journal	July 2008

Similar Records

ECabc: A feature tuning program focused on Artificial Neural Network hyperparameters

Journal Article · 2019 · Journal of Open Source Software · OSTI ID:2283733

Sharma, Sanskriti; Gelaf-Romer, Hernan; Kessler, Travis; +1 more

Two-Step Hyperparameter Optimization Method: Accelerating Hyperparameter Search by Using a Fraction of a Training Dataset

Journal Article · 2024 · Artificial Intelligence for the Earth Systems · OSTI ID:2323416

Yu, Sungduk; Ma, Po-Lun; Singh, Balwinder; +2 more

Two-Step Hyperparameter Optimization Method: Accelerating Hyperparameter Search by Using a Fraction of a Training Dataset

Journal Article · 2024 · Artificial Intelligence for the Earth Systems · OSTI ID:2323417

Yu, Sungduk; Ma, Po-Lun; Singh, Balwinder; +2 more

Related Subjects

Computer Science
Mathematics

Hyperparameter autotuning of programs with HybridTuner

Citation Formats

References (29)

Similar Records

Related Subjects