LM4HPC: Towards Effective Language Model Application in High-Performance Computing

Chen, L; Lin, P; Vanderbruggen, T; Liao, C; Emani, M; Supinski, B

doi:10.1007/978-3-031-40744-4_2

LM4HPC: Towards Effective Language Model Application in High-Performance Computing

Conference · Fri May 19 04:00:00 EDT 2023

DOI:https://doi.org/10.1007/978-3-031-40744-4_2· OSTI ID:2329383

Chen, L ^[1]; Lin, P ^[1]; Vanderbruggen, T ^[1]; Liao, C ^[1]; Emani, M ^[2]; Supinski, B ^[1]

Lawrence Livermore National Laboratory
Argonne National Laboratory

Research Organization:: Lawrence Livermore National Laboratory (LLNL), Livermore, CA (United States)

Sponsoring Organization:: USDOE National Nuclear Security Administration (NNSA)

DOE Contract Number:: AC52-07NA27344

OSTI ID:: 2329383

Report Number(s):: LLNL-CONF-849438; 1075118

Country of Publication:: United States

Language:: English

References (12)

DRB-ML-Dataset Lin, Pei-Hung; Liao, Chunhua LLNL-IPO (LLNL Innovation and Partnerships Office (IPO)) https://doi.org/10.11579/1958879	dataset	January 2022
CodeBERT: A Pre-Trained Model for Programming and Natural Languages Feng, Zhangyin; Guo, Daya; Tang, Duyu Findings of the Association for Computational Linguistics: EMNLP 2020 https://doi.org/10.18653/v1/2020.findings-emnlp.139	conference	January 2020
Learning to Parallelize in a Shared-Memory Environment with Transformers Harel, Re'em; Pinter, Yuval; Oren, Gal Proceedings of the 28th ACM SIGPLAN Annual Symposium on Principles and Practice of Parallel Programming https://doi.org/10.1145/3572848.3582565	conference	February 2023
Rodinia: A benchmark suite for heterogeneous computing Che, Shuai; Boyer, Michael; Meng, Jiayuan 2009 IEEE International Symposium on Workload Characterization (IISWC) https://doi.org/10.1109/IISWC.2009.5306797	conference	October 2009
DataRaceBench Liao, Chunhua; Lin, Pei-Hung; Asplund, Joshua Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis https://doi.org/10.1145/3126908.3126958	conference	November 2017
Finding Reusable Machine Learning Components to Build Programming Language Processing Pipelines Flynn, Patrick; Vanderbruggen, Tristan; Liao, Chunhua Lecture Notes in Computer Science https://doi.org/10.1007/978-3-031-36889-9_27	book	January 2023
Multi-View Learning for Parallelism Discovery of Sequential Programs Chen, Le; Mahmud, Quazi Ishtiaque; Jannesari, Ali 2022 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW) https://doi.org/10.1109/IPDPSW55747.2022.00059	conference	May 2022
CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation Wang, Yue; Wang, Weishi; Joty, Shafiq Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing https://doi.org/10.18653/v1/2021.emnlp-main.685	conference	January 2021
Convolutional Neural Networks over Tree Structures for Programming Language Processing Mou, Lili; Li, Ge; Zhang, Lu Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 30, Issue 1 https://doi.org/10.1609/aaai.v30i1.10139	journal	February 2016
Early Experience with Transformer-Based Similarity Analysis for DataRaceBench Chen, Winson; Vanderbruggen, Tristan; Lin, Pei-Hung 2022 IEEE/ACM Sixth International Workshop on Software Correctness for HPC Applications (Correctness) https://doi.org/10.1109/Correctness56720.2022.00011	conference	November 2022
ExeBench: an ML-scale dataset of executable C functions Armengol-Estapé, Jordi; Woodruff, Jackson; Brauckmann, Alexander Proceedings of the 6th ACM SIGPLAN International Symposium on Machine Programming https://doi.org/10.1145/3520312.3534867	conference	June 2022
HPCFAIR: Enabling FAIR AI for HPC Applications Verma, Gaurav; Emani, Murali; Liao, Chunhua 2021 IEEE/ACM Workshop on Machine Learning in High Performance Computing Environments (MLHPC) https://doi.org/10.1109/MLHPC54614.2021.00011	conference	November 2021

Similar Records

HPC-GPT: Integrating Large Language Model for High-Performance Computing

Conference · Mon Aug 14 00:00:00 EDT 2023 · OSTI ID:2328224

Towards Seamless Management of AI Models in High-Performance Computing

Conference · Mon Jun 12 00:00:00 EDT 2023 · OSTI ID:1984750

Towards an Abstraction-Friendly Programming Model for High Productivity and High Performance Computing

Conference · Tue Oct 13 00:00:00 EDT 2009 · OSTI ID:967752

Related Subjects

Computer science

LM4HPC: Towards Effective Language Model Application in High-Performance Computing

Citation Formats

References (12)

Similar Records

Related Subjects