LM4HPC: Towards Effective Language Model Application in High-Performance Computing

Chen, L; Lin, P; Vanderbruggen, T; Liao, C; Emani, M; Supinski, B

doi:10.1007/978-3-031-40744-4_2

LM4HPC: Towards Effective Language Model Application in High-Performance Computing

Conference · 19 May 2023

DOI:https://doi.org/10.1007/978-3-031-40744-4_2· OSTI ID:2329383

Chen, L ^[1]; Lin, P ^[1]; Vanderbruggen, T ^[1]; Liao, C ^[1]; Emani, M ^[2]; Supinski, B ^[1]

Lawrence Livermore National Laboratory
Argonne National Laboratory

View Conference

Research Organization:: Lawrence Livermore National Laboratory (LLNL), Livermore, CA (United States)

Sponsoring Organization:: USDOE National Nuclear Security Administration (NNSA)

DOE Contract Number:: AC52-07NA27344

OSTI ID:: 2329383

Report Number(s):: LLNL-CONF-849438; 1075118

Resource Relation:: Journal Volume: 14114; Conference: Bristol, null, United Kingdom

Country of Publication:: United States

Language:: English

References (12)

Multi-View Learning for Parallelism Discovery of Sequential Programs No authors listed 2022 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW) https://doi.org/10.1109/IPDPSW55747.2022.00059		May 2022
Finding Reusable Machine Learning Components to Build Programming Language Processing Pipelines No authors listed Lecture Notes in Computer Science https://doi.org/10.1007/978-3-031-36889-9_27		January 2023
CodeBERT: A Pre-Trained Model for Programming and Natural Languages No authors listed Findings of the Association for Computational Linguistics: EMNLP 2020 https://doi.org/10.18653/v1/2020.findings-emnlp.139		January 2020
CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation No authors listed Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing https://doi.org/10.18653/v1/2021.emnlp-main.685		January 2021
Convolutional Neural Networks over Tree Structures for Programming Language Processing No authors listed Proceedings of the AAAI Conference on Artificial Intelligence https://doi.org/10.1609/aaai.v30i1.10139		February 2016
DRB-ML-Dataset No authors listed LLNL-IPO (LLNL Innovation and Partnerships Office (IPO)) https://doi.org/10.11579/1958879		January 2022
DataRaceBench No authors listed Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis https://doi.org/10.1145/3126908.3126958		November 2017
Rodinia: A benchmark suite for heterogeneous computing No authors listed 2009 IEEE International Symposium on Workload Characterization (IISWC) https://doi.org/10.1109/IISWC.2009.5306797		October 2009
Early Experience with Transformer-Based Similarity Analysis for DataRaceBench No authors listed 2022 IEEE/ACM Sixth International Workshop on Software Correctness for HPC Applications (Correctness) https://doi.org/10.1109/Correctness56720.2022.00011		November 2022
Learning to Parallelize in a Shared-Memory Environment with Transformers No authors listed Proceedings of the 28th ACM SIGPLAN Annual Symposium on Principles and Practice of Parallel Programming https://doi.org/10.1145/3572848.3582565		February 2023
HPCFAIR: Enabling FAIR AI for HPC Applications No authors listed 2021 IEEE/ACM Workshop on Machine Learning in High Performance Computing Environments (MLHPC) https://doi.org/10.1109/MLHPC54614.2021.00011		November 2021
ExeBench: an ML-scale dataset of executable C functions No authors listed Proceedings of the 6th ACM SIGPLAN International Symposium on Machine Programming https://doi.org/10.1145/3520312.3534867		June 2022

Similar Records

HPC-GPT: Integrating Large Language Model for High-Performance Computing

Conference · 2023 · OSTI ID:2328224

Ding, X; Cheng, L; Emani, A; +6 more

Towards an Abstraction-Friendly Programming Model for High Productivity and High Performance Computing

Conference · 2009 · OSTI ID:967752

Liao, C.; Quinlan, D.; Panas, T.

Towards Seamless Management of AI Models in High-Performance Computing

Conference · 2023 · OSTI ID:1984750

Yu, S; Emani, M; Liao, C; +4 more

Related Subjects

Computer science

LM4HPC: Towards Effective Language Model Application in High-Performance Computing

Citation Formats

References (12)

Similar Records

Related Subjects