A multi-modal pre-training transformer for universal transfer learning in metal–organic frameworks

Kang, Yeonghun; Park, Hyunsoo; Smit, Berend; Kim, Jihan

doi:10.1038/s42256-023-00628-2

A multi-modal pre-training transformer for universal transfer learning in metal–organic frameworks

Journal Article · 28 February 2023 · Nature Machine Intelligence

DOI:https://doi.org/10.1038/s42256-023-00628-2· OSTI ID:2424363

; ; ;

Not provided.

Research Organization:: Ecole Polytechnique Federale Lausanne (EPFL) (Switzerland)

Sponsoring Organization:: USDOE

OSTI ID:: 2424363

Journal Information:: Nature Machine Intelligence, Journal Name: Nature Machine Intelligence Journal Issue: 3 Vol. 5; ISSN 2522-5839

Publisher:: Springer Nature

Country of Publication:: United States

Language:: English

References (50)

Algorithms and tools for high-throughput geometry-based analysis of crystalline porous materials Willems, Thomas F.; Rycroft, Chris H.; Kazi, Michaeel Microporous and Mesoporous Materials, Vol. 149, Issue 1 https://doi.org/10.1016/j.micromeso.2011.08.020	journal	February 2012
An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale Dosovitskiy, Alexey; Beyer, Lucas; Kolesnikov, Alexander arXiv https://doi.org/10.48550/arXiv.2010.11929	preprint	January 2020
Applications of machine learning in metal-organic frameworks Chong, Sanggyu; Lee, Sangwon; Kim, Baekjun Coordination Chemistry Reviews, Vol. 423 https://doi.org/10.1016/j.ccr.2020.213487	journal	November 2020
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Devlin, Jacob; Chang, Ming-Wei; Lee, Kenton arXiv https://doi.org/10.48550/arXiv.1810.04805	preprint	January 2018
Machine learning the quantum-chemical properties of metal–organic frameworks for accelerated materials discovery Rosen, Andrew S.; Iyer, Shaelyn M.; Ray, Debmalya Matter, Vol. 4, Issue 5 https://doi.org/10.1016/j.matt.2021.02.015	journal	May 2021
Transfer Learning Study of Gas Adsorption in Metal–Organic Frameworks Ma, Ruimin; Colón, Yamil J.; Luo, Tengfei ACS Applied Materials & Interfaces, Vol. 12, Issue 30 https://doi.org/10.1021/acsami.0c06858	journal	July 2020
Topologically Guided, Automated Construction of Metal–Organic Frameworks and Their Evaluation for Energy-Related Applications Colón, Yamil J.; Gómez-Gualdrón, Diego A.; Snurr, Randall Q. Crystal Growth & Design, Vol. 17, Issue 11 https://doi.org/10.1021/acs.cgd.7b00848	journal	September 2017
VisualBERT: A Simple and Performant Baseline for Vision and Language Li, Liunian Harold; Yatskar, Mark; Yin, Da arXiv https://doi.org/10.48550/arXiv.1908.03557	preprint	January 2019
Transferable Potentials for Phase Equilibria. 1. United-Atom Description of n-Alkanes Martin, Marcus G.; Siepmann, J. Ilja https://doi.org/10.1021/jp972543+		March 1998
Data-driven design of metal–organic frameworks for wet flue gas CO2 capture Boyd, Peter G.; Chidambaram, Arunraj; García-Díez, Enrique Nature, Vol. 576, Issue 7786 https://doi.org/10.1038/s41586-019-1798-7	journal	December 2019
MOF-Based Membranes for Gas Separations Qian, Qihui; Asinger, Patrick A.; Lee, Moon Joo Chemical Reviews, Vol. 120, Issue 16 https://doi.org/10.1021/acs.chemrev.0c00119	journal	July 2020
Finely tuned inverse design of metal–organic frameworks with user-desired Xe/Kr selectivity Lim, Yunsung; Park, Junkil; Lee, Sangwon Journal of Materials Chemistry A, Vol. 9, Issue 37 https://doi.org/10.1039/D1TA03129E	journal	January 2021
Resolving Transition Metal Chemical Space: Feature Selection for Machine Learning and Structure–Property Relationships Janet, Jon Paul; Kulik, Heather J. The Journal of Physical Chemistry A, Vol. 121, Issue 46 https://doi.org/10.1021/acs.jpca.7b08750	journal	November 2017
Preferred Hydrogen Adsorption Sites in Various MOFs-A Comparative Computational Study Fischer, Michael; Hoffmann, Frank; Fröba, Michael ChemPhysChem, Vol. 10, Issue 15 https://doi.org/10.1002/cphc.200900459	journal	October 2009
Energy-based descriptors to rapidly predict hydrogen storage in metal–organic frameworks Bucior, Benjamin J.; Bobbitt, N. Scott; Islamoglu, Timur Molecular Systems Design & Engineering, Vol. 4, Issue 1 https://doi.org/10.1039/C8ME00050F	journal	January 2019
MOFSimplify, machine learning models with extracted stability data of three thousand metal–organic frameworks Nandy, Aditya; Terrones, Gianmarco; Arunachalam, Naveen Scientific Data, Vol. 9, Issue 1 https://doi.org/10.1038/s41597-022-01181-0	journal	March 2022
Advances, Updates, and Analytics for the Computation-Ready, Experimental Metal–Organic Framework Database: CoRE MOF 2019 Chung, Yongchul G.; Haldoupis, Emmanuel; Bucior, Benjamin J. Journal of Chemical & Engineering Data, Vol. 64, Issue 12 https://doi.org/10.1021/acs.jced.9b00835	journal	November 2019
Hydrogen storage mechanism and diffusion in metal–organic frameworks Koizumi, Kenichi; Nobusada, Katsuyuki; Boero, Mauro Physical Chemistry Chemical Physics, Vol. 21, Issue 15 https://doi.org/10.1039/C8CP07467D	journal	January 2019
Graph Networks as a Universal Machine Learning Framework for Molecules and Crystals Chen, Chi; Ye, Weike; Zuo, Yunxing Chemistry of Materials, Vol. 31, Issue 9 https://doi.org/10.1021/acs.chemmater.9b01294	journal	April 2019
Metal–Organic Frameworks as A Tunable Platform for Designing Functional Molecular Materials Wang, Cheng; Liu, Demin; Lin, Wenbin Journal of the American Chemical Society, Vol. 135, Issue 36 https://doi.org/10.1021/ja308229p	journal	August 2013
Green synthesis of metal–organic frameworks: A state-of-the-art review of potential environmental and medical applications Kumar, Sandeep; Jain, Shikha; Nehra, Monika Coordination Chemistry Reviews, Vol. 420 https://doi.org/10.1016/j.ccr.2020.213407	journal	October 2020
High-throughput computational screening of metal–organic frameworks Colón, Yamil J.; Snurr, Randall Q. Chem. Soc. Rev., Vol. 43, Issue 16 https://doi.org/10.1039/C4CS00070F	journal	January 2014
UniT: Multimodal Multitask Learning with a Unified Transformer Hu, Ronghang; Singh, Amanpreet 2021 IEEE/CVF International Conference on Computer Vision (ICCV) https://doi.org/10.1109/ICCV48922.2021.00147	conference	October 2021
Machine Learning Meets with Metal Organic Frameworks for Gas Storage and Separation Altintas, Cigdem; Altundal, Omer Faruk; Keskin, Seda Journal of Chemical Information and Modeling, Vol. 61, Issue 5 https://doi.org/10.1021/acs.jcim.1c00191	journal	April 2021
Inverse design of nanoporous crystalline reticular materials with deep generative models Yao, Zhenpeng; Sánchez-Lengeling, Benjamín; Bobbitt, N. Scott Nature Machine Intelligence, Vol. 3, Issue 1 https://doi.org/10.1038/s42256-020-00271-1	journal	January 2021
Computational Screening of Trillions of Metal–Organic Frameworks for High-Performance Methane Storage Lee, Sangwon; Kim, Baekjun; Cho, Hyun ACS Applied Materials & Interfaces, Vol. 13, Issue 20 https://doi.org/10.1021/acsami.1c02471	journal	May 2021
The materials genome in action: identifying the performance limits for methane storage Simon, Cory M.; Kim, Jihan; Gomez-Gualdron, Diego A. Energy & Environmental Science, Vol. 8, Issue 4 https://doi.org/10.1039/C4EE03515A	journal	January 2015
Application of transfer learning to predict diffusion properties in metal–organic frameworks Lim, Yunsung; Kim, Jihan Molecular Systems Design & Engineering, Vol. 7, Issue 9 https://doi.org/10.1039/D2ME00082B	journal	January 2022
The Current Status of MOF and COF Applications Freund, Ralph; Zaremba, Orysia; Arnauts, Giel Angewandte Chemie International Edition, Vol. 60, Issue 45 https://doi.org/10.1002/anie.202106259	journal	July 2021
Interpretable Graph Transformer Network for Predicting Adsorption Isotherms of Metal–Organic Frameworks Chen, Pin; Jiao, Rui; Liu, Jinyu Journal of Chemical Information and Modeling, Vol. 62, Issue 22 https://doi.org/10.1021/acs.jcim.2c00876	journal	November 2022
Predicting hydrogen storage in MOFs via machine learning Ahmed, Alauddin; Siegel, Donald J. Patterns, Vol. 2, Issue 7 https://doi.org/10.1016/j.patter.2021.100291	journal	July 2021
Decoupled Weight Decay Regularization Loshchilov, Ilya; Hutter, Frank arXiv https://doi.org/10.48550/arXiv.1711.05101	preprint	January 2017
MOFTransformer Kang, Yeonghun; Park, Hyunsoo figshare https://doi.org/10.6084/m9.figshare.21155506.v2	dataset	January 2022
Understanding the diversity of the metal-organic framework ecosystem Moosavi, Seyed Mohamad; Nandy, Aditya; Jablonka, Kevin Maik Nature Communications, Vol. 11, Issue 1 https://doi.org/10.1038/s41467-020-17755-8	journal	August 2020
The Reticular Chemistry Structure Resource (RCSR) Database of, and Symbols for, Crystal Nets O’Keeffe, Michael; Peskov, Maxim A.; Ramsden, Stuart J. Accounts of Chemical Research, Vol. 41, Issue 12, p. 1782-1789 https://doi.org/10.1021/ar800124u	journal	December 2008
Large-Pore Apertures in a Series of Metal-Organic Frameworks Deng, H.; Grunder, S.; Cordova, K. E. Science, Vol. 336, Issue 6084, p. 1018-1023 https://doi.org/10.1126/science.1220131	journal	May 2012
QMOF Database Rosen, Andrew figshare https://doi.org/10.6084/m9.figshare.13147324.v13	dataset	January 2021
Recent advances, opportunities, and challenges in high-throughput computational screening of MOFs for gas separations Daglar, Hilal; Keskin, Seda Coordination Chemistry Reviews, Vol. 422 https://doi.org/10.1016/j.ccr.2020.213470	journal	November 2020
Fast Parallel Algorithms for Short-Range Molecular Dynamics Plimpton, Steve Journal of Computational Physics, Vol. 117, Issue 1 https://doi.org/10.1006/jcph.1995.1039	journal	March 1995
Exploring the performance limits of MOF/polymer MMMs for O2/N2 separation using computational screening Daglar, Hilal; Erucar, Ilknur; Keskin, Seda Journal of Membrane Science, Vol. 618 https://doi.org/10.1016/j.memsci.2020.118555	journal	January 2021
Die Berechnung optischer und elektrostatischer Gitterpotentiale Ewald, P. P. Annalen der Physik, Vol. 369, Issue 3 https://doi.org/10.1002/andp.19213690304	journal	January 1921
UFF, a full periodic table force field for molecular mechanics and molecular dynamics simulations Rappe, A. K.; Casewit, C. J.; Colwell, K. S. Journal of the American Chemical Society, Vol. 114, Issue 25, p. 10024-10035 https://doi.org/10.1021/ja00051a040	journal	December 1992
Improving MOF stability: approaches and applications Ding, Meili; Cai, Xuechao; Jiang, Hai-Long Chemical Science, Vol. 10, Issue 44 https://doi.org/10.1039/C9SC03916C	journal	January 2019
1 million hypothetical MOFs Kang, Yeonghun; Park, Hyunsoo figshare https://doi.org/10.6084/m9.figshare.21810147.v2	dataset	January 2023
Using Machine Learning and Data Mining to Leverage Community Knowledge for the Engineering of Stable Metal–Organic Frameworks Nandy, Aditya; Duan, Chenru; Kulik, Heather J. Journal of the American Chemical Society, Vol. 143, Issue 42 https://doi.org/10.1021/jacs.1c07217	journal	October 2021
Crystal Graph Convolutional Neural Networks for an Accurate and Interpretable Prediction of Material Properties Xie, Tian; Grossman, Jeffrey C. Physical Review Letters, Vol. 120, Issue 14 https://doi.org/10.1103/PhysRevLett.120.145301	journal	April 2018
Metal–organic framework materials as catalysts Lee, JeongYong; Farha, Omar K.; Roberts, John Chemical Society Reviews, Vol. 38, Issue 5, p. 1450-1459 https://doi.org/10.1039/b807080f	journal	January 2009
RASPA: molecular simulation software for adsorption and diffusion in flexible nanoporous materials Dubbeldam, David; Calero, Sofía; Ellis, Donald E. Molecular Simulation, Vol. 42, Issue 2 https://doi.org/10.1080/08927022.2015.1010082	journal	February 2015
MOFormer: Self-Supervised Transformer model for Metal-Organic Framework Property Prediction Cao, Zhonglin; Magar, Rishikesh; Wang, Yuyang arXiv https://doi.org/10.48550/arXiv.2210.14188	preprint	January 2022
Prediction of O₂/N₂ Selectivity in Metal–Organic Frameworks via High-Throughput Computational Screening and Machine Learning Orhan, Ibrahim B.; Daglar, Hilal; Keskin, Seda ACS Applied Materials & Interfaces, Vol. 14, Issue 1 https://doi.org/10.1021/acsami.1c18521	journal	December 2021

Similar Records

Photocatalytic metal–organic frameworks for organic transformations

Journal Article · 2016 · CrystEngComm · OSTI ID:1535184

Photocatalytic metal–organic frameworks for organic transformations

Journal Article · 2017 · CrystEngComm · OSTI ID:1780608

Failure Analysis of a Complex Learning Framework Incorporating Multi-Modal and Semi-Supervised Learning

Conference · 2010 · OSTI ID:1032815

Related Subjects

Computer Science

A multi-modal pre-training transformer for universal transfer learning in metal–organic frameworks

Citation Formats

References (50)

Similar Records

Related Subjects