Enabling additive manufacturing part inspection of digital twins via collaborative virtual reality

Chheang, Vuthea; Narain, Saurabh; Hooten, Garrett; Cerda, Robert; Au, Brian; Weston, Brian; Giera, Brian; Bremer, Peer-Timo; Miao, Haichao

doi:10.1038/s41598-024-80541-9

Enabling additive manufacturing part inspection of digital twins via collaborative virtual reality

Journal Article · Sat Nov 30 00:00:00 EST 2024 · Scientific Reports

DOI:https://doi.org/10.1038/s41598-024-80541-9· OSTI ID:2479665

^[1]; Narain, Saurabh ^[1]; Hooten, Garrett ^[1]; Cerda, Robert ^[1]; Au, Brian ^[1]; Weston, Brian ^[1]; Giera, Brian ^[1]; Bremer, Peer-Timo ^[1]; Miao, Haichao ^[1]

Lawrence Livermore National Laboratory (LLNL), Livermore, CA (United States)

Digital twins (DTs) are an emerging capability in additive manufacturing (AM), set to revolutionize design optimization, inspection, in situ monitoring, and root cause analysis. AM DTs typically incorporate multimodal data streams, ranging from machine toolpaths and in-process imaging to X-ray CT scans and performance metrics. Despite the evolution of DT platforms, challenges remain in effectively inspecting them for actionable insights, either individually or in a multidisciplinary, geographically distributed team setting. Quality assurance, manufacturing departments, pilot labs, and plant operations must collaborate closely to reliably produce parts at scale. This is particularly crucial in AM where complex structures require a collaborative and multidisciplinary approach. Additionally, the large-scale data originating from different modalities and their inherent 3D nature pose significant hurdles for traditional 2D desktop-based inspection methods. To address these challenges and increase the value proposition of DTs, we introduce a novel virtual reality (VR) framework to facilitate collaborative and real-time inspection of DTs in AM. This framework includes advanced features for intuitive alignment and visualization of multimodal data, visual occlusion management, streaming large-scale volumetric data, and collaborative tools, substantially improving the inspection of AM components and processes to fully exploit the potential of DTs in AM.

View Journal Article

Research Organization:: Lawrence Livermore National Laboratory (LLNL), Livermore, CA (United States)

Sponsoring Organization:: USDOE; USDOE Laboratory Directed Research and Development (LDRD) Program; USDOE National Nuclear Security Administration (NNSA)

Grant/Contract Number:: AC52-07NA27344

OSTI ID:: 2479665

Alternate ID(s):: OSTI ID: 2484229

Report Number(s):: LLNL--JRNL-861091; 1092955

Journal Information:: Scientific Reports, Journal Name: Scientific Reports Journal Issue: 1 Vol. 14; ISSN 2045-2322

Publisher:: Nature Publishing GroupCopyright Statement

Country of Publication:: United States

Language:: English

References (31)

A digital twin ecosystem for additive manufacturing using a real-time development platform Pantelidakis, Minas; Mykoniatis, Konstantinos; Liu, Jia The International Journal of Advanced Manufacturing Technology, Vol. 120, Issue 9-10 https://doi.org/10.1007/s00170-022-09164-6	journal	April 2022
Ontology of 3D virtual modeling in digital twin: a review, analysis and thinking Wang, Yuchen; Wang, Xinheng; Liu, Ang Journal of Intelligent Manufacturing https://doi.org/10.1007/s10845-023-02246-6	journal	November 2023
Occlusion handling using moving volume and ray casting techniques for augmented reality systems Tian, Yuan; Wang, Xuefan; Yao, Huang Multimedia Tools and Applications, Vol. 77, Issue 13 https://doi.org/10.1007/s11042-017-5228-2	journal	September 2017
Defects in Metal Additive Manufacturing Processes Brennan, M. C.; Keist, J. S.; Palmer, T. A. Journal of Materials Engineering and Performance, Vol. 30, Issue 7 https://doi.org/10.1007/s11665-021-05919-6	journal	July 2021
Contextual Ambient Occlusion: A volumetric rendering technique that supports real-time clipping Titov, Andrey; Kersten-Oertel, Marta; Drouin, Simon Computers & Graphics, Vol. 119 https://doi.org/10.1016/j.cag.2024.01.011	journal	April 2024
A digital twin hierarchy for metal additive manufacturing Phua, A.; Davies, C. H. J.; Delaney, G. W. Computers in Industry, Vol. 140 https://doi.org/10.1016/j.compind.2022.103667	journal	September 2022
Digital Twin: Benefits, use cases, challenges, and opportunities Attaran, Mohsen; Celik, Bilge Gokhan Decision Analytics Journal, Vol. 6 https://doi.org/10.1016/j.dajour.2023.100165	journal	March 2023
Data-driven smart manufacturing Tao, Fei; Qi, Qinglin; Liu, Ang Journal of Manufacturing Systems, Vol. 48 https://doi.org/10.1016/j.jmsy.2018.01.006	journal	July 2018
Digital Twin-enabled Collaborative Data Management for Metal Additive Manufacturing Systems Liu, Chao; Le Roux, Léopold; Körner, Carolin Journal of Manufacturing Systems https://doi.org/10.1016/j.jmsy.2020.05.010	journal	May 2020
Review of digital twin about concepts, technologies, and industrial applications Liu, Mengnan; Fang, Shuiliang; Dong, Huiyue Journal of Manufacturing Systems, Vol. 58 https://doi.org/10.1016/j.jmsy.2020.06.017	journal	January 2021
SLM lattice structures: Properties, performance, applications and challenges Maconachie, Tobias; Leary, Martin; Lozanovski, Bill Materials & Design, Vol. 183 https://doi.org/10.1016/j.matdes.2019.108137	journal	December 2019
A scalable digital platform for the use of digital twins in additive manufacturing Scime, Luke; Singh, Alka; Paquit, Vincent Manufacturing Letters, Vol. 31 https://doi.org/10.1016/j.mfglet.2021.05.007	journal	January 2022
Collaborative manufacturing design: a mixed reality and cloud-based framework for part design Mourtzis, Dimitris; Angelopoulos, John; Panopoulos, Nikos Procedia CIRP, Vol. 100 https://doi.org/10.1016/j.procir.2021.05.016	journal	January 2021
Multisensor Fusion-Based Digital twin in Additive Manufacturing for In-Situ Quality Monitoring and Defect Correction Chen, Lequn; Yao, Xiling; Liu, Kui Proceedings of the Design Society, Vol. 3 https://doi.org/10.1017/pds.2023.276	journal	June 2023
Digital twin and parameter correlation-enabled variant design of production lines Yan, Douxi; Yang, Jiafeng; Zhu, Xiaofeng International Journal of Computer Integrated Manufacturing https://doi.org/10.1080/0951192X.2023.2294447	journal	December 2023
The case for digital twins in metal additive manufacturing Gunasegaram, D. R.; Murphy, A. B.; Matthews, M. J. Journal of Physics: Materials, Vol. 4, Issue 4 https://doi.org/10.1088/2515-7639/ac09fb	journal	June 2021
AMP-IT and WISDOM: Improving 3D Manipulation for High-Precision Tasks in Virtual Reality Rodrigues, Francielly; Giovannelli, Alexander; Pavanatto, Leonardo 2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR) https://doi.org/10.1109/ISMAR59233.2023.00045	conference	October 2023
Virtual Inspection of Additively Manufactured Parts Klacansky, Pavol; Miao, Haichao; Gyulassy, Attila 2022 IEEE 15th Pacific Visualization Symposium (PacificVis) https://doi.org/10.1109/PacificVis53943.2022.00017	conference	April 2022
Digital Twin in Industry: State-of-the-Art Tao, Fei; Zhang, He; Liu, Ang IEEE Transactions on Industrial Informatics, Vol. 15, Issue 4 https://doi.org/10.1109/TII.2018.2873186	journal	April 2019
Using Virtual Replicas to Improve Mixed Reality Remote Collaboration Tian, Huayuan; Lee, Gun A.; Bai, Huidong IEEE Transactions on Visualization and Computer Graphics, Vol. 29, Issue 5 https://doi.org/10.1109/TVCG.2023.3247113	journal	May 2023
Immersive Virtual Reality for Virtual and Digital Twins: A Literature Review to Identify State Of The Art and Perspectives Pirker, Johanna; Loria, Enrica; Safikhani, Saeed 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW) https://doi.org/10.1109/VRW55335.2022.00035	conference	March 2022
Evaluating the Use of Virtual Reality to Teach Introductory Concepts of Additive Manufacturing Ostrander, John K.; Tucker, Conrad S.; Simpson, Timothy W. Journal of Mechanical Design, Vol. 142, Issue 5 https://doi.org/10.1115/1.4044006	journal	November 2019
Volumetric additive manufacturing via tomographic reconstruction Kelly, Brett E.; Bhattacharya, Indrasen; Heidari, Hossein Science, Vol. 363, Issue 6431 https://doi.org/10.1126/science.aau7114	journal	January 2019
Free-form deformation of solid geometric models Sederberg, Thomas W.; Parry, Scott R. ACM SIGGRAPH Computer Graphics, Vol. 20, Issue 4 https://doi.org/10.1145/15886.15903	journal	August 1986
Loki Thoravi Kumaravel, Balasaravanan; Anderson, Fraser; Fitzmaurice, George Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology https://doi.org/10.1145/3332165.3347872	conference	October 2019
3D Printing and Design in Isolation: A Case from a Simulated Lunar Mission Stawski, Wiktor; Skorupska, Kinga H.; Kopec, Wieslaw Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems https://doi.org/10.1145/3544549.3585741	conference	April 2023
Industrial Metaverse Oppermann, Leif; Buchholz, Florian; Uzun, Yücel Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems https://doi.org/10.1145/3544549.3585835	conference	April 2023
A Virtual Environment for Collaborative Inspection in Additive Manufacturing Chheang, Vuthea; Weston, Brian Thomas; Cerda, Robert William Extended Abstracts of the CHI Conference on Human Factors in Computing Systems https://doi.org/10.1145/3613905.3650730	conference	May 2024
Orchestration of materials science workflows for heterogeneous resources at large scale Zhou, Naweiluo; Scorzelli, Giorgio; Luettgau, Jakob The International Journal of High Performance Computing Applications, Vol. 37, Issue 3-4 https://doi.org/10.1177/10943420231167800	journal	April 2023
Bibliometric Performance and Future Relevance of Virtual Manufacturing Technology in the Fourth Industrial Revolution Kobara, Yawo Mamoua; Akpan, Ikpe Justice Systems, Vol. 11, Issue 10 https://doi.org/10.3390/systems11100524	journal	October 2023
The Role of Virtual Reality Simulation in Manufacturing in Industry 4.0 Akpan, Ikpe Justice; Offodile, Onyebuchi Felix Systems, Vol. 12, Issue 1 https://doi.org/10.3390/systems12010026	journal	January 2024

Similar Records

Chapter 21: The Utility of Virtual Reality for Science and Engineering

Book · Fri Jun 07 00:00:00 EDT 2019 · OSTI ID:1544522

A Virtual Reality Visualization Tool for Neuron Tracing

Journal Article · Sun Dec 31 19:00:00 EST 2017 · IEEE Transactions on Visualization and Computer Graphics · OSTI ID:1756051

Related Subjects

42 ENGINEERING
97 MATHEMATICS AND COMPUTING
Additive manufacturing
Collaborative VR
Computer science
Digital twins
Mechanical engineering
Software
Virtual inspection
Virtual reality

Enabling additive manufacturing part inspection of digital twins via collaborative virtual reality

Citation Formats

References (31)

Similar Records

Related Subjects