Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

A multi-modal scanning system to digitize CBRNE emergency response scenes

Conference ·

A handheld system developed to digitize a contextual understanding of the scene at a chemical, biological, radiological, nuclear and/or explosives (CBRNE) events is described. The system uses LiDAR and cameras to create a colorized 3D model of the environment, which helps domain experts that are supporting responders in the field. To generate the digitized model, a responder scans any suspicious objects and the surroundings by carrying the system through the scene. The scanning system provides a real-time user interface to inform the user about scanning progress and to indicate any areas that may have been missed either by the LiDAR sensors or the cameras. Currently, the collected data are post-processed on a different device, building a colorized triangular mesh of the encountered scene, with the intention of moving this pipeline to the scanner at a later point. The mesh is sufficiently compressed to be sent over a reduced bandwidth connection to a remote analyst. Furthermore, the system tracks fiducial markers attached to diagnostic equipment that is placed around the suspicious object. The resulting tracking information can be transmitted to remote analysts to further facilitate their supporting efforts. The paper will discuss the system's design, software components, the user interface used for scanning a scene, the necessary procedures for calibration of the sensors, and the processing steps of the resulting data. The discussion will close by evaluating the system's performance on 11 scenes.

Research Organization:
Lawrence Berkeley National Laboratory (LBNL), Berkeley, CA (United States)
Sponsoring Organization:
USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR) (SC-ASCR)
DOE Contract Number:
AC02-05CH11231
OSTI ID:
2370359
Country of Publication:
United States
Language:
English

References (15)

State-of-the-Art Mobile Radiation Detection Systems for Different Scenarios journal February 2021
Design, Calibration, and Evaluation of a Backpack Indoor Mobile Mapping System journal April 2019
Indoor 3D reconstruction from point clouds for optimal routing in complex buildings to support disaster management journal May 2020
Free-moving Quantitative Gamma-ray Imaging journal October 2021
Comparison of the Selected State-Of-The-Art 3D Indoor Scanning and Point Cloud Generation Methods journal August 2017
Geant4—a simulation toolkit
  • Agostinelli, S.; Allison, J.; Amako, K.
  • Nuclear Instruments and Methods in Physics Research Section A: Accelerators, Spectrometers, Detectors and Associated Equipment, Vol. 506, Issue 3 https://doi.org/10.1016/S0168-9002(03)01368-8
journal July 2003
Real-time loop closure in 2D LIDAR SLAM conference May 2016
Blur image detection using Laplacian operator and Open-CV conference January 2016
Unmanned multi-robot CBRNE reconnaissance with mobile manipulation System description and technical validation conference May 2012
Robot assisted analysis of suspicious objects in public spaces using CBRN sensors in combination with high-resolution LIDAR conference September 2019
RESCUER: Development of a Modular Chemical, Biological, Radiological, and Nuclear Robot for Intervention, Sampling, and Situation Awareness* journal June 2015
Increasing situation awareness of the CBRNE robot operators conference April 2010
CBRNE hazard detection with an Unmanned vehicle conference November 2009
Robotic Tasks for Chemical, Biological, Radiological, Nuclear and Explosive Incident Response journal January 2009
Automatic generation and detection of highly reliable fiducial markers under occlusion journal June 2014

Related Subjects