Reconstruction of dynamic scenes based on differences between collected view and synthesized view
Abstract
A system for generating a 4D representation of a scene in motion given a sinogram collected from the scene while in motion. The system generates, based on scene parameters, an initial 3D representation of the scene indicating linear attenuation coefficients (LACs) of voxels of the scene. The system generates, based on motion parameters, a 4D motion field indicating motion of the scene. The system generates, based on the initial 3D representation and the 4D motion field, a 4D representation of the scene that is a sequence of 3D representations having LACs. The system generates a synthesized sinogram of the scene from the generated 4D representation. The system adjusts the scene parameters and the motion parameters based on differences between the collected sinogram and the synthesized sinogram. The processing is repeated until the differences satisfy a termination criterion.
- Inventors:
- Issue Date:
- Research Org.:
- Lawrence Livermore National Laboratory (LLNL), Livermore, CA (United States); Arizona State Univ., Scottsdale, AZ (United States)
- Sponsoring Org.:
- USDOE
- OSTI Identifier:
- 2222247
- Patent Number(s):
- 11741643
- Application Number:
- 17/208,849
- Assignee:
- Lawrence Livermore National Security, LLC (Livermore, CA); Arizona Board of Regents on behalf of Arizona State University (Scottsdale, AZ)
- Patent Classifications (CPCs):
-
G - PHYSICS G06 - COMPUTING G06T - IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- DOE Contract Number:
- AC52-07NA27344
- Resource Type:
- Patent
- Resource Relation:
- Patent File Date: 03/22/2021
- Country of Publication:
- United States
- Language:
- English
Citation Formats
Kim, Hyojin, Anirudh, Rushil, Champley, Kyle, Mohan, Kadri Aditya, Reed, Albert William, and Jayasuriya, Suren. Reconstruction of dynamic scenes based on differences between collected view and synthesized view. United States: N. p., 2023.
Web.
Kim, Hyojin, Anirudh, Rushil, Champley, Kyle, Mohan, Kadri Aditya, Reed, Albert William, & Jayasuriya, Suren. Reconstruction of dynamic scenes based on differences between collected view and synthesized view. United States.
Kim, Hyojin, Anirudh, Rushil, Champley, Kyle, Mohan, Kadri Aditya, Reed, Albert William, and Jayasuriya, Suren. Tue .
"Reconstruction of dynamic scenes based on differences between collected view and synthesized view". United States. https://www.osti.gov/servlets/purl/2222247.
@article{osti_2222247,
title = {Reconstruction of dynamic scenes based on differences between collected view and synthesized view},
author = {Kim, Hyojin and Anirudh, Rushil and Champley, Kyle and Mohan, Kadri Aditya and Reed, Albert William and Jayasuriya, Suren},
abstractNote = {A system for generating a 4D representation of a scene in motion given a sinogram collected from the scene while in motion. The system generates, based on scene parameters, an initial 3D representation of the scene indicating linear attenuation coefficients (LACs) of voxels of the scene. The system generates, based on motion parameters, a 4D motion field indicating motion of the scene. The system generates, based on the initial 3D representation and the 4D motion field, a 4D representation of the scene that is a sequence of 3D representations having LACs. The system generates a synthesized sinogram of the scene from the generated 4D representation. The system adjusts the scene parameters and the motion parameters based on differences between the collected sinogram and the synthesized sinogram. The processing is repeated until the differences satisfy a termination criterion.},
doi = {},
journal = {},
number = ,
volume = ,
place = {United States},
year = {2023},
month = {8}
}
Works referenced in this record:
TIMBIR: A Method for Time-Space Reconstruction From Interlaced Views
journal, June 2015
- Aditya Mohan, K.; Venkatakrishnan, S. V.; Gibbs, John W.
- IEEE Transactions on Computational Imaging, Vol. 1, Issue 2
Sparse-view x-ray CT reconstruction via total generalized variation regularization
journal, May 2014
- Niu, Shanzhou; Gao, Yang; Bian, Zhaoying
- Physics in Medicine and Biology, Vol. 59, Issue 12
NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis
book, November 2020
- Mildenhall, Ben; Srinivasan, Pratul P.; Tancik, Matthew
- Computer Vision – ECCV 2020
A deep convolutional neural network using directional wavelets for low-dose X-ray CT reconstruction
journal, October 2017
- Kang, Eunhee; Min, Junhong; Ye, Jong Chul
- Medical Physics, Vol. 44, Issue 10
Deforming Autoencoders: Unsupervised Disentangling of Shape and Appearance
book, January 2018
- Shu, Zhixin; Sahasrabudhe, Mihir; Alp Güler, Rıza
- Computer Vision – ECCV 2018
A Model Based Iterative Reconstruction Algorithm For High Angle Annular Dark Field-Scanning Transmission Electron Microscope (HAADF-STEM) Tomography
journal, November 2013
- Venkatakrishnan, S. V.; Drummy, L. F.; Jackson, M. A.
- IEEE Transactions on Image Processing, Vol. 22, Issue 11
ECG‐correlated image reconstruction from subsecond multi‐slice spiral CT scans of the heart
journal, August 2000
- Kachelrieß, Marc; Ulzheimer, Stefan; Kalender, Willi A.
- Medical Physics, Vol. 27, Issue 8
4D-CT imaging of a volume influenced by respiratory motion on multi-slice CT
journal, January 2004
- Pan, Tinsu; Lee, Ting-Yim; Rietzel, Eike
- Medical Physics, Vol. 31, Issue 2
Acquiring 4D thoracic CT scans using a multislice helical method
journal, May 2004
- Keall, P. J.; Starkschall, G.; Shukla, H.
- Physics in Medicine and Biology, Vol. 49, Issue 10
Warp-and-project tomography for rapidly deforming objects
journal, July 2019
- Zang, Guangming; Idoughi, Ramzi; Tao, Ran
- ACM Transactions on Graphics, Vol. 38, Issue 4
Electronic image processing device for the detection of motions
patent, September 2001
- Declerck, Jerome; Ayache, Nicholas; Feldmar, Jacques
- US Patent Document 6,289,135
Industrial applications of computed tomography
journal, January 2014
- De Chiffre, L.; Carmignato, S.; Kruth, J. -P.
- CIRP Annals, Vol. 63, Issue 2
OpenDR: An Approximate Differentiable Renderer
book, January 2014
- Loper, Matthew M.; Black, Michael J.
- Computer Vision – ECCV 2014
Few-view image reconstruction with dual dictionaries
journal, December 2011
- Lu, Yang; Zhao, Jun; Wang, Ge
- Physics in Medicine and Biology, Vol. 57, Issue 1
A convected particle domain interpolation technique to extend applicability of the material point method for problems involving massive deformations
journal, March 2011
- Sadeghirad, A.; Brannon, R. M.; Burghardt, J.
- International Journal for Numerical Methods in Engineering, Vol. 86, Issue 12
Regularized Image Reconstruction Algorithms for Positron Emission Tomography
journal, September 2004
- Chang, J. -H.; Anderson, J. M. M.; Votaw, J. R.
- IEEE Transactions on Medical Imaging, Vol. 23, Issue 9
Characterization and reduction of artifacts in limited angle tomography
journal, November 2013
- Frikel, Jürgen; Quinto, Eric Todd
- Inverse Problems, Vol. 29, Issue 12
Space-time tomography for continuously deforming objects
journal, August 2018
- Zang, Guangming; Idoughi, Ramzi; Tao, Ran
- ACM Transactions on Graphics, Vol. 37, Issue 4
Soft Rasterizer: A Differentiable Renderer for Image-Based 3D Reasoning
conference, October 2019
- Liu, Shichen; Chen, Weikai; Li, Tianye
- 2019 IEEE/CVF International Conference on Computer Vision (ICCV)
Simultaneous Algebraic Reconstruction Technique (SART): A superior implementation of the ART algorithm
journal, January 1984
- Andersen, A.
- Ultrasonic Imaging, Vol. 6, Issue 1
Maximum Likelihood from Incomplete Data Via the EM Algorithm
journal, September 1977
- Dempster, A. P.; Laird, N. M.; Rubin, D. B.
- Journal of the Royal Statistical Society: Series B (Methodological), Vol. 39, Issue 1
A framework for evaluation of deformable image registration spatial accuracy using large landmark point sets
journal, March 2009
- Castillo, Richard; Castillo, Edward; Guerra, Rudy
- Physics in Medicine and Biology, Vol. 54, Issue 7
Restoration of missing data in limited angle tomography based on Helgason–Ludwig consistency conditions
journal, May 2017
- Huang, Yixing; Huang, Xiaolin; Taubmann, Oliver
- Biomedical Physics & Engineering Express, Vol. 3, Issue 3
Improved total variation-based CT image reconstruction applied to clinical data
journal, February 2011
- Ritschl, Ludwig; Bergner, Frank; Fleischmann, Christof
- Physics in Medicine and Biology, Vol. 56, Issue 6
The Three-Dimensional Morphology of Growing Dendrites
journal, July 2015
- Gibbs, J. W.; Mohan, K. A.; Gulsoy, E. B.
- Scientific Reports, Vol. 5, Issue 1
Deep Convolutional Neural Network for Inverse Problems in Imaging
journal, September 2017
- Jin, Kyong Hwan; McCann, Michael T.; Froustey, Emmanuel
- IEEE Transactions on Image Processing, Vol. 26, Issue 9
A First-Order Primal-Dual Algorithm for Convex Problems with Applications to Imaging
journal, December 2010
- Chambolle, Antonin; Pock, Thomas
- Journal of Mathematical Imaging and Vision, Vol. 40, Issue 1
Few-Views Image Reconstruction with SMART and an Allowance for Contrast Structure Shadows
book, January 2015
- Vlasov, Vitaly V.; Konovalov, Alexander B.; Uglov, Alexander S.
- Computer Analysis of Images and Patterns
Second-order convected particle domain interpolation (CPDI2) with enrichment for weak discontinuities at material interfaces: ENRICHED SECOND-ORDER CONVECTED PARTICLE DOMAIN INTERPOLATION (CPDI2)
journal, July 2013
- Sadeghirad, A.; Brannon, R. M.; Guilkey, J. E.
- International Journal for Numerical Methods in Engineering, Vol. 95, Issue 11
Algebraic reconstruction in CT from limited views
journal, March 1989
- Andersen, A. H.
- IEEE Transactions on Medical Imaging, Vol. 8, Issue 1
PET-CT image co-registration in the thorax: influence of respiration
journal, January 2002
- Goerres, Gerhard W.; Kamel, Ehab; Heidelberg, Thai-Nia H.
- European Journal of Nuclear Medicine and Molecular Imaging, Vol. 29, Issue 3
Accelerated image reconstruction using ordered subsets of projection data
journal, January 1994
- Hudson, H. M.; Larkin, R. S.
- IEEE Transactions on Medical Imaging, Vol. 13, Issue 4
Spatial Resolution Analysis for Few-Views Discrete Tomography Based on MART-AP Algorithm
journal, January 2013
- Konovalov, Alexander B.; Vlasov, Vitaly V.
- ISRN Signal Processing, Vol. 2013