Unified many-worlds browsing of arbitrary physics-based animations

Goel, Purvi; James, Doug L.

doi:10.1145/3528223.3530082

Unified many-worlds browsing of arbitrary physics-based animations

Journal Article · Fri Jul 01 04:00:00 EDT 2022 · ACM Transaction on Graphics

DOI:https://doi.org/10.1145/3528223.3530082· OSTI ID:1980838

^[1]; ^[2]

Stanford University; OSTI
Stanford University

Manually tuning physics-based animation parameters to explore a simulation outcome space or achieve desired motion outcomes can be notoriously tedious. This problem has motivated many sophisticated and specialized optimization-based methods for fine-grained (keyframe) control, each of which are typically limited to specific animation phenomena, usually complicated, and, unfortunately, not widely used.

In this paper, we proposeUnified Many-Worlds Browsing(UMWB), a practical method for sample-level control and exploration of physics-based animations. Our approach supports browsing of large simulation ensembles of arbitrary animation phenomena by using a unified volumetric WORLDPACK representation based on spatiotemporally compressed voxel data associated with geometric occupancy and other low-fidelity animation state. Beyond memory reduction, the WORLDPACK representation also enables unified query support for interactive browsing: it provides fast evaluation of approximate spatiotemporal queries, such as occupancy tests that find ensemble samples ("worlds") where material is either IN or NOT IN a user-specified spacetime region. WORLDPACKS also support real-time hardware-accelerated voxel rendering by exploiting the spatially hierarchical and temporal RLE raster data structure. Our UMWB implementation supports interactive browsing (and offline refinement) of ensembles containing thousands of simulation samples, and fast spatiotemporal queries and ranking. We show UMWB results using a wide variety of physics-based animation phenomena---not just JELL-O^®.

Research Organization:: Stanford Univ., CA (United States)

Sponsoring Organization:: USDOE National Nuclear Security Administration (NNSA)

DOE Contract Number:: NA0003968

OSTI ID:: 1980838

Journal Information:: ACM Transaction on Graphics, Journal Name: ACM Transaction on Graphics Journal Issue: 4 Vol. 41; ISSN 0730-0301

Publisher:: Association for Computing Machinery (ACM)

Country of Publication:: United States

Language:: English

References (46)

Keyframe control of smoke simulations Treuille, Adrien; McNamara, Antoine; Popović, Zoran ACM Transactions on Graphics, Vol. 22, Issue 3 https://doi.org/10.1145/882262.882337	journal	July 2003
Inverse-Foley animation Langlois, Timothy R.; James, Doug L. ACM Transactions on Graphics, Vol. 33, Issue 4 https://doi.org/10.1145/2601097.2601178	journal	July 2014
Design galleries Marks, J.; Ruml, W.; Ryall, K. Proceedings of the 24th annual conference on Computer graphics and interactive techniques - SIGGRAPH '97 https://doi.org/10.1145/258734.258887	conference	January 1997
Sampling plausible solutions to multi-body constraint problems Chenney, Stephen; Forsyth, D. A. Proceedings of the 27th annual conference on Computer graphics and interactive techniques - SIGGRAPH '00 https://doi.org/10.1145/344779.344882	conference	January 2000
Lagrangian neural style transfer for fluids Kim, Byungsoo; Azevedo, Vinicius C.; Gross, Markus ACM Transactions on Graphics, Vol. 39, Issue 4 https://doi.org/10.1145/3386569.3392473	journal	August 2020
Schrödinger's smoke Chern, Albert; Knöppel, Felix; Pinkall, Ulrich ACM Transactions on Graphics, Vol. 35, Issue 4 https://doi.org/10.1145/2897824.2925868	journal	July 2016
Spacetime constraints Witkin, Andrew; Kass, Michael Proceedings of the 15th annual conference on Computer graphics and interactive techniques - SIGGRAPH '88 https://doi.org/10.1145/54852.378507	conference	January 1988
Compressed Vector Set: A Fast and Space-Efficient Data Mining Framework Oyamada, Masafumi; Liu, Jianquan; Ito, Shinji Journal of Information Processing, Vol. 26, Issue 0 https://doi.org/10.2197/ipsjjip.26.416	journal	January 2018
Efficient sparse voxel octrees Laine, Samuli; Karras, Tero Proceedings of the 2010 ACM SIGGRAPH symposium on Interactive 3D Graphics and Games https://doi.org/10.1145/1730804.1730814	conference	February 2010
Fluid control using the adjoint method McNamara, Antoine; Treuille, Adrien; Popović, Zoran ACM Transactions on Graphics, Vol. 23, Issue 3 https://doi.org/10.1145/1015706.1015744	journal	August 2004
Ray tracing Jell-O ^® Brand Gelatin Heckbert, Paul S. ACM SIGGRAPH Computer Graphics, Vol. 21, Issue 4 https://doi.org/10.1145/37402.37411	journal	August 1987
Evaluating the visual fidelity of physically based animations O'Sullivan, Carol; Dingliana, John; Giang, Thanh ACM Transactions on Graphics, Vol. 22, Issue 3 https://doi.org/10.1145/882262.882303	journal	July 2003
Volumetric appearance stylization with stylizing kernel prediction network Guo, Jie; Li, Mengtian; Zong, Zijing ACM Transactions on Graphics, Vol. 40, Issue 4 https://doi.org/10.1145/3450626.3459799	journal	July 2021
N-body spacetime constraints Tang, Diane; Ngo, J. Thomas; Marks, Joe The Journal of Visualization and Computer Animation, Vol. 6, Issue 3 https://doi.org/10.1002/vis.4340060304	journal	July 1995
QuanTaichi: a compiler for quantized simulations Hu, Yuanming; Liu, Jiafeng; Yang, Xuanda ACM Transactions on Graphics, Vol. 40, Issue 4 https://doi.org/10.1145/3450626.3459671	journal	August 2021
Power diagrams and sparse paged grids for high resolution adaptive liquids Aanjaneya, Mridul; Gao, Ming; Liu, Haixiang ACM Transactions on Graphics, Vol. 36, Issue 4 https://doi.org/10.1145/3072959.3073625	journal	July 2017
Simple and efficient compression of animation sequences Sattler, Mirko; Sarlette, Ralf; Klein, Reinhard Proceedings of the 2005 ACM SIGGRAPH/Eurographics symposium on Computer animation https://doi.org/10.1145/1073368.1073398	conference	July 2005
NanoVDB: A GPU-Friendly and Portable VDB Data Structure For Real-Time Rendering And Simulation Museth, Ken SIGGRAPH '21: Special Interest Group on Computer Graphics and Interactive Techniques Conference, ACM SIGGRAPH 2021 Talks https://doi.org/10.1145/3450623.3464653	conference	August 2021
Compression of time-dependent geometry Lengyel, Jerome Edward Proceedings of the 1999 symposium on Interactive 3D graphics https://doi.org/10.1145/300523.300533	conference	April 1999
Interactive localized liquid motion editing Pan, Zherong; Huang, Jin; Tong, Yiying ACM Transactions on Graphics, Vol. 32, Issue 6 https://doi.org/10.1145/2508363.2508429	journal	November 2013
Interactive liquid splash modeling by user sketches Yan, Guowei; Chen, Zhili; Yang, Jimei ACM Transactions on Graphics, Vol. 39, Issue 6 https://doi.org/10.1145/3414685.3417832	journal	November 2020
Tracks Bergou, Miklós; Mathur, Saurabh; Wardetzky, Max ACM Transactions on Graphics, Vol. 26, Issue 3 https://doi.org/10.1145/1276377.1276439	journal	July 2007
VDB: High-resolution sparse volumes with dynamic topology Museth, Ken ACM Transactions on Graphics, Vol. 32, Issue 3 https://doi.org/10.1145/2487228.2487235	journal	June 2013
Result-Driven Exploration of Simulation Parameter Spaces for Visual Effects Design Bruckner, Stefan; Möller, Torsten IEEE Transactions on Visualization and Computer Graphics, Vol. 16, Issue 6 https://doi.org/10.1109/TVCG.2010.190	journal	November 2010
Hierarchical RLE level set Houston, Ben; Nielsen, Michael B.; Batty, Christopher ACM Transactions on Graphics, Vol. 25, Issue 1 https://doi.org/10.1145/1122501.1122508	journal	January 2006
Implementation and Application of Intersection Operation Based on Run-Length Encoding Ding-tao, Shen; Can, Cui; Jie-chen, Wang 2008 International Conference on Computer Science and Software Engineering https://doi.org/10.1109/CSSE.2008.1197	conference	January 2008
Stream-guided smoke simulations Sato, Syuhei; Dobashi, Yoshinori; Kim, Theodore ACM Transactions on Graphics, Vol. 40, Issue 4 https://doi.org/10.1145/3450626.3459846	journal	July 2021
Many-worlds browsing for control of multibody dynamics Twigg, Christopher D.; James, Doug L. ACM Transactions on Graphics, Vol. 26, Issue 3 https://doi.org/10.1145/1276377.1276395	journal	July 2007
DB+Grid Museth, Ken ACM SIGGRAPH 2011 Talks https://doi.org/10.1145/2037826.2037894	conference	August 2011
SPGrid: a sparse paged grid structure applied to adaptive smoke simulation Setaluri, Rajsekhar; Aanjaneya, Mridul; Bauer, Sean ACM Transactions on Graphics, Vol. 33, Issue 6 https://doi.org/10.1145/2661229.2661269	journal	November 2014
Particle‐based Liquid Control using Animation Templates Schoentgen, Arnaud; Poulin, Pierre; Darles, Emmanuelle Computer Graphics Forum, Vol. 39, Issue 8 https://doi.org/10.1111/cgf.14103	journal	November 2020
Transport-based neural style transfer for smoke simulations Kim, Byungsoo; Azevedo, Vinicius C.; Gross, Markus ACM Transactions on Graphics, Vol. 38, Issue 6 https://doi.org/10.1145/3355089.3356560	journal	November 2019
Design Adjectives Shimizu, Evan; Fisher, Matthew; Paris, Sylvain Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology https://doi.org/10.1145/3379337.3415866	conference	October 2020
Fool me twice Yeh, Thomas Y.; Reinman, Glenn; Patel, Sanjay J. ACM Transactions on Graphics, Vol. 29, Issue 1 https://doi.org/10.1145/1640443.1640448	journal	December 2009
Real-time control of physically based simulations using gentle forces Barbič, Jernej; Popović, Jovan ACM Transactions on Graphics, Vol. 27, Issue 5 https://doi.org/10.1145/1409060.1409116	journal	December 2008
Fluid directed rigid body control using deep reinforcement learning Ma, Pingchuan; Tian, Yunsheng; Pan, Zherong ACM Transactions on Graphics, Vol. 37, Issue 4 https://doi.org/10.1145/3197517.3201334	journal	August 2018
Exploratory modeling with collaborative design spaces Talton, Jerry O.; Gibson, Daniel; Yang, Lingfeng ACM Transactions on Graphics, Vol. 28, Issue 5 https://doi.org/10.1145/1618452.1618513	journal	December 2009
Motion sketching for control of rigid-body simulations Popović, Jovan; Seitz, Steven M.; Erdmann, Michael ACM Transactions on Graphics, Vol. 22, Issue 4 https://doi.org/10.1145/944020.944025	journal	October 2003
Controllable smoke animation with guiding objects Shi, Lin; Yu, Yizhou ACM Transactions on Graphics, Vol. 24, Issue 1 https://doi.org/10.1145/1037957.1037965	journal	January 2005
Dynamic Tubular Grid: An Efficient Data Structure and Algorithms for High Resolution Level Sets Nielsen, Michael B.; Museth, Ken Journal of Scientific Computing, Vol. 26, Issue 3 https://doi.org/10.1007/s10915-005-9062-8	journal	January 2006
A volumetric method for building complex models from range images Curless, Brian; Levoy, Marc Proceedings of the 23rd annual conference on Computer graphics and interactive techniques - SIGGRAPH '96 https://doi.org/10.1145/237170.237269	conference	January 1996
Interactive spacetime control for animation Cohen, Michael F. Proceedings of the 19th annual conference on Computer graphics and interactive techniques https://doi.org/10.1145/133994.134083	conference	July 1992
Interactive manipulation of rigid body simulations Popović, Jovan; Seitz, Steven M.; Erdmann, Michael Proceedings of the 27th annual conference on Computer graphics and interactive techniques - SIGGRAPH '00 https://doi.org/10.1145/344779.344880	conference	January 2000
A collocated spatially adaptive approach to smoke simulation in bifrost Nielsen, Michael B.; Stamatelos, Konstantinos; Bojsen-Hansen, Morten SIGGRAPH '18: Special Interest Group on Computer Graphics and Interactive Techniques Conference, ACM SIGGRAPH 2018 Talks https://doi.org/10.1145/3214745.3214749	conference	August 2018
Principles of traditional animation applied to 3D computer animation Lasseter, John Proceedings of the 14th annual conference on Computer graphics and interactive techniques https://doi.org/10.1145/37401.37407	conference	August 1987
Sequential gallery for interactive visual design optimization Koyama, Yuki; Sato, Issei; Goto, Masataka ACM Transactions on Graphics, Vol. 39, Issue 4 https://doi.org/10.1145/3386569.3392444	journal	August 2020

Similar Records

Browsing in an information repository

Conference · Mon Dec 30 23:00:00 EST 1996 · OSTI ID:501654

MultiFacet: A Faceted Interface for Browsing Large Multimedia Collections

Conference · Thu Oct 31 00:00:00 EDT 2013 · OSTI ID:1178901

Distance browsing in spatial databases

Journal Article · Tue Jun 01 00:00:00 EDT 1999 · ACM Transactions on Database Systems · OSTI ID:20005653

Related Subjects

Computer Science

Unified many-worlds browsing of arbitrary physics-based animations

Citation Formats

References (46)

Similar Records

Related Subjects