Methods and systems relating to an augmented virtuality environment
Abstract
Systems and methods relating to an augmented virtuality system are disclosed. A method of operating an augmented virtuality system may comprise displaying imagery of a real-world environment in an operating picture. The method may further include displaying a plurality of virtual icons in the operating picture representing at least some assets of a plurality of assets positioned in the real-world environment. Additionally, the method may include displaying at least one virtual item in the operating picture representing data sensed by one or more of the assets of the plurality of assets and remotely controlling at least one asset of the plurality of assets by interacting with a virtual icon associated with the at least one asset.
- Inventors:
- Issue Date:
- Research Org.:
- Idaho National Laboratory (INL), Idaho Falls, ID (United States)
- Sponsoring Org.:
- USDOE
- OSTI Identifier:
- 1131869
- Patent Number(s):
- 8732592
- Application Number:
- 12/480,459
- Assignee:
- Battelle Energy Alliance, LLC (Idaho Falls, ID)
- Patent Classifications (CPCs):
-
G - PHYSICS G06 - COMPUTING G06F - ELECTRIC DIGITAL DATA PROCESSING
G - PHYSICS G06 - COMPUTING G06T - IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- DOE Contract Number:
- AC07-05ID14517
- Resource Type:
- Patent
- Resource Relation:
- Patent File Date: 2009 Jun 08
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 97 MATHEMATICS AND COMPUTING
Citation Formats
Nielsen, Curtis W, Anderson, Matthew O, McKay, Mark D, Wadsworth, Derek C, Boyce, Jodie R, Hruska, Ryan C, Koudelka, John A, Whetten, Jonathan, and Bruemmer, David J. Methods and systems relating to an augmented virtuality environment. United States: N. p., 2014.
Web.
Nielsen, Curtis W, Anderson, Matthew O, McKay, Mark D, Wadsworth, Derek C, Boyce, Jodie R, Hruska, Ryan C, Koudelka, John A, Whetten, Jonathan, & Bruemmer, David J. Methods and systems relating to an augmented virtuality environment. United States.
Nielsen, Curtis W, Anderson, Matthew O, McKay, Mark D, Wadsworth, Derek C, Boyce, Jodie R, Hruska, Ryan C, Koudelka, John A, Whetten, Jonathan, and Bruemmer, David J. Tue .
"Methods and systems relating to an augmented virtuality environment". United States. https://www.osti.gov/servlets/purl/1131869.
@article{osti_1131869,
title = {Methods and systems relating to an augmented virtuality environment},
author = {Nielsen, Curtis W and Anderson, Matthew O and McKay, Mark D and Wadsworth, Derek C and Boyce, Jodie R and Hruska, Ryan C and Koudelka, John A and Whetten, Jonathan and Bruemmer, David J},
abstractNote = {Systems and methods relating to an augmented virtuality system are disclosed. A method of operating an augmented virtuality system may comprise displaying imagery of a real-world environment in an operating picture. The method may further include displaying a plurality of virtual icons in the operating picture representing at least some assets of a plurality of assets positioned in the real-world environment. Additionally, the method may include displaying at least one virtual item in the operating picture representing data sensed by one or more of the assets of the plurality of assets and remotely controlling at least one asset of the plurality of assets by interacting with a virtual icon associated with the at least one asset.},
doi = {},
journal = {},
number = ,
volume = ,
place = {United States},
year = {Tue May 20 00:00:00 EDT 2014},
month = {Tue May 20 00:00:00 EDT 2014}
}
Works referenced in this record:
Method for the perspective display of a part of a topographic map, and device suitable for performing such a method
patent, November 1992
- De Jong, Durk J.; Everett, Timothy J.
- US Patent Document 5,161,886
Automated video imagery database generation using photogrammetry
patent, November 1993
- Plunk, Gerald W.
- US Patent Document 5,259,037
Radar based terrain and obstacle alerting function
patent, August 1999
- Ammar, Danny F.; Spires, Randall C.; Sweet, Steven R.
- US Patent Document 5,945,926
Method and apparatus for augmented reality using a see-through head-mounted display
patent, March 2000
- Robinson, Ian N.
- US Patent Document 6,037,914
Hybrid tracking for augmented reality using both camera motion detection and landmark tracking
patent, May 2000
- Hirota, Gentaro; State, Andrei
- US Patent Document 6,064,749
Method and apparatus for operating the overlay of computer-generated effects onto a live image
patent, January 2001
- Mitchell, Brian K.; Wells, Robert V.
- US Patent Document 6,175,343
Cartographic overlay on sensor video
patent, March 2001
- Lazar, Jonathan Noel
- US Patent Document 6,208,933
Interfaces for planning vehicle routes
patent, September 2001
- Feyereisen, Thea L.; Misiak, Christopher J.; Riley, Victor A.
- US Patent Document 6,289,277
Apparatus and method for providing images of real and virtual objects in a head mounted display
patent, June 2002
- Maguire, Jr., Francis J.
- US Patent Document 6,411,266
Augmented reality-based firefighter training system and method
patent, December 2002
- Ebersole, Jr., John Franklin; Furlong, Todd; Ebersole, Jr., John Franklin
- US Patent Document 6,500,008
Image processor and monitoring system
patent, May 2004
- Nobori, Kunio; Nakagawa, Masamichi; Ishii, Hirofumi
- US Patent Document 6,734,896
Method and apparatus for augmented reality visualization
patent, July 2005
- Sauer, Frank
- US Patent Document 6,919,867
Systems and methods for providing enhanced vision imaging with decreased latency
patent, December 2006
- Yelton, Dennis J.; Bernier, Kenneth Leonard
- US Patent Document 7,148,861
Image processing device and monitoring system
patent, January 2007
- Okamoto, Shusaku; Nakagawa, Masamichi; Nobori, Kunio
- US Patent Document 7,161,616
Augmented reality technology
patent, January 2007
- Meisner, Jeffrey; Donnelly, Walter P.; Roosen, Richard
- US Patent Document 7,162,054
System for autonomous vehicle navigation with carrier phase DGPS and laser-scanner augmentation
patent, June 2007
- Hirokawa, Rui
- US Patent Document 7,228,230
Augmented reality system
patent, September 2007
- Navab, Nassir; Zhang, Xiang; Genc, Yakup
- US Patent Document 7,274,380
Augmented reality system
patent, November 2007
- Martins, Fernando; Junkins, Stephen; Plumb, Jason E.
- US Patent Document 7,301,547
Vehicle control system including related methods and components
patent, March 2008
- Duggan, David S.; Felio, David A.; Pate, Billy B.
- US Patent Document 7,343,232
Method and apparatus for navigation system for searching easily accessible POI along route
patent, January 2009
- Laverty, Tom
- US Patent Document 7,480,566
System for autonomous vehicle navigation with carrier phase DGPS and laser-scanner augmentation
patent, March 2009
- Hirokawa, Rui
- US Patent Document 7,502,688
Modeling and video projection for augmented virtual environments
patent, September 2009
- Neumann, Ulrich; You, Suya
- US Patent Document 7,583,275
Visualizing space systems modeling using augmented reality
patent, April 2010
- Kerner, Sara A.; Stiles, Randy J.
- US Patent Document 7,693,702
Augmented reality-based system and method providing status and control of unmanned vehicles
patent, April 2011
- Baillot, Yohann
- US Patent Document 7,920,071
Systems and methods for remote display of an enhanced image
patent, April 2011
- Sanders-Reed, John N.
- US Patent Document 7,925,391
Scene selection in a vehicle-to-vehicle network
patent, March 2013
- Grigsby, Travis M.; Miller, Steven M.; Nesbitt, Pamela A.
- US Patent Document 8,400,507
Peripheral image processor of vehicle and recording medium
patent-application, September 2003
- Yanagawa, Hirohiko; Ishikawa, Tetsuri; Ogiso, Haruhiko
- US Patent Application 10/333745; 20030165255
Interacting augmented reality and virtual reality
patent-application, November 2003
- Benton, Charles
- US Patent Application 10/144467; 20030210832
Fiducial detection system
patent-application, February 2004
- Naimark, Leonid; Foxlin, Eric
- US Patent Application 10/215503; 20040028258
Virtual reality immersion system
patent-application, June 2004
- Williamson, Todd; Suzuki, Norihisa
- US Patent Application 10/628951; 20040104935
Augmented virtual environments
patent-application, June 2004
- Neumann, Ulrich; You, Suya
- US Patent Application 10/676377; 20040105573
Arbitrary object tracking in augmented reality applications
patent-application, June 2004
- Dempski, Kelly L.
- US Patent Application 10/326158; 20040119662
Map generation device, map delivery method, and map generation program
patent-application, December 2004
- Jin, Haomin; Iwamura, Kazuaki; Ishimaru, Nobuhiro
- US Patent Application 10/759234; 20040263514
Birds eye view virtual imaging for real time composited wide field of view
patent-application, February 2005
- Shulman, Alan; Snyder, III, Donald R.
- US Patent Application 10/914375; 20050031169
Rapid mobility analysis and vehicular route planning from overhead imagery
patent-application, September 2005
- Ward, Derek K.; Walloch, Margaret K.
- US Patent Application 10/794361; 20050195096
Remote Perspective Vehicle Environment Observation System
patent-application, January 2007
- Browne, Alan L.; Altan, Osman D.
- US Patent Application 11/427818; 20070016372
User interface for railroad dispatch monitoring of a geographic region and display system employing a common data format for displaying information from different and diverse railroad CAD systems
patent-application, May 2007
- Galbraith, II, Robert E.; Boyle, C. Franklin; Mcquiston, C. Wesley
- US Patent Application 11/268691; 20070106434
Media fusion remote access system
patent-application, May 2007
- Hughes, David William
- US Patent Application 11/368625; 20070124382
Augmented reality-based system and method providing status and control of unmanned vehicles
patent-application, November 2007
- Baillot, Yahan
- US Patent Application 11/715339; 20070273557
Multi-Robot Control Interface
patent-application, January 2008
- Bruemmer, David J.; Walton, Miles C.
- US Patent Application 11/428757; 20080009969
Method and system for providing augmented reality
patent-application, June 2008
- Maassel, Paul W.; Thomas, Justin
- US Patent Application 11/640185; 20080147325
Augmented reality-based system and method to show the location of personnel and sensors inside occluded structures and provide increased situation awareness
patent-application, September 2008
- Baillot, Yohan
- US Patent Application 11/715338; 20080218331
Collection and Distribution Application
patent-application, September 2008
- Diamandis, Peter H.; Whitelaw, Granger; D'Angelo, Michael R.
- US Patent Application 11/932698; 20080221745
Street level video simulation display system and method
patent-application, October 2008
- Lynch, James; Gale, William; Kohlmeyer, Bradley
- US Patent Application 11/796899; 20080266324
4D GIS virtual reality for controlling, monitoring and prediction of manned/unmanned system
patent-application, March 2009
- Lin, Ching-Fang
- US Patent Application 12/154033; 20090073034
Vehicle Control System Including Related Methods and Components
patent-application, November 2010
- Duggan, David S.; Felio, David A.; Pate, Billy B.
- US Patent Application 12/712581; 20100292874
Method and Systems Relating to an Augmented Virtuality Environment
patent-application, December 2010
- Nielsen, Curtis W.; Anderson, Matthew O.; McKay, Mark D.
- US Patent Application 12/480459; 20100313146
Teleoperation of multiple robots through the Internet
conference, January 1996
- Suzuki, T.; Fujii, T.; Yokota, K.
- Proceedings 5th IEEE International Workshop on Robot and Human Communication. RO-MAN'96 TSUKUBA
Works referencing / citing this record:
Sensor management and sensor analytics system
patent, October 2017
- Gallo, Joseph L.; de Antoni, Ferdinand E. K.; Gill, Scott
- US Patent Document 9,779,183
User query and gauge-reading relationships
patent, October 2017
- de Antoni, Ferdinand E. K.
- US Patent Document 9,778,066
Time chart for sensor based detection system
patent, June 2017
- Gallo, Joseph L.; de Antoni, Ferdinand E. K.; Gill, Scott
- US Patent Document 9,693,386
Gesture sensing enhancement system for a wagering game
patent, February 2015
- Aoki, Dion K.; Gronkowski, Timothy T.; Jaffe, Joel R.
- US Patent Document 8,959,459