System and method for operator control of heterogeneous unmanned system teams
Abstract
A control architecture and associated control methods are under development to allow a single user to control a team of multiple heterogeneous UMS as they conduct multi-faceted (i.e. multi-objective) missions in real time is disclosed. The control architecture is hierarchical, modular and layered and enables operator interaction at each layer, ensuring the human operator is in close control of the unmanned team at all times. The architecture and key data structures are introduced. Two approaches to distributed collaborative control of heterogeneous unmanned systems are described, including an extension of homogeneous swarm control and a novel application of distributed model predictive control. Initial results are presented, demonstrating heterogeneous UMS teams conducting collaborative missions.
- Inventors:
- Issue Date:
- Research Org.:
- Sandia National Lab. (SNL-NM), Albuquerque, NM (United States)
- Sponsoring Org.:
- USDOE
- OSTI Identifier:
- 1493315
- Patent Number(s):
- 10168674
- Application Number:
- 14/258,986
- Assignee:
- National Technology & Engineering Solutions of Sandia, LLC (Albuquerque, NM)
- Patent Classifications (CPCs):
-
G - PHYSICS G05 - CONTROLLING G05B - CONTROL OR REGULATING SYSTEMS IN GENERAL
G - PHYSICS G05 - CONTROLLING G05D - SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- DOE Contract Number:
- AC04-94AL85000
- Resource Type:
- Patent
- Resource Relation:
- Patent File Date: 2014 Apr 22
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 47 OTHER INSTRUMENTATION
Citation Formats
Buerger, Stephen, Love, Joshua Alan, Neely, Jason C., Amai, Wendy A., and Little, Charles Q. System and method for operator control of heterogeneous unmanned system teams. United States: N. p., 2019.
Web.
Buerger, Stephen, Love, Joshua Alan, Neely, Jason C., Amai, Wendy A., & Little, Charles Q. System and method for operator control of heterogeneous unmanned system teams. United States.
Buerger, Stephen, Love, Joshua Alan, Neely, Jason C., Amai, Wendy A., and Little, Charles Q. Tue .
"System and method for operator control of heterogeneous unmanned system teams". United States. https://www.osti.gov/servlets/purl/1493315.
@article{osti_1493315,
title = {System and method for operator control of heterogeneous unmanned system teams},
author = {Buerger, Stephen and Love, Joshua Alan and Neely, Jason C. and Amai, Wendy A. and Little, Charles Q.},
abstractNote = {A control architecture and associated control methods are under development to allow a single user to control a team of multiple heterogeneous UMS as they conduct multi-faceted (i.e. multi-objective) missions in real time is disclosed. The control architecture is hierarchical, modular and layered and enables operator interaction at each layer, ensuring the human operator is in close control of the unmanned team at all times. The architecture and key data structures are introduced. Two approaches to distributed collaborative control of heterogeneous unmanned systems are described, including an extension of homogeneous swarm control and a novel application of distributed model predictive control. Initial results are presented, demonstrating heterogeneous UMS teams conducting collaborative missions.},
doi = {},
journal = {},
number = ,
volume = ,
place = {United States},
year = {2019},
month = {1}
}
Save to My Library
You must Sign In or Create an Account in order to save documents to your library.
Works referenced in this record:
System and Method for Generating Instruction for a Robot
patent-application, January 2008
- Hostettler, Randy W.
- US Patent Application 11/479,784; 2008/0004749 Al
Controlling Unmanned Aerial Vehicles as a Flock to Synchronize Flight in Aerial Displays
patent-application, September 2014
- Stark, James Alexander; Wong, Clifford; Trowbridge, Robert Scott
- US Patent Application 13/768,823; 2014/0249693 Al
Robot and Task Execution System
patent-application, August 2010
- Kawaguchi, Yuichiro; Watari, Katsuyoshi; Yokoyama, Taro
- US Patent Application 12/681,818; 2010/0217438 Al
Robot Control Apparatus
patent-application, November 2006
- Orita, Atsuo
- US Patent Application 11/416,066; 2006/0265103 Al
Apparatus and Method for Controlling and Unmanned Vehicle
patent-application, December 2009
- Wood, Joanne E.; Hashimi, Jamil R.; Thourot, Fred G.
- US Patent Application 12/492,713; 2009/0326735 Al
Multi-Objective Predictive Process Optimization with Concurrent Process Simulation
patent-application, July 2007
- Blevins, TerranceL.; Wojsznis, Wilhelm K.; Nixon, Mark J.
- US Patent Application 11/567,107; 2007/0168057 Al
Method and System for Transferring/Acquiring Operation Right of Moving Robot in Multi-Operator Multi-Robot Environment
patent-application, March 2011
- Seo, Beom-Su; Kim, Sung-Hoon; Lee, Kyeong-Ho
- US Patent Application 12/873,606; 2011/0054684 Al
System and Method for Controlling Swarm of Remote Unmanned Vehicles Through Human Gestures
patent-application, September 2009
- Murray, Paul; Troy, James J.; Erignac, Charles A.
- US Patent Application 12/395,019; 2009/0222149 Al
Autonomous coordination of agents
patent, July 2013
- Ashton, Geoffrey D.
- US Patent Document 8,494,689
A layered control architecture for single-operator control of heterogeneous unmanned system teams
conference, May 2012
- Buerger, Stephen P.; Neely, Jason; Little, Charles
- SPIE Defense, Security, and Sensing, SPIE Proceedings
Method and System for Robot Generation
patent-application, December 2009
- Baltes, Hansjorg; Peterson, Jack Elmin; Schaerer, Shawn Samuel
- US Patent Application 12/499,411; 2009/0306823 Al
Multi-Robot Control Interface
patent-application, January 2008
- Bruemmer, David J.; Walton, Miles C.
- US Patent Application 11/428757; 20080009969
Cost-Minimizing Task Scheduler
patent-application, August 2014
- Shill, Kathryn Marie; Christofferson, Carl Louis; Cole, Richard Jeffrey
- US Patent Application 13/764,692; 2014/0229221 Al
Network of Unmanned Vehicles
patent-application, March 2014
- Casado, Enrique Juan Magana; Scarlatti, David; Esteban-Campillo, David
- US Patent Application 13/848,241; 2014/0074339 A1
System and Method for Sensor Scheduling
patent-application, March 2009
- Nguyen, Duong; Hampton, Michael T.; Janoso, Anthony M.
- US Patent Application 11/849,016; 2009/0064169 Al
Decentralized Control of Unmanned Aerial Vehicle Collaborative Sensing Missions
conference, July 2007
- Ryan, Allison; Tisdale, John; Godwin, Mark
- 2007 American Control Conference
Systems and Methods for Dispersing and Clustering a Plurality of Robotic Devices
patent-application, April 2006
- McLurkin, James; Smith, Jennifer
- US Patent Application 11/130,842; 2006/0079997 Al
Decentralized control of cooperative robotic vehicles: theory and application
journal, October 2002
- Feddema, J. T.; Lewis, C.; Schoenwald, D. A.
- IEEE Transactions on Robotics and Automation, Vol. 18, Issue 5
Methods, Apparatus and Systems for Enhanced Synthetic Vision and Multi-Sensor Data Fusion to Improve Operational Capabilities of Unmanned Aerial Vehicles
patent-application, September 2008
- Roy, Phillippe; Yu, Jun; Linden, David S.
- US Patent Application 11/951,920; 2008/0215204 Al
Collaborative system for a team of unmanned vehicles
patent-application, January 2007
- Appleby, Brent D.; Franke, Jerry L.; Jameson, Stephen M.
- US Patent Application 11/188830; 20070021880
Distributed Sequential Auctions for Multiple UAV Task Allocation
conference, July 2007
- Sujit, P. B.; Beard, Randy
- 2007 American Control Conference
Reconfigurable autonomous device networks
patent, September 2007
- Sutton, Jeffrey P.; Jamieson, Ian MacQueen Drummond
- US Patent Document 7,266,532
Robust planning for coupled cooperative UAV missions
conference, January 2004
- Bertuccelli, L. F.; Alighanbari, M.; How, J. P.
- 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601)
Algorithm for optimal winner determination in combinatorial auctions
journal, February 2002
- Sandholm, Tuomas
- Artificial Intelligence, Vol. 135, Issue 1-2
Market-Based Multirobot Coordination: A Survey and Analysis
journal, July 2006
- Dias, M. B.; Zlot, R.; Kalra, N.
- Proceedings of the IEEE, Vol. 94, Issue 7
System, Method and Apparatus for Organizing Groups of Self-Configurable Mobile Robotic Agents in a Multi-Robotic System
patent-application, August 2004
- Solomon, Neal
- US Patent Application 10/647,034; 2004/0162638 Al
Real Time Mission Planning
patent-application, November 2011
- Saad, Emad William; Bieniawski, Stefan Richard; Pigg, Paul Edward Riley
- US Patent Application 12/780,621; 2011/0283285 Al
Distributed multirobot exploration, mapping, and task allocation
journal, April 2008
- Vincent, Regis; Fox, Dieter; Ko, Jonathan
- Annals of Mathematics and Artificial Intelligence, Vol. 52, Issue 2-4
Autonomous command and control unit for mobile platform
patent, September 2000
- Yavnai, Arie
- US Patent Document 6,122,572
Task Changing Apparatus, Task Changing Method and Task Changing Program
patent-application, October 2014
- Saito, Fuminori; Hashimoto, Kunimatsu
- US Patent Application 14/185,483; 2014/0298231 Al
Apparatus and Method for Controlling an Unmanned Vehicle
patent-application, August 2014
- Wood, Joanne E.; Hashimi, Jamil R.; Thourot, Fred G.
- US Patent Application 13/975,189; 2014/0236391 Al
Task Allocation Mechanisms and Markets for Acquiring and Harnessing Sets of Human and Computational Resources for Sensing, Effecting, and Problem Solving
patent-application, December 2010
- Horvitz, Eric; Shahaf, Dafna
- US Patent Application 12/493,146; 2010/0332281 Al
Method and System for Controlling Multiple Small Robots
patent-application, May 2013
- Seo, Beom-Su
- US Patent Application 13/596,149; 2013/0123980 Al
Control System for Real-Time Complex Resource Allocation
patent-application, April 2014
- Peters, Justin; Marinho, Marcio
- US Patent Application 14/116,475; 2014/0108663 Al