Object sense and avoid system for autonomous vehicles
Abstract
A system for determining a travel path for an autonomous vehicle (“AV”) to travel to a target while avoiding objects (i.e., obstacles) without the use of an imaging system is provided. An object sense and avoid (“OSA”) system detects objects in an object field that is adjacent to the AV and dynamically generates, as the AV travels, a travel path to the target to avoid the objects. The OSA system repeatedly uses sensors to collect sensor data of any objects in the object field. An object detection system then detects the objects and determines their locations based on triangulating ranges to an object as indicated by different sensors. The path planner system then plans a next travel direction for the AV to avoid the detected objects while seeking to minimize the distance traveled. The OSA system then instructs the AV to travel in the travel direction.
- Inventors:
- Issue Date:
- Research Org.:
- Lawrence Livermore National Laboratory (LLNL), Livermore, CA (United States)
- Sponsoring Org.:
- USDOE
- OSTI Identifier:
- 2293763
- Patent Number(s):
- 11796673
- Application Number:
- 16/315,142
- Assignee:
- Lawrence Livermore National Security, LLC (Livermore, CA)
- DOE Contract Number:
- AC52-07NA27344
- Resource Type:
- Patent
- Resource Relation:
- Patent File Date: 07/06/2016
- Country of Publication:
- United States
- Language:
- English
Citation Formats
Beer, N. Reginald, Chambers, David, and Paglieroni, David W. Object sense and avoid system for autonomous vehicles. United States: N. p., 2023.
Web.
Beer, N. Reginald, Chambers, David, & Paglieroni, David W. Object sense and avoid system for autonomous vehicles. United States.
Beer, N. Reginald, Chambers, David, and Paglieroni, David W. Tue .
"Object sense and avoid system for autonomous vehicles". United States. https://www.osti.gov/servlets/purl/2293763.
@article{osti_2293763,
title = {Object sense and avoid system for autonomous vehicles},
author = {Beer, N. Reginald and Chambers, David and Paglieroni, David W.},
abstractNote = {A system for determining a travel path for an autonomous vehicle (“AV”) to travel to a target while avoiding objects (i.e., obstacles) without the use of an imaging system is provided. An object sense and avoid (“OSA”) system detects objects in an object field that is adjacent to the AV and dynamically generates, as the AV travels, a travel path to the target to avoid the objects. The OSA system repeatedly uses sensors to collect sensor data of any objects in the object field. An object detection system then detects the objects and determines their locations based on triangulating ranges to an object as indicated by different sensors. The path planner system then plans a next travel direction for the AV to avoid the detected objects while seeking to minimize the distance traveled. The OSA system then instructs the AV to travel in the travel direction.},
doi = {},
journal = {},
number = ,
volume = ,
place = {United States},
year = {2023},
month = {10}
}
Works referenced in this record:
Distributed control for multiple quadrotors with obstacle avoidance using potential fields
conference, July 2016
- Luque-Vega, Luis F.; Gonzalez-Jimenez, Luis E.; Fernandez-Flores, David
- 2016 World Automation Congress (WAC)
Methods and apparatus for swarm navigation of multiple agents
patent, July 2012
- Bauer, Peter; Scheutz, Matthias J.
- US Patent Document 8,234,067
A unified distance transform algorithm and architecture
journal, December 1992
- Paglieroni, David W.
- Machine Vision and Applications, Vol. 5, Issue 1
Flying Fast and Low Among Obstacles: Methodology and Experiments
journal, May 2008
- Scherer, Sebastian; Singh, Sanjiv; Chamberlain, Lyle
- The International Journal of Robotics Research, Vol. 27, Issue 5
Unmanned Aerial Vehicle Flight Path Determination, Optimization, and Management
patent-application, November 2015
- Pasko, Douglas M.; Srivastava, Ashok N.; Batla, Hani
- US Patent Application 14/282163; 20150336668
Control of swarms of autonomous robots using Model Driven Development - A state-based approach
conference, April 2011
- Ouellet, Dany; Givigi, Sidney N.; Beaulieu, Alain J. G.
- 2011 IEEE International Systems Conference
Surveying Areas Using a Radar System and an Unmanned Aerial Vehicle
patent-application, April 2016
- Pulleti, Uday K.; Gonia, Patrick
- US Patent Application 14/521199; 20160116915
Systems and Methods for Time-Based Parallel Robotic Operation
patent-application, November 2015
- Linnell, Jeffrey; Byrne, Kendra
- US Patent Application 14/333311; 20150336269
Real-time 3D navigation for autonomous vision-guided MAVs
conference, September 2015
- Xu, Shengdong; Honegger, Dominik; Pollefeys, Marc
- 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
Survey of advances in guidance, navigation, and control of unmanned rotorcraft systems
journal, January 2012
- Kendoul, Farid
- Journal of Field Robotics, Vol. 29, Issue 2
Capturing Environmental Information
patent-application, October 2012
- Spata, Gregory P.
- US Patent Application 13/222230; 20120271461
Autonomous Three-Dimensional Formation Flight for a Swarm of Unmanned Aerial Vehicles
journal, November 2011
- Bennet, Derek J.; MacInnes, C. R.; Suzuki, M.
- Journal of Guidance, Control, and Dynamics, Vol. 34, Issue 6
Path Planning in Complex 3D Environments Using a Probabilistic Roadmap Method
journal, December 2013
- Yan, Fei; Liu, Yi-Sha; Xiao, Ji-Zhong
- International Journal of Automation and Computing, Vol. 10, Issue 6
Unmanned Aerial Vehicle and Methods for Controlling Same
patent-application, October 2014
- Kugelmass, Bret
- US Patent Application 14/204634; 20140316616
Sequential Operations in Digital Picture Processing
journal, October 1966
- Pfaltz, John L.
- Journal of the ACM, Vol. 13, Issue 4
An improved Artificial Potential Field approach to real-time mobile robot path planning in an unknown environment
conference, September 2011
- Sfeir, Joe; Saad, Maarouf; Saliah-Hassane, Hamadou
- 2011 IEEE International Symposium on Robotic and Sensors Environments (ROSE)
Collaborative system for a team of unmanned vehicles
patent-application, January 2007
- Appleby, Brent D.; Franke, Jerry L.; Jameson, Stephen M.
- US Patent Application 11/188830; 20070021880
Computing Device and Method for Controlling Unmanned Aerial Vehicle to Capture Images
patent-application, June 2013
- Lee, Hou-Hsien; Lee, Chang-Jung; Lo, Chih-Ping
- US Patent Application 13/719046; 20130162822
Obstacle-avoiding navigation system
patent, April 1991
- Borenstein, Johann; Koren, Yoram; Levine, Simon
- US Patent Document 5,006,988
Autonomous Nap-Of-the-Earth (ANOE) Flight Path Planning for Manned and Unmanned Rotorcraft
patent-application, July 2016
- Kohn-Rich, Sylvia
- US Patent Application 14/599574; 20160210863
Dynamically reconfigurable sensor arrays
patent, June 2014
- Maleki, Lute
- US Patent Document 8,761,603
Multi-user MIMO via active scattering platforms
patent, October 2017
- Chang, Donald C. D.; Lee, Juo-Yu
- US Patent Document 9,780,859
Matching Random Tree Models of Spatio-Temporal Patterns to Tables or Graphs
conference, April 2007
- Paglieroni, David W.; Nekoogar, Faranak
- 2007 IEEE Symposium on Computational Intelligence and Data Mining
Surveying areas using a radar system and an unmanned aerial vehicle
patent, August 2016
- Pulleti, Uday; Gonia, Patrick
- US Patent Document 9,429,945
A Formal Basis for the Heuristic Determination of Minimum Cost Paths
journal, January 1968
- Hart, Peter; Nilsson, Nils; Raphael, Bertram
- IEEE Transactions on Systems Science and Cybernetics, Vol. 4, Issue 2
Reactive obstacle avoidance for Rotorcraft UAVs
conference, September 2011
- Hrabar, S.
- 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems
Unmanned Vehicle Movement Path Assignment and Management
patent-application, November 2016
- Brown, Jay A.; Watson, Thomas J.
- US Patent Application 14/703062; 20160327959
Outdoor flocking and formation flight with autonomous aerial robots
conference, September 2014
- Vasarhelyi, G.; Viragh, Cs.; Somorjai, G.
- 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems
Controlling unmanned aerial vehicles as a flock to synchronize flight in aerial displays
patent, August 2015
- Stark, James Alexander; Wong, Clifford; Trowbridge, Robert Scott
- US Patent Document 9,102,406
Systems and methods for operating drones in response to an incident
patent, March 2021
- Flick, Bryan
- US Patent Document 10,956,980
Object Discrimination Based on a Swarm of Agents
patent-application, March 2018
- Beer, N. Reginald; Chambers, David; Chandrasekaran, Hema
- US Patent Application 15/267066; 20180074174
Swarm management
patent, May 2015
- Clark, Brendan Edward; Krosky, Ronald Charles; Ammar, Phillip George
- US Patent Document 9,043,021
A linear time algorithm for computing exact Euclidean distance transforms of binary images in arbitrary dimensions
journal, February 2003
- Maurer, C. R.; Raghavan, V.
- IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 25, Issue 2
Multi-Sensor Environmental Mapping
patent-application, March 2016
- Liu, Ang; Mo, Weiyu; Ling, Yonggen
- US Patent Application 14/814159; 20160070265
Classification of subsurface objects using singular values derived from signal frames
patent, May 2014
- Chambers, David; Paglieroni, David W.
- US Patent Document 8,717,223
Control and Systems for Autonomously Driver Vehicles
patent-application, October 2013
- Trepagnier, Paul Gerard; Nagel, Jorge Emilio; Dooner, Matthew Taylor
- US Patent Application 13/854630; 20130274986
Mission planning system for vehicles with varying levels of autonomy
patent-application, August 2006
- Appleby, Brent; Paradis, Rosemary D.; Szczerba, Robert J.
- US Patent Application 11/058836; 20060184292
Dynamic Collision-Avoidance System and Method
patent-application, October 2017
- Kunzi, Fabrice; Rogers, Donald; McKenna, Terrence
- US Patent Application 15/291892; 20170301249
Towards A Swarm of Agile Micro Quadrotors
conference, July 2012
- Kushleyev, Aleksandr; Kumar, Vijay; Mellinger, Daniel
- Robotics: Science and Systems VIII
A note on two problems in connexion with graphs
journal, December 1959
- Dijkstra, E. W.
- Numerische Mathematik, Vol. 1, Issue 1
UAV formation flight using 3D potential field
conference, June 2008
- Paul, Tobias; Krogstad, Thomas R.; Gravdahl, Jan Tommy
- 2008 16th Mediterranean Conference on Control and Automation
Reconnaissance using unmanned surface vehicles and unmanned micro-aerial vehicles
patent, March 2004
- Kucik, Daniel
- US Patent Document 6,712,312
Acoustic time-reversal mirrors
journal, January 2001
- Fink, Mathias; Prada, Claire
- Inverse Problems, Vol. 17, Issue 1, p. R1-R38
Formation Control Numerical Simulations of Geometric Patterns for Unmanned Autonomous Vehicles with Swarm Dynamical Methodologies
conference, January 2009
- Xue, Zhibin; Zeng, Jianchao
- 2009 International Conference on Measuring Technology and Mechatronics Automation
Faster algorithms for the shortest path problem
journal, April 1990
- Ahuja, Ravindra K.; Mehlhorn, Kurt; Orlin, James
- Journal of the ACM, Vol. 37, Issue 2
Fibonacci heaps and their uses in improved network optimization algorithms
journal, July 1987
- Fredman, Michael L.; Tarjan, Robert Endre
- Journal of the ACM, Vol. 34, Issue 3
Data Transmission System and Method
patent-application, August 2012
- Agrell, Erik; Sjodin, Martin
- US Patent Application 13/503692; 20120207476
System and Methods Relating to Autonomous Tracking and Surveillance
patent-application, February 2010
- Kokkeby, Kristen L.; Lutter, Robert P.; Munoz, Michael L.
- US Patent Application 12/334325; 20100042269
Systems and Methods for Drone Navigation
patent-application, May 2016
- Levy, Ziv; Levy, Ran
- US Patent Application 14/882575; 20160140851
The Potential Field Approach And Operational Space Formulation In Robot Control
book, January 1986
- Khatib, Oussama
- Adaptive and Learning Systems
Kinodynamic Motion Planning
journal, March 2010
- Masoud, Ahmad A.
- IEEE Robotics & Automation Magazine, Vol. 17, Issue 1
Method and System for Aircraft Taxi Strike Alerting
patent-application, October 2017
- Ell, Todd; Rutkiewicz, Robert; Pesik, Joseph T.
- US Patent Application 15/385224; 20170301250
Systems and methods for automated cloud-based analytics for surveillance systems with unmanned aerial devices
patent, August 2016
- Renkis, Martin A.
- US Patent Document 9,407,881
Collisionless flying of unmanned aerial vehicles that maximizes coverage of predetermined region
patent, March 2017
- Bogdanowicz, Zbigniew; Patel, Ketula
- US Patent Document 9,599,994
Application of potential field methods in directing agents
patent, September 2015
- Ayyagari, Arun; Battles, Craig Farris; Dorsett, Michael A.
- US Patent Document 9,137,847
Method and apparatus for dynamic swarming of airborne drones for a reconfigurable array
patent, August 2015
- Pillai, Unnikrishna Sreedharan; Mangiat, Alain Anthony
- US Patent Document 9,104,201
Path planning and formation control via potential function for UAV Quadrotor
conference, June 2014
- Rizqi, Ahmad Ataka Awwalur; Cahyadi, Adha Imam; Adji, Teguh Bharata
- 2014 International Conference on Advanced Robotics and Intelligent Systems (ARIS)
Object detection and analysis via unmanned aerial vehicle
patent, June 2018
- Cuban, Mark; Reitman, Joyce; Pritchard, Jeffrey Orion
- US Patent Document 9,989,965
Unmanned Vehicle (UV) Control System
patent-application, August 2015
- Mullan, Pramila; Negm, Walid; Liongosari, Edy S.
- US Patent Application 14/619854; 20150234387
Driving Assistance Apparatus
patent-application, March 2017
- Suzuki, Takamitsu; Katoh, Takahira; Yamamoto, Takeshi
- US Patent Application 15/310903; 20170088130
A strategy of multi-robot formation and obstacle avoidance in unknown environment
conference, August 2016
- Chi, Ting; Zhang, Chengjin; Song, Yong
- 2016 IEEE International Conference on Information and Automation (ICIA)
Airborne relays in cooperative-MIMO systems
patent, October 2017
- Shattil, Steve
- US Patent Document 9,798,329
Multiple pass location processor
patent-application, January 2004
- Anderson, Robert J.
- US Patent Application 10/414982; 20040017312
Subject Tracking System for Autonomous Vehicles
patent-application, April 2017
- Garland, Jeffrey Clyne
- US Patent Application 14/562020; 20170097645
The Hungarian method for the assignment problem
journal, March 1955
- Kuhn, H. W.
- Naval Research Logistics Quarterly, Vol. 2, Issue 1-2, p. 83-97
Obstacle Detection and Collision Avoidance for a UAV With Complementary Low-Cost Sensors
journal, January 2015
- Gageik, Nils; Benz, Paul; Montenegro, Sergio
- IEEE Access, Vol. 3
Neural Network-Based Mobility Management for Healing Mobile Ad Hoc Radio Networks
patent-application, December 2007
- El-Damhougy, Hesham
- US Patent Application 11/426428; 20070299947
Path Generator for Mobile Object
patent-application, December 2006
- Hasegawa, Yuji; Yamada, Kentarou
- US Patent Application 11/452270; 20060293792
Autonomous Mobile Robot
patent-application, July 2007
- Yamauchi, Brian
- US Patent Application 11/618742; 20070156286
System and method for controlling unmanned aerial vehicles
patent, December 2017
- Shehata, Kareem; Thiffault, Matthew; Pike, James Thomas
- US Patent Document 9,841,761
Autonomous Mobile Body
patent-application, May 2013
- Shitamoto, Hideo; Nakano, Tsuyoshi; Tanaka, Shoji
- US Patent Application 13/809719; 20130116880
UCAV Path Planning by Fitness-Scaling Adaptive Chaotic Particle Swarm Optimization
journal, January 2013
- Zhang, Yudong; Wu, Lenan; Wang, Shuihua
- Mathematical Problems in Engineering, Vol. 2013
New scaling algorithms for the assignment and minimum mean cycle problems
journal, February 1992
- Orlin, James B.; Ahuja, Ravindra K.
- Mathematical Programming, Vol. 54, Issue 1-3, p. 41-56
Energy-based approach for obstacle avoidance
patent, October 2000
- Sarangapani, Jagannathan
- US Patent Document 6,134,502
Object detection with a multistatic array using singular value decomposition
patent, July 2014
- Hallquist, Aaron; Chambers, David
- US Patent Document 8,766,845
Wireless signal localization and collection from an airborne symmetric line array network
patent, October 2018
- Ngo, Tan Anh; Tummala, Murali; McEachen, John C.
- US Patent Document 10,107,891