skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Real-Time Fine Grained Occupancy Estimation Using Depth Sensors on ARM Embedded Platforms

Conference · · 2017 IEEE Real-Time and Embedded Technology and Applications Symposium (RTAS)
DOI:https://doi.org/10.1109/rtas.2017.8· OSTI ID:1811682

Occupancy estimation is an important primitive for a wide range of applications including building energy efficiency, safety, and security. In this paper, we explore the potential of using depth sensors to detect, estimate, identify, and track occupants in buildings. While depth sensors have been widely used for human detection and gesture recognition, computer vision algorithms are typically run on a powerful computer like XBOX or Intel R CoreTM i7 processor. In this work, we develop a prototype system called FORK using off-the-shelf components that performs the entire depth data processing on a cheaper and low power ARM processor in real-time. As ARM processors are extremely weak in running computer vision algorithms, FORK is designed to detect humans and track them in a very efficient way by leveraging a novel lightweight model based approach instead of traditional approaches based on histogram of oriented gradients (HOG) features. Unlike other camera based approaches, FORK is much less privacy invasive (even if the sensor is compromised). Based on a complete implementation, real-world deployment, and extensive evaluation at realistic scenarios, we observe that FORK achieves over 99% accuracy in real-time (4-9 FPS) in occupancy estimation.

Research Organization:
Robert Bosch LLC, Farmington Hills, MI (United States)
Sponsoring Organization:
USDOE Office of Energy Efficiency and Renewable Energy (EERE), Energy Efficiency Office. Building Technologies Office
DOE Contract Number:
EE0007682
OSTI ID:
1811682
Journal Information:
2017 IEEE Real-Time and Embedded Technology and Applications Symposium (RTAS), Conference: IEEE Real-Time and Embedded Technology and Applications Symposium (RTAS) , Pittsburgh, USA, April 18-21, 2017.
Country of Publication:
United States
Language:
English

References (18)

A People Counting System Based on Face Detection and Tracking in a Video conference September 2009
Water Filling: Unsupervised People Counting via Vertical Kinect Sensor conference September 2012
Real-time people counting from depth imagery of crowded environments conference August 2014
Tracking human motion using multiple cameras conference January 1996
Histograms of Oriented Gradients for Human Detection conference January 2005
Doorjamb conference November 2012
A Kinect-based people-flow counting system conference November 2012
A novel method for tracking and counting pedestrians in real-time using a single camera journal January 2001
Human detection using depth information by Kinect conference June 2011
Smart cameras as embedded systems journal September 2002
Real-Time People Counting Using Multiple Lines conference January 2008
An efficient method for contour tracking using active shape models conference November 1994
PIR sensors conference April 2015
Sensor Andrew: Large-scale campus-wide sensing and actuation journal January 2011
Tracking and counting moving people conference November 1994
A camera-based system for tracking people in real time conference January 1996
Human Detection using HOG Features of Head and Shoulder Based on Depth Map journal September 2013
Occupancy estimation using ultrasonic chirps conference April 2015