Title: Geolocation tracking for human identification and activity recognition using radar deep transfer learning

Journal Article · · IET Radar, Sonar & Navigation
DOI: https://doi.org/10.1049/rsn2.12390 · OSTI ID:1959877
ORCiD logo [1];  [1];  [2];  [2]
  1. Department of Electrical and Computer Engineering University of California Davis California USA
  2. Lawrence Livermore National Laboratory Livermore California USA

Abstract Human identification and activity recognition (HIAR) is crucial for many applications, such as surveillance, smart homes, and assisted living. As a sensing modality, radar has many unique characteristics including privacy protection, and contactless sensing. Single classification systems have shown to be accurate, but for long‐term solutions both human identification (ID) and human activity recognition (HAR) will need to be integrated in one system where it can be utilised simultaneously. In this article, a novel radar‐based human tracking system is presented where three classifiers are utilised to identify the subject and his/her behaviour. For any kind of motion, the system tracks the subject and detect the type of his/her motion. Based on the detected type of motion, the three classifiers are utilised for identification and activity recognition. The classifiers are built utilising deep transfer learning where three radar datasets are established to train and validate each of the deep networks. To recognise six activities and 10 human subjects, the three classifiers, namely, HAR, Gait ID, and Heart sound ID, achieve superior performance compared to the best reported results in literature with classification accuracies of 97.6%, 100%, and 41.8% respectively. Three successful examples are presented to demonstrate the introduced concept.

Sponsoring Organization:
USDOE
OSTI ID:
1959877
Journal Information:
IET Radar, Sonar & Navigation, Journal Name: IET Radar, Sonar & Navigation Journal Issue: 6 Vol. 17; ISSN 1751-8784
Publisher:
Institution of Engineering and Technology (IET)Copyright Statement
Country of Publication:
United Kingdom
Language:
English

References (25)

Design study of a short-range airborne UAV radar for human monitoring conference November 2014
Phase based motion characteristics measurement for fall detection by using stepped-frequency continuous wave radar conference January 2016
Multiple joint-variable domains recognition of human motion conference May 2017
A Deep Multi-task Network for Activity Classification and Person Identification with Micro-Doppler Signatures conference September 2019
Radar Data Cube Processing for Human Activity Recognition Using Multisubspace Learning journal December 2019
Activity Recognition of Assembly Tasks Using Body-Worn Microphones and Accelerometers journal October 2006
Radar and RGB-Depth Sensors for Fall Detection: A Review journal June 2017
Classification of Unarmed/Armed Personnel Using the NetRAD Multistatic Radar for Micro-Doppler and Singular Value Decomposition Features journal September 2015
Human Detection and Activity Classification Based on Micro-Doppler Signatures Using Deep Convolutional Neural Networks journal January 2016
Person Identification Using Micro-Doppler Signatures of Human Motions and UWB Radar journal May 2019
Gait Recognition using FMCW Radar and Temporal Convolutional Deep Neural Networks conference June 2020
Radar Signal Processing for Elderly Fall Detection: The future for in-home monitoring journal March 2016
Radar Signal Processing for Sensing in Assisted Living: The Challenges Associated With Real-Time Implementation of Emerging Algorithms journal July 2019
Pedestrian motion direction estimation using simulated automotive MIMO radar journal June 2016
DNN Transfer Learning From Diversified Micro-Doppler for Motion Classification journal October 2019
Human Activity Classification Based on Micro-Doppler Signatures Using a Support Vector Machine journal May 2009
A Portable Real-Time Digital Noise Radar System for Through-the-Wall Imaging journal October 2012
Indoor Person Identification Using a Low-Power FMCW Radar journal July 2018
Continuous Human Motion Recognition With a Dynamic Range-Doppler Trajectory Method Based on FMCW Radar journal September 2019
Multi-target human gait classification using LSTM recurrent neural networks applied to micro-Doppler conference October 2017
A Survey of Deep Learning-Based Human Activity Recognition in Radar journal May 2019
Heart ID: Human Identification Based on Radar Micro-Doppler Signatures of the Heart Using Deep Learning journal May 2019
Micro-Doppler Based Classification of Human Aquatic Activities via Transfer Learning of Convolutional Neural Networks journal November 2016
Temporal Convolutional Neural Networks for Radar Micro-Doppler Based Gait Recognition journal January 2021
Dual-Biometric Human Identification Using Radar Deep Transfer Learning journal August 2022