Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

A data-centric weak supervised learning for highway traffic incident detection

Journal Article · · Accident Analysis and Prevention
 [1];  [2];  [2];  [3]
  1. Purdue Univ., West Lafayette, IN (United States); Argonne National Lab. (ANL), Argonne, IL (United States)
  2. Argonne National Lab. (ANL), Argonne, IL (United States)
  3. Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States)
Using the data from loop detector sensors for near-real-time detection of traffic incidents on highways is crucial to averting major traffic congestion. While recent supervised machine learning methods offer solutions to incident detection by leveraging human-labeled incident data, the false alarm rate is often too high to be used in practice. Specifically, the inconsistency in the human labeling of the incidents significantly affects the performance of supervised learning models. To that end, we focus on a data-centric approach to improve the accuracy and reduce the false alarm rate of traffic incident detection on highways. We develop a weak supervised learning workflow to generate high-quality training labels for the incident data without the ground truth labels, and we use those generated labels in the supervised learning setup for final detection. This approach comprises three stages. First, we introduce a data preprocessing and curation pipeline that processes traffic sensor data to generate high-quality training data through leveraging labeling functions, which can be domain knowledge-related or simple heuristic rules. Second, we evaluate the training data generated by weak supervision using three supervised learning models-random forest, k-nearest neighbors, and a support vector machine ensemble-and long short-term memory classifiers. The results show that the accuracy of all of the models improves significantly after using the training data generated by weak supervision. Third, we develop an online real-time incident detection approach that leverages the model ensemble and the uncertainty quantification while detecting incidents. Finally, we show that our proposed weak supervised learning workflow achieves a high incident detection rate (0.90) and low false alarm rate (0.08).
Research Organization:
Argonne National Laboratory (ANL), Argonne, IL (United States)
Sponsoring Organization:
USDOE Office of Energy Efficiency and Renewable Energy (EERE); USDOE Office of Energy Efficiency and Renewable Energy (EERE), Office of Sustainable Transportation. Vehicle Technologies Office (VTO); USDOE Office of Science (SC), Basic Energy Sciences (BES). Scientific User Facilities Division
Grant/Contract Number:
AC02-06CH11357
OSTI ID:
1960722
Alternate ID(s):
OSTI ID: 1960570
Journal Information:
Accident Analysis and Prevention, Journal Name: Accident Analysis and Prevention Vol. 176; ISSN 0001-4575
Publisher:
ElsevierCopyright Statement
Country of Publication:
United States
Language:
English

References (22)

Traffic Dynamics Exploration and Incident Detection Using Spatiotemporal Graphical Modeling journal May 2019
Real-time prediction and avoidance of secondary crashes under unexpected traffic congestion journal March 2018
Modeling when and where a secondary accident occurs journal September 2019
Likelihood estimation of secondary crashes using Bayesian complementary log-log model journal October 2018
A spatiotemporal deep learning approach for citywide short-term crash risk prediction with multi-source data journal January 2019
Real-time accident detection: Coping with imbalanced data journal August 2019
Highway crash detection and risk estimation using deep learning journal February 2020
Toward safer highways, application of XGBoost and SHAP for real-time accident detection and feature analysis journal March 2020
A long short-term memory-based framework for crash detection on freeways with traffic data of different temporal resolutions journal June 2020
Automated traffic incident detection with a smaller dataset based on generative adversarial networks journal September 2020
Automatic incident detection on freeways based on Bluetooth traffic monitoring journal October 2020
A deep learning approach for real-time crash prediction using vehicle-by-vehicle data journal November 2021
Fuzzy deep learning based urban traffic incident detection journal August 2018
SVM and KNN ensemble learning for traffic incident detection journal March 2019
Spatio-temporal clustering for non-recurrent traffic congestion detection on urban road networks journal November 2014
The Exponentially Weighted Moving Average journal October 1986
Focal Loss for Dense Object Detection conference October 2017
Automatic Incident Detection in Intelligent Transportation Systems Using Aggregation of Traffic Parameters Collected Through V2I Communications journal January 2017
Deep Spatio-Temporal Representation for Detection of Road Accidents Using Stacked Autoencoder journal March 2019
Robust principal component analysis? journal May 2011
Large-Scale Transportation Network Congestion Evolution Prediction Using Deep Learning Theory journal March 2015
Urban Freeway Traffic Flow Prediction: Application of Seasonal Autoregressive Integrated Moving Average and Exponential Smoothing Models
  • Williams, Billy M.; Durvasula, Priya K.; Brown, Donald E.
  • Transportation Research Record: Journal of the Transportation Research Board, Vol. 1644, Issue 1 https://doi.org/10.3141/1644-14
journal January 1998

Similar Records

Data fusion on a distributed heterogeneous sensor network.
Conference · Tue Jan 31 23:00:00 EST 2006 · OSTI ID:943868

In-situ trainable intrusion detection system
Patent · Mon Nov 14 23:00:00 EST 2016 · OSTI ID:1332095

Weakly supervised classification of aortic valve malformations using unlabeled cardiac MRI sequences
Journal Article · Sun Jul 14 20:00:00 EDT 2019 · Nature Communications · OSTI ID:1624170