A data-centric weak supervised learning for highway traffic incident detection
Journal Article
·
· Accident Analysis and Prevention
- Purdue Univ., West Lafayette, IN (United States); Argonne National Lab. (ANL), Argonne, IL (United States)
- Argonne National Lab. (ANL), Argonne, IL (United States)
- Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States)
Using the data from loop detector sensors for near-real-time detection of traffic incidents on highways is crucial to averting major traffic congestion. While recent supervised machine learning methods offer solutions to incident detection by leveraging human-labeled incident data, the false alarm rate is often too high to be used in practice. Specifically, the inconsistency in the human labeling of the incidents significantly affects the performance of supervised learning models. To that end, we focus on a data-centric approach to improve the accuracy and reduce the false alarm rate of traffic incident detection on highways. We develop a weak supervised learning workflow to generate high-quality training labels for the incident data without the ground truth labels, and we use those generated labels in the supervised learning setup for final detection. This approach comprises three stages. First, we introduce a data preprocessing and curation pipeline that processes traffic sensor data to generate high-quality training data through leveraging labeling functions, which can be domain knowledge-related or simple heuristic rules. Second, we evaluate the training data generated by weak supervision using three supervised learning models-random forest, k-nearest neighbors, and a support vector machine ensemble-and long short-term memory classifiers. The results show that the accuracy of all of the models improves significantly after using the training data generated by weak supervision. Third, we develop an online real-time incident detection approach that leverages the model ensemble and the uncertainty quantification while detecting incidents. Finally, we show that our proposed weak supervised learning workflow achieves a high incident detection rate (0.90) and low false alarm rate (0.08).
- Research Organization:
- Argonne National Laboratory (ANL), Argonne, IL (United States)
- Sponsoring Organization:
- USDOE Office of Energy Efficiency and Renewable Energy (EERE); USDOE Office of Energy Efficiency and Renewable Energy (EERE), Office of Sustainable Transportation. Vehicle Technologies Office (VTO); USDOE Office of Science (SC), Basic Energy Sciences (BES). Scientific User Facilities Division
- Grant/Contract Number:
- AC02-06CH11357
- OSTI ID:
- 1960722
- Alternate ID(s):
- OSTI ID: 1960570
- Journal Information:
- Accident Analysis and Prevention, Journal Name: Accident Analysis and Prevention Vol. 176; ISSN 0001-4575
- Publisher:
- ElsevierCopyright Statement
- Country of Publication:
- United States
- Language:
- English
Similar Records
Data fusion on a distributed heterogeneous sensor network.
In-situ trainable intrusion detection system
Weakly supervised classification of aortic valve malformations using unlabeled cardiac MRI sequences
Conference
·
Tue Jan 31 23:00:00 EST 2006
·
OSTI ID:943868
In-situ trainable intrusion detection system
Patent
·
Mon Nov 14 23:00:00 EST 2016
·
OSTI ID:1332095
Weakly supervised classification of aortic valve malformations using unlabeled cardiac MRI sequences
Journal Article
·
Sun Jul 14 20:00:00 EDT 2019
· Nature Communications
·
OSTI ID:1624170