Failure Analysis of a Complex Learning Framework Incorporating Multi-Modal and Semi-Supervised Learning
- ORNL
Machine learning is used in many applications, from machine vision to speech recognition to decision support systems, and is used to test applications. However, though much has been done to evaluate the performance of machine learning algorithms, little has been done to verify the algorithms or examine their failure modes. Moreover, complex learning frameworks often require stepping beyond black box evaluation to distinguish between errors based on natural limits on learning and errors that arise from mistakes in implementation. We present a conceptual architecture, failure model and taxonomy, and failure modes and effects analysis (FMEA) of a semi-supervised, multi-modal learning system, and provide specific examples from its use in a radiological analysis assistant system. The goal of the research described in this paper is to provide a foundation from which dependability analysis of systems using semi-supervised, multi-modal learning can be conducted. The methods presented provide a first step towards that overall goal.
- Research Organization:
- Oak Ridge National Lab. (ORNL), Oak Ridge, TN (United States)
- Sponsoring Organization:
- USDOE Laboratory Directed Research and Development (LDRD) Program
- DOE Contract Number:
- DE-AC05-00OR22725
- OSTI ID:
- 1032815
- Resource Relation:
- Conference: IEEE Pacific Rim International Symposium on Dependable Computing (PRDC 2011), Pasadena, CA, USA, 20111212, 20111214
- Country of Publication:
- United States
- Language:
- English
Similar Records
Semi-supervised learning approach for crack detection and identification in advanced gas-cooled reactor graphite bricks - 111
Unsupervised and Supervised Learning over the Energy Landscape for Protein Decoy Selection