Topological structure of complex predictions
Abstract Current complex prediction models are the result of fitting deep neural networks, graph convolutional networks or transducers to a set of training data. A key challenge with these models is that they are highly parameterized, which makes describing and interpreting the prediction strategies difficult. We use topological data analysis to transform these complex prediction models into a simplified topological view of the prediction landscape. The result is a map of the predictions that enables inspection of the model results with more specificity than dimensionality-reduction methods such as tSNE and UMAP. The methods scale up to large datasets across different domains. We present a case study of a transformer-based model previously designed to predict expression levels of a piece of DNA in thousands of genomic tracks. When the model is used to study mutations in the BRCA1 gene, our topological analysis shows that it is sensitive to the location of a mutation and the exon structure of BRCA1 in ways that cannot be found with tools based on dimensionality reduction. Moreover, the topological framework offers multiple ways to inspect results, including an error estimate that is more accurate than model uncertainty. Further studies show how these ideas produce useful results in graph-based learning and image classification.
- Research Organization:
- Purdue Univ., West Lafayette, IN (United States)
- Sponsoring Organization:
- USDOE; USDOE Office of Science (SC)
- Grant/Contract Number:
- SC0023162
- OSTI ID:
- 2216985
- Journal Information:
- Nature Machine Intelligence, Journal Name: Nature Machine Intelligence Journal Issue: 12 Vol. 5; ISSN 2522-5839
- Publisher:
- Nature Publishing GroupCopyright Statement
- Country of Publication:
- United Kingdom
- Language:
- English
Similar Records
Graph identification of proteins in tomograms (
Graph convolutional networks applied to unstructured flow field data