Universal image representation based on a multimodal graph
Abstract
A system for classifying a target image with segments having attributes is provided. The system generates a graph for the target image that includes vertices representing segments of the image and edges representing relationships between the connected vertices. For each vertex, the system generates a subgraph that includes the vertex as a home vertex and neighboring vertices representing segments of the target image within a neighborhood of the segment represented by the home vertex. The system applies an autoencoder to each subgraph to generate latent variables to represent the subgraph. The system applies a machine learning algorithm to a feature vector comprising a universal image representation of the target image that is derived from the generated latent variables of the subgraphs to generate a classification for the target image.
- Inventors:
- Issue Date:
- Research Org.:
- Lawrence Livermore National Laboratory (LLNL), Livermore, CA (United States)
- Sponsoring Org.:
- USDOE
- OSTI Identifier:
- 1859946
- Patent Number(s):
- 11145403
- Application Number:
- 16/684,388
- Assignee:
- Lawrence Livermore National Security, LLC (Livermore, CA)
- Patent Classifications (CPCs):
-
G - PHYSICS G06 - COMPUTING G06N - COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
G - PHYSICS G06 - COMPUTING G06T - IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- DOE Contract Number:
- AC52-07NA27344
- Resource Type:
- Patent
- Resource Relation:
- Patent File Date: 11/14/2019
- Country of Publication:
- United States
- Language:
- English
Citation Formats
Bremer, Peer-Timo, Anirudh, Rushil, and Thiagarajan, Jayaraman. Universal image representation based on a multimodal graph. United States: N. p., 2021.
Web.
Bremer, Peer-Timo, Anirudh, Rushil, & Thiagarajan, Jayaraman. Universal image representation based on a multimodal graph. United States.
Bremer, Peer-Timo, Anirudh, Rushil, and Thiagarajan, Jayaraman. Tue .
"Universal image representation based on a multimodal graph". United States. https://www.osti.gov/servlets/purl/1859946.
@article{osti_1859946,
title = {Universal image representation based on a multimodal graph},
author = {Bremer, Peer-Timo and Anirudh, Rushil and Thiagarajan, Jayaraman},
abstractNote = {A system for classifying a target image with segments having attributes is provided. The system generates a graph for the target image that includes vertices representing segments of the image and edges representing relationships between the connected vertices. For each vertex, the system generates a subgraph that includes the vertex as a home vertex and neighboring vertices representing segments of the target image within a neighborhood of the segment represented by the home vertex. The system applies an autoencoder to each subgraph to generate latent variables to represent the subgraph. The system applies a machine learning algorithm to a feature vector comprising a universal image representation of the target image that is derived from the generated latent variables of the subgraphs to generate a classification for the target image.},
doi = {},
journal = {},
number = ,
volume = ,
place = {United States},
year = {2021},
month = {10}
}
Works referenced in this record:
Categorical feature encoding for property graphs by vertex proximity
patent-application, August 2020
- Kim, Jinha; Patra, Rhicheek; Hong, Sungpack
- US Patent Application 16/270535; 20200257982
Learning Property Graph Representations Edge-By- Edge
patent-application, May 2020
- Patra, Rhicheek; Hong, Sungpack; Kim, Jinha
- US Patent Application 16/179049; 20200142957
Object pose estimation
patent-application, November 2020
- Mousavian, Arsalan; Xiang, Yu; Fox, Dieter
- US Patent Application 16/416075; 20200363815
Methods, systems, and computer readable media for utilizing brain structural characteristics for predicting a diagnosis of a neurobehavioral disorder
patent-application, May 2019
- Styner, Martin Andreas; Kim, Sun Hyung; Collins, Donald Louis
- US Patent Application 16/235379; 20190148021
Apparatus and method to process and cluster data
patent-application, March 2019
- Eriksson, Brian Charles; Sun, Yifan; Zhang, Deijiao
- US Patent Application 16/119747; 20190073594