Representation of activity in images using geospatial temporal graphs

Brost, Randolph; McLendon, William C.; Parekh, Ojas D.; Rintoul, Mark Daniel; Watson, Jean-Paul; Strip, David R.; Diegert, Carl

Advanced Search OptionsAdvanced Search queries use a traditional Term Search. For more info, see our FAQ.

All Fields:

Patent Title:

Abstract:

Assignee:

Inventor(s):

Patent Number:

Patent Classification (CPC):

All Classifications
A - human necessities
A01 - agriculture
A21 - baking
A22 - butchering
A23 - foods or foodstuffs
A24 - tobacco
A41 - wearing apparel
A42 - headwear
A43 - footwear
A44 - haberdashery
A45 - hand or travelling articles
A46 - brushware
A47 - furniture
A61 - medical or veterinary science
A62 - life-saving
A63 - sports
A99 - subject matter not otherwise provided for in this section
B - performing operations
B01 - physical or chemical processes or apparatus in general
B02 - crushing, pulverising, or disintegrating
B03 - separation of solid materials using liquids or using pneumatic tables or jigs
B04 - centrifugal apparatus or machines for carrying-out physical or chemical processes
B05 - spraying or atomising in general
B06 - generating or transmitting mechanical vibrations in general
B07 - separating solids from solids
B08 - cleaning
B09 - disposal of solid waste
B21 - mechanical metal-working without essentially removing material
B22 - casting
B23 - machine tools
B24 - grinding
B25 - hand tools
B26 - hand cutting tools
B27 - working or preserving wood or similar material
B28 - working cement, clay, or stone
B29 - working of plastics
B30 - presses
B31 - making articles of paper, cardboard or material worked in a manner analogous to paper
B32 - layered products
B33 - additive manufacturing technology
B41 - printing
B42 - bookbinding
B43 - writing or drawing implements
B44 - decorative arts
B60 - vehicles in general
B61 - railways
B62 - land vehicles for travelling otherwise than on rails
B63 - ships or other waterborne vessels
B64 - aircraft
B65 - conveying
B66 - hoisting
B67 - opening, closing {or cleaning} bottles, jars or similar containers
B68 - saddlery
B81 - microstructural technology
B82 - nanotechnology
B99 - subject matter not otherwise provided for in this section
C - chemistry
C01 - inorganic chemistry
C02 - treatment of water, waste water, sewage, or sludge
C03 - glass
C04 - cements
C05 - fertilisers
C06 - explosives
C07 - organic chemistry
C08 - organic macromolecular compounds
C09 - dyes
C10 - petroleum, gas or coke industries
C11 - animal or vegetable oils, fats, fatty substances or waxes
C12 - biochemistry
C13 - sugar industry
C14 - skins
C21 - metallurgy of iron
C22 - metallurgy
C23 - coating metallic material
C25 - electrolytic or electrophoretic processes
C30 - crystal growth
C40 - combinatorial technology
C99 - subject matter not otherwise provided for in this section
D - textiles
D01 - natural or man-made threads or fibres
D02 - yarns
D03 - weaving
D04 - braiding
D05 - sewing
D06 - treatment of textiles or the like
D07 - ropes
D10 - indexing scheme associated with sublasses of section d, relating to textiles
D21 - paper-making
D99 - subject matter not otherwise provided for in this section
E - fixed constructions
E01 - construction of roads, railways, or bridges
E02 - hydraulic engineering
E03 - water supply
E04 - building
E05 - locks
E06 - doors, windows, shutters, or roller blinds in general
E21 - earth drilling
E99 - subject matter not otherwise provided for in this section
F - mechanical engineering
F01 - machines or engines in general
F02 - combustion engines
F03 - machines or engines for liquids
F04 - positive - displacement machines for liquids
F05 - indexing schemes relating to engines or pumps in various subclasses of classes f01-f04
F15 - fluid-pressure actuators
F16 - engineering elements and units
F17 - storing or distributing gases or liquids
F21 - lighting
F22 - steam generation
F23 - combustion apparatus
F24 - heating
F25 - refrigeration or cooling
F26 - drying
F27 - furnaces
F28 - heat exchange in general
F41 - weapons
F42 - ammunition
F99 - subject matter not otherwise provided for in this section
G - physics
G01 - measuring
G02 - optics
G03 - photography
G04 - horology
G05 - controlling
G06 - computing
G07 - checking-devices
G08 - signalling
G09 - education
G10 - musical instruments
G11 - information storage
G12 - instrument details
G16 - information and communication technology [ict] specially adapted for specific application fields
G21 - nuclear physics
G99 - subject matter not otherwise provided for in this section
H - electricity
H01 - basic electric elements
H02 - generation
H03 - basic electronic circuitry
H04 - electric communication technique
H05 - electric techniques not otherwise provided for
H99 - subject matter not otherwise provided for in this section
Y - new / cross sectional technologies
Y02 - technologies or applications for mitigation or adaptation against climate change
Y04 - information or communication technologies having an impact on other technology areas
Y10 - technical subjects covered by former uspc

More Options ...

Title: Representation of activity in images using geospatial temporal graphs

Abstract

Various technologies pertaining to modeling patterns of activity observed in remote sensing images using geospatial-temporal graphs are described herein. Graphs are constructed by representing objects in remote sensing images as nodes, and connecting nodes with undirected edges representing either distance or adjacency relationships between objects and directed edges representing changes in time. Activity patterns may be discerned from the graphs by coding nodes representing persistent objects like buildings differently from nodes representing ephemeral objects like vehicles, and examining the geospatial-temporal relationships of ephemeral nodes within the graph.

Inventors:: Brost, Randolph; McLendon, III, William C.; Parekh, Ojas D.; Rintoul, Mark Daniel; Watson, Jean-Paul; Strip, David R.; Diegert, Carl

Issue Date:: Tue May 01 00:00:00 EDT 2018

Research Org.:: Sandia National Laboratories (SNL), Albuquerque, NM, and Livermore, CA (United States)

Sponsoring Org.:: USDOE

OSTI Identifier:: 1438449

Patent Number(s):: 9959647

Application Number:: 14/848,165

Assignee:: National Technology & Engineering Solutions of Sandia, LLC (Albuquerque, NM)

Patent Classifications (CPCs):: G - PHYSICS G06 - COMPUTING G06T - IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

Show more

G - PHYSICS G06 - COMPUTING G06T - IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
G06T11/60 - Editing figures and text
G06T2207/10016 - Video
G06T2207/10024 - Color image
G06T2207/10036 - Multispectral image
G06T2207/10044 - Radar image
G06T2207/10048 - Infrared image
G06T2207/20036 - Morphological image processing
G06T2207/20072 - Graph-based image processing
G06T2207/30232 - Surveillance
G06T7/11 - Region-based segmentation
G06T7/162 - involving graph-based methods

Show less

DOE Contract Number:: AC04-94AL85000

Resource Type:: Patent

Resource Relation:: Patent File Date: 2015 Sep 08

Country of Publication:: United States

Language:: English

Subject:: 47 OTHER INSTRUMENTATION

Citation Formats


                    Brost, Randolph, McLendon, III, William C., Parekh, Ojas D., Rintoul, Mark Daniel, Watson, Jean-Paul, Strip, David R., and Diegert, Carl. Representation of activity in images using geospatial temporal graphs.  United States: N. p., 2018. 
        Web.

Copy to clipboard


                    Brost, Randolph, McLendon, III, William C., Parekh, Ojas D., Rintoul, Mark Daniel, Watson, Jean-Paul, Strip, David R., & Diegert, Carl. Representation of activity in images using geospatial temporal graphs.  United States.

Copy to clipboard


                    Brost, Randolph, McLendon, III, William C., Parekh, Ojas D., Rintoul, Mark Daniel, Watson, Jean-Paul, Strip, David R., and Diegert, Carl. Tue .  
        "Representation of activity in images using geospatial temporal graphs".  United States.  https://www.osti.gov/servlets/purl/1438449.

Copy to clipboard


                    
@article{osti_1438449,

  title        = {Representation of activity in images using geospatial temporal graphs},

  author       = {Brost, Randolph and McLendon, III, William C. and Parekh, Ojas D. and Rintoul, Mark Daniel and Watson, Jean-Paul and Strip, David R. and Diegert, Carl},

  abstractNote = {Various technologies pertaining to modeling patterns of activity observed in remote sensing images using geospatial-temporal graphs are described herein. Graphs are constructed by representing objects in remote sensing images as nodes, and connecting nodes with undirected edges representing either distance or adjacency relationships between objects and directed edges representing changes in time. Activity patterns may be discerned from the graphs by coding nodes representing persistent objects like buildings differently from nodes representing ephemeral objects like vehicles, and examining the geospatial-temporal relationships of ephemeral nodes within the graph.},

  doi          = {},

  journal      = {},
number       = ,

  volume       = ,

  place        = {United States},

  year         = {Tue May 01 00:00:00 EDT 2018},

  month        = {Tue May 01 00:00:00 EDT 2018}

}

Copy to clipboard

Patent:

Save / Share:

Export Metadata

Save to My Library

Works referenced in this record:

Aspect coherence for graph-based semantic image labelling
journal, January 2010

Passino, G.; Patras, I.; Izquierdo, E.
IET Computer Vision, Vol. 4, Issue 3, p. 183-194
https://doi.org/10.1049/iet-cvi.2008.0093

Learning to map between ontologies on the semantic web
conference, January 2002

Doan, AnHai; Madhavan, Jayant; Domingos, Pedro
WWW '02 Proceedings of the 11th international conference on World Wide Web, p. 662-673
https://doi.org/10.1145/511446.511532

Jackpine: A benchmark to evaluate spatial database performance
conference, April 2011

Ray, Suprio; Simion, Bogdan; Demke Brown, Angela
Data Engineering (ICDE)
https://doi.org/10.1109/ICDE.2011.5767929

Method and system for tracking and behavioral monitoring of multiple objects moving through multiple fields-of-view
patent-application, December 2005

Buehler, Christopher; Brock, Neil; Edulbehram, Jehanbux
US Patent Application 11/191128; 20050265582
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20050265582

Geometric Hitting Set for Segments of Few Orientations
book, January 2015

Fekete, Sándor P.; Huang, Kan; Mitchell, Joseph S. B.
Approximation and Online Algorithms, p. 145-157
https://doi.org/10.1007/978-3-319-28684-6_13

Encoding and analyzing aerial imagery using geospatial semantic graphs
report, February 2014

Watson, Jean-Paul; Strip, David R.; McLendon, William C.
SAND2014-1405
https://doi.org/10.2172/1204099

Trajectory parsing by cluster sampling in spatio-temporal graph
conference, June 2009

Liu, Xiaobai; Lin, Liang; Zhu, Song-Chun
2009 IEEE Conference on Computer Vision and Pattern Recognition
https://doi.org/10.1109/CVPR.2009.5206688

A computational framework for ontologically storing and analyzing very large overhead image sets
conference, November 2014

Brost, Randy C.; McLendon, William C.; Parekh, Ojas
BigSpatial '14 Proceedings of the 3rd ACM SIGSPATIAL International Workshop on Analytics for Big Geospatial Data, p. 1-10
https://doi.org/10.1145/2676536.2676537

Computing quality scores and uncertainty for approximate pattern matching in geospatial semantic graphs
journal, September 2015

Stracuzzi, David J.; Brost, Randy C.; Phillips, Cynthia A.
Statistical Analysis and Data Mining: The ASA Data Science Journal, Vol. 8, Issue 5-6, p. 340-352
https://doi.org/10.1002/sam.11294

Video-based vehicle detection and tracking using spatio-temporal maps
patent, January 2013

Malinovskiy, Yegor; Wang, Yinhai; Wu, Yao-Jan
US Patent Document 8,358,808
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/8358808

Methods and Systems for Content Processing
patent-application, February 2010

Conwell, William
US Patent Application 12/271692; 20100046842
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20100046842

Geospatial-temporal semantic graph representations of trajectories from remote sensing and geolocation data
patent, August 2017

Perkins, David Nikolaus; Brost, Randolph C.; Ray, Lawrence P.
US Patent Document 9,727,976
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/9727976

Geospatial multiviewer
patent, July 2015

Hourie, Craig; Sulte, Steve
US Patent Document 9,076,259
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/9076259

Geospatial multiviewer
patent-application, March 2013

Hourie, Craig
US Patent Application 13/232559; 20130063489
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20130063489

Classification and feature extraction for remote sensing images from urban areas based on morphological transformations
journal, September 2003

Benediktsson, J. A.; Pesaresi, M.; Arnason, K.
IEEE Transactions on Geoscience and Remote Sensing, Vol. 41, Issue 9, p. 1940-1949
https://doi.org/10.1109/TGRS.2003.814625

Method and system for performing image re-identification
patent, May 2010

Tu, Peter Henry; Sebastian, Thomas Baby; Rittscher, Jens
US Patent Document 7,711,146
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/7711146

Similar Records in DOE Patents and OSTI.GOV collections:

Geospatial-temporal semantic graph representations of trajectories from remote sensing and geolocation data

Patent Perkins, David Nikolaus; Brost, Randolph; Ray, Lawrence P.

Various technologies for facilitating analysis of large remote sensing and geolocation datasets to identify features of interest are described herein. A search query can be submitted to a computing system that executes searches over a geospatial temporal semantic (GTS) graph to identify features of interest. The GTS graph comprises nodes corresponding to objects described in the remote sensing and geolocation datasets, and edges that indicate geospatial or temporal relationships between pairs of nodes in the nodes. Trajectory information is encoded in the GTS graph by the inclusion of movable nodes to facilitate searches for features of interest in the datasetsmore » « less
Full Text Available
Computer processing through distance-based quality score method in geospatial-temporal semantic graphs

Patent Brost, Randolph C.; Woodbridge, Diane

A computer-implemented method of improving processing of overhead image data by a processor using a distance-based quality score in a geospatial-temporal semantic graph. An allowable range for each attribute in the subgraph search template is defined. For each match in a comparison, attribute values of each match element are compared against the preferred range and the allowable range to compute a corresponding distance of each match attribute from the subgraph search template. A corresponding overall match quality score is determined for each match from the subgraph search template, wherein determining the corresponding overall match qualities is performed using a correspondingmore » « less
Full Text Available
Searches over graphs representing geospatial-temporal remote sensing data

Patent Brost, Randolph; Perkins, David Nikolaus

Various technologies pertaining to identifying objects of interest in remote sensing images by searching over geospatial-temporal graph representations are described herein. Graphs are constructed by representing objects in remote sensing images as nodes, and connecting nodes with undirected edges representing either distance or adjacency relationships between objects and directed edges representing changes in time. Geospatial-temporal graph searches are made computationally efficient by taking advantage of characteristics of geospatial-temporal data in remote sensing images through the application of various graph search techniques.
Full Text Available
Universal image representation based on a multimodal graph

Patent Bremer, Peer-Timo; Anirudh, Rushil; Thiagarajan, Jayaraman

A system for classifying a target image with segments having attributes is provided. The system generates a graph for the target image that includes vertices representing segments of the image and edges representing relationships between the connected vertices. For each vertex, the system generates a subgraph that includes the vertex as a home vertex and neighboring vertices representing segments of the target image within a neighborhood of the segment represented by the home vertex. The system applies an autoencoder to each subgraph to generate latent variables to represent the subgraph. The system applies a machine learning algorithm to a featuremore » « less
Full Text Available
Universal image representation based on a multimodal graph

Patent Bremer, Peer-Timo; Anirudh, Rushil; Thiagarajan, Jayaraman Jayaraman

A system for classifying a target image with segments having attributes is provided. The system generates a graph for the target image that includes vertices representing segments of the image and edges representing relationships between the connected vertices. For each vertex, the system generates a subgraph that includes the vertex as a home vertex and neighboring vertices representing segments of the target image within a neighborhood of the segment represented by the home vertex. The system applies an autoencoder to each subgraph to generate latent variables to represent the subgraph. The system applies a machine learning algorithm to a featuremore » « less
Full Text Available

Similar Records

Title: Representation of activity in images using geospatial temporal graphs

Abstract

Citation Formats

Aspect coherence for graph-based semantic image labelling journal, January 2010

Learning to map between ontologies on the semantic web conference, January 2002

Jackpine: A benchmark to evaluate spatial database performance conference, April 2011

Method and system for tracking and behavioral monitoring of multiple objects moving through multiple fields-of-view patent-application, December 2005

Geometric Hitting Set for Segments of Few Orientations book, January 2015

Encoding and analyzing aerial imagery using geospatial semantic graphs report, February 2014

Trajectory parsing by cluster sampling in spatio-temporal graph conference, June 2009

A computational framework for ontologically storing and analyzing very large overhead image sets conference, November 2014

Computing quality scores and uncertainty for approximate pattern matching in geospatial semantic graphs journal, September 2015

Video-based vehicle detection and tracking using spatio-temporal maps patent, January 2013

Methods and Systems for Content Processing patent-application, February 2010

Geospatial-temporal semantic graph representations of trajectories from remote sensing and geolocation data patent, August 2017

Geospatial multiviewer patent, July 2015

Geospatial multiviewer patent-application, March 2013

Classification and feature extraction for remote sensing images from urban areas based on morphological transformations journal, September 2003

Method and system for performing image re-identification patent, May 2010

Aspect coherence for graph-based semantic image labelling
journal, January 2010

Learning to map between ontologies on the semantic web
conference, January 2002

Jackpine: A benchmark to evaluate spatial database performance
conference, April 2011

Method and system for tracking and behavioral monitoring of multiple objects moving through multiple fields-of-view
patent-application, December 2005

Geometric Hitting Set for Segments of Few Orientations
book, January 2015

Encoding and analyzing aerial imagery using geospatial semantic graphs
report, February 2014

Trajectory parsing by cluster sampling in spatio-temporal graph
conference, June 2009

A computational framework for ontologically storing and analyzing very large overhead image sets
conference, November 2014

Computing quality scores and uncertainty for approximate pattern matching in geospatial semantic graphs
journal, September 2015

Video-based vehicle detection and tracking using spatio-temporal maps
patent, January 2013

Methods and Systems for Content Processing
patent-application, February 2010

Geospatial-temporal semantic graph representations of trajectories from remote sensing and geolocation data
patent, August 2017

Geospatial multiviewer
patent, July 2015

Geospatial multiviewer
patent-application, March 2013

Classification and feature extraction for remote sensing images from urban areas based on morphological transformations
journal, September 2003

Method and system for performing image re-identification
patent, May 2010