Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information
  1. SAM-I-Am: Semantic boosting for zero-shot atomic-scale electron micrograph segmentation

    Image segmentation is a critical enabler for tasks ranging from medical diagnostics to autonomous driving. However, the correct segmentation semantics — where are boundaries located? what segments are logically similar? — change depending on the domain, such that state-of-the-art foundation models can generate meaningless and incorrect results. Moreover, in certain domains, fine-tuning and retraining techniques are infeasible: obtaining labels is costly and time-consuming; domain images (micrographs) can be exponentially diverse; and data sharing (for third-party retraining) is restricted. To enable rapid adaptation of the best segmentation technology, we propose the concept of semantic boosting: given a zero-shot foundation model, guide its segmentation and adjust results to match domain expectations. Here, we apply semantic boosting to the Segment Anything Model (SAM) to obtain microstructure segmentation for transmission electron microscopy. Our booster, SAM-I-Am, serves as a post-processing engine that extracts geometric and textural features of various intermediate masks to perform mask removal and mask merging operations. We demonstrate a zero-shot performance increase of (absolute) +21.35%, +12.6%, +5.27% in mean IoU, and a -9.91%, -18.42%, -4.06% drop in mean false positive masks across images of three difficulty classes over vanilla SAM (ViT-L).

  2. Enabling portable demand flexibility control applications in virtual and real buildings

    Control applications that facilitate Demand Flexibility (DF) are difficult to deploy at scale in existing buildings. The heterogeneity of systems and non-standard naming conventions for metadata describing data points in building automation systems often lead to ad-hoc and building-specific applications. In recent years, several researchers investigated semantic models to describe the meaning of building data. They suggest that these models can enhance the deployment of building applications, enabling data exchanges among heterogeneous sources and their portability across different buildings. However, the studies in question fail to explore these capabilities in the context of controls. This paper proposes a novel semantics-driven framework for developing and deploying portable DF control applications. The design of the framework leverages an iterative design science research methodology, evolving from evidence gathered through simulation and field demonstrations. The framework aims to decouple control applications from specific buildings and control platforms, enabling these control applications to be configured semi-automatically. This allows application developers and researchers to streamline the onboarding of new applications that could otherwise be time-consuming and resource-intensive. The framework has been validated for its capability to facilitate the deployment of control applications sharing the same codebase across diverse virtual and real buildings. The demonstration successfully tested two controls for load shifting and shedding in four virtual buildings using the Building Optimization Testing Framework (BOPTEST) and in one real building using the control platform VOLTTRON. Insights into the current limitations, benefits, and challenges of generalizable controls and semantic models are derived from the deployment efforts and outcomes to guide future research in this field.

  3. Metadata Schemas and Ontologies for Building Energy Applications: A Critical Review and Use Case Analysis

    Digital and intelligent buildings are critical to realizing efficient building energy operations and a smart grid. With the increasing digitalization of processes throughout the life cycle of buildings, data exchanged between stakeholders and between building systems have grown significantly. However, a lack of semantic interoperability between data in different systems is still prevalent and hinders the development of energy-oriented applications that can be reused across buildings, limiting the scalability of innovative solutions. Addressing this challenge, our review paper systematically reviews metadata schemas and ontologies that are at the foundation of semantic interoperability necessary to move toward improved building energy operations. The review finds 40 schemas that span different phases of the building life cycle, most of which cover commercial building operations and, in particular, control and monitoring systems. The paper’s deeper review and analysis of five popular schemas identify several gaps in their ability to fully facilitate the work of a building modeler attempting to support three use cases: energy audits, automated fault detection and diagnosis, and optimal control. Our findings demonstrate that building modelers focused on energy use cases will find it difficult, labor intensive, and costly to create, sustain, and use semantic models with existing ontologies. This underscores the significant work still to be done to enable interoperable, usable, and maintainable building models. We make three recommendations for future work by the building modeling and energy communities: a centralized repository with a search engine for relevant schemas, the development of more use cases, and better harmonization and standardization of schemas in collaboration with industry to facilitate their adoption by stakeholders addressing varied energy-focused use cases.

  4. A Semantic Search Capability for a Grid Model Repository

    The operation of electric grids is becoming more challenging due to continued increases in wind and solar generation, the proliferation of decentralization generation resources, and cyber security threats. To support the needed research, new large scale realistic public grid models have been developed and placed in a repository for access by researchers. To assist researchers in easily finding grid models that are suitable for their specific research needs, an approach to searching numerous large grid models was evaluated, prototyped and developed. Here, the research identified multiple possible approaches to using graph database techniques and a natural language processing for the search algorithm. Results of the prototype, the final approach for production repository and the search algorithm formulation are described.

  5. Computational evaluation of exome sequence data using human and model organism phenotypes improves diagnostic efficiency

    Purpose: Medical diagnosis and molecular or biochemical confirmation typically rely on the knowledge of the clinician. Although this is very difficult in extremely rare diseases, we hypothesized that the recording of patient phenotypes in Human Phenotype Ontology (HPO) terms and computationally ranking putative disease-associated sequence variants improves diagnosis, particularly for patients with atypical clinical profiles. Methods: Using simulated exomes and the National Institutes of Health Undiagnosed Diseases Program (UDP) patient cohort and associated exome sequence, we tested our hypothesis using Exomiser. Exomiser ranks candidate variants based on patient phenotype similarity to (i) known disease–gene phenotypes, (ii) model organism phenotypes of candidate orthologs, and (iii) phenotypes of protein– protein association neighbors. Results: Benchmarking showed Exomiser ranked the causal variant as the top hit in 97% of known disease–gene associations and ranked the correct seeded variant in up to 87% when detectable disease–gene associations were unavailable. Using UDP data, Exomiser ranked the causative variant(s) within the top 10 variants for 11 previously diagnosed variants and achieved a diagnosis for 4 of 23 cases undiagnosed by clinical evaluation. Conclusion: Structured phenotyping of patients and computational analysis are effective adjuncts for diagnosing patients with genetic disorders.

  6. Workshop on Current Issues in Predictive Approaches to Intelligence and Security Analytics: Fostering the Creation of Decision Advantage through Model Integration and Evaluation

    The increasing asymmetric nature of threats to the security, health and sustainable growth of our society requires that anticipatory reasoning become an everyday activity. Currently, the use of anticipatory reasoning is hindered by the lack of systematic methods for combining knowledge- and evidence-based models, integrating modeling algorithms, and assessing model validity, accuracy and utility. The workshop addresses these gaps with the intent of fostering the creation of a community of interest on model integration and evaluation that may serve as an aggregation point for existing efforts and a launch pad for new approaches.


Search for:
All Records
Subject
semantic model

Refine by:
Resource Type
Availability
Publication Date
  • 2010: 1 results
  • 2011: 0 results
  • 2012: 0 results
  • 2013: 0 results
  • 2014: 0 results
  • 2015: 1 results
  • 2016: 0 results
  • 2017: 0 results
  • 2018: 0 results
  • 2019: 1 results
  • 2020: 0 results
  • 2021: 1 results
  • 2022: 0 results
  • 2023: 0 results
  • 2024: 2 results
2010
2024
Author / Contributor
Research Organization