skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: MESUR: USAGE-BASED METRICS OF SCHOLARLY IMPACT

Abstract

The evaluation of scholarly communication items is now largely a matter of expert opinion or metrics derived from citation data. Both approaches can fail to take into account the myriad of factors that shape scholarly impact. Usage data has emerged as a promising complement to existing methods o fassessment but the formal groundwork to reliably and validly apply usage-based metrics of schlolarly impact is lacking. The Andrew W. Mellon Foundation funded MESUR project constitutes a systematic effort to define, validate and cross-validate a range of usage-based metrics of schlolarly impact by creating a semantic model of the scholarly communication process. The constructed model will serve as the basis of a creating a large-scale semantic network that seamlessly relates citation, bibliographic and usage data from a variety of sources. A subsequent program that uses the established semantic network as a reference data set will determine the characteristics and semantics of a variety of usage-based metrics of schlolarly impact. This paper outlines the architecture and methodology adopted by the MESUR project and its future direction.

Authors:
 [1];  [1];  [1]
  1. Los Alamos National Laboratory
Publication Date:
Research Org.:
Los Alamos National Lab. (LANL), Los Alamos, NM (United States)
OSTI Identifier:
985894
Report Number(s):
LA-UR-07-0663
TRN: US201017%%72
DOE Contract Number:
AC52-06NA25396
Resource Type:
Conference
Resource Relation:
Conference: JOINT CONFERENCE ON DIGITAL LIBRARIES ; 200706 ; VANCOUVER
Country of Publication:
United States
Language:
English
Subject:
99; ARCHITECTURE; COMMUNICATIONS; EVALUATION; METRICS; SHAPE

Citation Formats

BOLLEN, JOHAN, RODRIGUEZ, MARKO A., and VAN DE SOMPEL, HERBERT. MESUR: USAGE-BASED METRICS OF SCHOLARLY IMPACT. United States: N. p., 2007. Web.
BOLLEN, JOHAN, RODRIGUEZ, MARKO A., & VAN DE SOMPEL, HERBERT. MESUR: USAGE-BASED METRICS OF SCHOLARLY IMPACT. United States.
BOLLEN, JOHAN, RODRIGUEZ, MARKO A., and VAN DE SOMPEL, HERBERT. Tue . "MESUR: USAGE-BASED METRICS OF SCHOLARLY IMPACT". United States. doi:. https://www.osti.gov/servlets/purl/985894.
@article{osti_985894,
title = {MESUR: USAGE-BASED METRICS OF SCHOLARLY IMPACT},
author = {BOLLEN, JOHAN and RODRIGUEZ, MARKO A. and VAN DE SOMPEL, HERBERT},
abstractNote = {The evaluation of scholarly communication items is now largely a matter of expert opinion or metrics derived from citation data. Both approaches can fail to take into account the myriad of factors that shape scholarly impact. Usage data has emerged as a promising complement to existing methods o fassessment but the formal groundwork to reliably and validly apply usage-based metrics of schlolarly impact is lacking. The Andrew W. Mellon Foundation funded MESUR project constitutes a systematic effort to define, validate and cross-validate a range of usage-based metrics of schlolarly impact by creating a semantic model of the scholarly communication process. The constructed model will serve as the basis of a creating a large-scale semantic network that seamlessly relates citation, bibliographic and usage data from a variety of sources. A subsequent program that uses the established semantic network as a reference data set will determine the characteristics and semantics of a variety of usage-based metrics of schlolarly impact. This paper outlines the architecture and methodology adopted by the MESUR project and its future direction.},
doi = {},
journal = {},
number = ,
volume = ,
place = {United States},
year = {Tue Jan 30 00:00:00 EST 2007},
month = {Tue Jan 30 00:00:00 EST 2007}
}

Conference:
Other availability
Please see Document Availability for additional information on obtaining the full-text document. Library patrons may search WorldCat to identify libraries that hold this conference proceeding.

Save / Share:
  • Although recording of usage data is common in scholarly information services, its exploitation for the creation of value-added services remains limited due to concerns regarding, among others, user privacy, data validity, and the lack of accepted standards for the representation, sharing and aggregation of usage data. A technical, standards-based architecture for sharing usage information is presented. In this architecture, OpenURL-compliant linking servers aggregate usage information of a specific user community as it navigates the distributed information environment that it has access to. This usage information is made OAI-PMH harvestable so that usage information exposed by many linking servers can bemore » aggregated to facilitate the creation of value-added services with a reach beyond that of a single community or a single information service.« less
  • The large-scale analysis of scholarly artifact usage is constrained primarily by current practices in usage data archiving, privacy issues concerned with the dissemination of usage data, and the lack of a practical ontology for modeling the usage domain. As a remedy to the third constraint, this article presents a scholarly ontology that was engineered to represent those classes for which large-scale bibliographic and usage data exists, supports usage research, and whose instantiation is scalable to the order of 50 million articles along with their associated artifacts (e.g. authors and journals) and an accompanying 1 billion usage events. The real worldmore » instantiation of the presented abstract ontology is a semantic network model of the scholarly community which lends the scholarly process to statistical analysis and computational support. They present the ontology, discuss its instantiation, and provide some example inference rules for calculating various scholarly artifact metrics.« less
  • "Resilience” describes how systems operate at an acceptable level of normalcy despite disturbances or threats. In this paper we first consider the cognitive, cyber-physical interdependencies inherent in critical infrastructure systems and how resilience differs from reliability to mitigate these risks. Terminology and metrics basis are provided to integrate the cognitive, cyber-physical aspects that should be considered when defining solutions for resilience. A practical approach is taken to roll this metrics basis up to system integrity and business case metrics that establish “proper operation” and “impact.” A notional chemical processing plant is the use case for demonstrating how the system integritymore » metrics can be applied to establish performance, and« less
  • This paper incorporates the stochastic day-ahead security-constrained unit commitment (DASCUC) within a multi-timescale, multi-scheduling application with commitment, dispatch, and automatic generation control. The stochastic DASCUC is solved using a progressive hedging algorithm with constrained ordinal optimization to accelerate the individual scenario solution. Sensitivity studies are performed in the RTS-96 system, and the results show how this new scheduling application would impact costs and reliability with a closer representation of timescales of system operations in practice.