U.S. Department of Energy Office of Science Office of Scientific and Technical Information

OSTI Slideshows and Speeches

More viewing options for this presentation:

Delivering R&D Results

Slide01

Delivering R&D Results

Presented by:

Dr. Walter L. Warnick

Director

Office of Scientific and Technical Information (OSTI)

Delivering R&D Results

Delivering R&D Results

Slide02

R&D Deliverables

  • The main deliverable coming out of R&D projects is scientific and technical information (STI)
  • STI takes the form of journal articles, gray literature reports, e-prints
  • Federal STI function:

– Each R&D Agency has an organization dedicated to getting mileage out of its STI

– The DOE organization is the Office of Scientific and Technical Information (OSTI) (www.osti.gov)

Delivering R&D Results

Slide03

OSTI and Science.gov

  • OSTI focuses on DOE R&D results and related STI

  • Science.gov integrates most STI across all agencies

    • 50 million pages of STI

    • All searchable

    • Relevance ranked

    • Alert service

  • These are the deliverables from hundreds of billions of dollars of R&D, over one million man-years of R&D

Delivering R&D Results

Slide04

Measures of Research Success

  • No perfect tool for measuring research success

  • With billions of dollars spent each year, you have to try

  • OSTI and Science.gov provide new tools and approaches

Delivering R&D Results

Slide05

Measures of Success

  • There are two measures of success
    • Direct performance
    • Impact on science and technology
      • Long-term
      • Short-term

Delivering R&D Results

Slide06

Direct Performance

  • Typical–meeting loosely defined goals, targets and milestones, often done by peer review
  • Problem–low value, low risk research may score high
  • No measure of return on investment (ROI)

Delivering R&D Results

Slide07

Long-Term Impact Assessment
R&D Accomplishments

  • Provide compelling evidence that DOE R&D pays real dividends
  • Provide very incomplete accounting of dividends
  • Tell us very little/nothing about current or recent R&D

Delivering R&D Results

Slide08

Short-Term Impact on Science and Technology

  • Impact leads to ROI
  • Problem: impact is diffuse
  • Diffusion is subtle and complex – so hard to measure
  • Hard to see where ROI is occurring

Delivering R&D Results

Slide09

Typical Short-Term Impact Measure

  • Journal citations
  • Problem: slow and narrow
  • Does not capture the diffusion process

Delivering R&D Results

Slide10

Citations Are Slow

Results > Proposal > Research > Published with Citation

  • Problem: cycle time is 2-4 years

Delivering R&D Results

Slide11

Citations Are Narrow

  • Of primary interest to direct predecessors and others working the problem
  • Methods, techniques, instruments, etc., not usually cited
  • Problem: many high impact factors are not cited

Delivering R&D Results

Slide12

"Global Discovery"

  • Full text, deep web search
  • Mention and discussion, much broader than citation
  • "Real time" sources, less delay than citations
  • Delivering R&D Results

    Slide13

    Information Dissemination

    • Information Bridge: close to 90,000 full text documents, all searchable - and adding more all the time!
    • Energy Citations Database: 2 million bibliographic records from 1948 to the present
    • DOE R&D Project Summaries: about 10,000 projects into the system each year

    Speaker Notes:

    OSTI has engaged in an aggressive effort to capitalize on technological advances to provide state-of-the-art information tools and services to the DOE community, intergovernmental and international partners, students and the public.

    • At Information Bridge, we have close to 90,000 full-text documents, all searchable, and adding more all the time!
    • At Energy Citations Database we have approximately 2 million bibliographic records from 1948 forward, of literature in disciplines such as chemistry, physics, materials, environmental science, geology, engineering, mathematics, climatology, oceanography, computer science and related disciplines. It includes citations to report literature, conference papers, journal articles, books, dissertations, and patents.
    • At DOE R&D Project Summaries, we have about 10,000 projects into the system each year.

    Delivering R&D Results

    Slide14

    More Research Results

    • E-print Network – a searchable gateway to over 500,000 documents, access to more than 16,000 scientific Web sites
    • DOE R&D Accomplishments – where you can find remarkable advances in science

    Our interagency collaborations:

    • Federal R&D Project Summaries
    • Science.gov: 50 million pages

    All-in-all: 35 million transactions per year

    Speaker Notes:

    Other research results:

    • E-print Network is a searchable gateway to preprints, papers, and other documents circulated among the research community. We now have over 500,000 documents and access to more than 16,000 scientific Web sites.
    • DOE R&D Accomplishments – that's where you can find remarkable advances in science.

    And our collaborations:

    • Federal R&D Project Summaries – it's a unique window to the Federal research community, with the capability to search almost half-a-million records from six Federal agencies.
    • Science.gov: Recognizing that the boundaries of science disciplines do not necessarily coincide with organizational boundaries, OSTI championed the interagency development of science.gov, the gateway for R&D results and related government science information with 50 million pages of science information from 12 federal agencies.

    All-in-all for OSTI resources, 35 million transactions per year

    Delivering R&D Results

    Slide15

    OSTI Enhancing Search

    • Making search relevant
    • Fully searchable full text
    • Alert Services
    • Real-time search results
    • Deep Web search

    Speaker Notes:

    OSTI has sought ways to enhance search, through relevancy ranked results; fully searchable full text, alert services, real-time search results and Deep Web search. Soon we will be coming out with Science.gov 3.0, and continue our push to ease search for our patrons and to send science to desktops everywhere.

    Delivering R&D Results

    Slide16

    The Internet and advanced Web tools have created wonderful opportunities

    But also great challenges for those along the leading edge in information dissemination

    Speaker Notes:

    As you can see, just by looking at OSTI's evolution since the 1940s, the world of communication has changed. The Internet and advancing Web tools have created wonderful opportunities, but also great challenges for those along the leading edge in information dissemination.

    Delivering R&D Results

    Slide17

    Collaborative search, enhancing knowledge,
    advancing science

    Global Discovery

    Speaker Notes:

    We call it Global Discovery, and we must aim for this place just barely within our imaginations, where collaborative search is readily available across all science disciplines to enhance knowledge and advance science.

    Delivering R&D Results

    Slide18

    Global Discovery – Collaborative search, enhancing knowledge, advancing science

    The return on investment in science depends on this diffusion of scientific knowledge.

    The opportunity exists to build a global community, to massively speed up and expand the diffusion of knowledge.

    Delivering R&D Results

    Slide19

    Global Discovery – Collaborative search, enhancing knowledge, advancing science

    Full-text search across disciplines

    Making available tools to enable researchers to find – and use – the information and data they need, regardless of the discipline.

    Delivering R&D Results

    Slide20

    Summary

    • Diffusion of scientific knowledge is subtle and complex
    • May never really be able to fully track or measure it
    • But global discovery is a powerful new approach
    1 of 1