U.S. Department of Energy Office of Science Office of Scientific and Technical Information

OSTI Slideshows and Speeches

More viewing options for this presentation:

Delivering R&D Results

Slide01

Slide01

Delivering R&D Results

Presented by:

Dr. Walter L. Warnick

Director

Office of Scientific and Technical Information (OSTI)

Delivering R&D Results

Slide02

Slide02

R&D Deliverables

  • The main deliverable coming out of R&D projects is scientific and technical information (STI)
  • STI takes the form of journal articles, gray literature reports, e-prints
  • Federal STI function:

– Each R&D Agency has an organization dedicated to getting mileage out of its STI

– The DOE organization is the Office of Scientific and Technical Information (OSTI) (www.osti.gov)

Slide03

Slide03

OSTI and Science.gov

  • OSTI focuses on DOE R&D results and related STI

  • Science.gov integrates most STI across all agencies

    • 50 million pages of STI

    • All searchable

    • Relevance ranked

    • Alert service

  • These are the deliverables from hundreds of billions of dollars of R&D, over one million man-years of R&D

Slide04

Slide04

Measures of Research Success

  • No perfect tool for measuring research success

  • With billions of dollars spent each year, you have to try

  • OSTI and Science.gov provide new tools and approaches

Slide05

Slide05

Measures of Success

  • There are two measures of success
    • Direct performance
    • Impact on science and technology
      • Long-term
      • Short-term

Slide06

Slide06

Direct Performance

  • Typical–meeting loosely defined goals, targets and milestones, often done by peer review
  • Problem–low value, low risk research may score high
  • No measure of return on investment (ROI)

Slide07

Slide07

Long-Term Impact Assessment
R&D Accomplishments

  • Provide compelling evidence that DOE R&D pays real dividends
  • Provide very incomplete accounting of dividends
  • Tell us very little/nothing about current or recent R&D

Slide08

Slide08

Short-Term Impact on Science and Technology

  • Impact leads to ROI
  • Problem: impact is diffuse
  • Diffusion is subtle and complex – so hard to measure
  • Hard to see where ROI is occurring

Slide09

Slide09

Typical Short-Term Impact Measure

  • Journal citations
  • Problem: slow and narrow
  • Does not capture the diffusion process

Slide10

Slide10

Citations Are Slow

Results > Proposal > Research > Published with Citation

  • Problem: cycle time is 2-4 years

Slide11

Slide11

Citations Are Narrow

  • Of primary interest to direct predecessors and others working the problem
  • Methods, techniques, instruments, etc., not usually cited
  • Problem: many high impact factors are not cited

Slide12

Slide12

"Global Discovery"

Full text, deep web search Mention and discussion, much broader than citation "Real time" sources, less delay than citations

Slide13

Slide13

Information Dissemination

  • Information Bridge: close to 90,000 full text documents, all searchable - and adding more all the time!
  • Energy Citations Database: 2 million bibliographic records from 1948 to the present
  • DOE R&D Project Summaries: about 10,000 projects into the system each year

Speaker Notes:

OSTI has engaged in an aggressive effort to capitalize on technological advances to provide state-of-the-art information tools and services to the DOE community, intergovernmental and international partners, students and the public.

  • At Information Bridge, we have close to 90,000 full-text documents, all searchable, and adding more all the time!
  • At Energy Citations Database we have approximately 2 million bibliographic records from 1948 forward, of literature in disciplines such as chemistry, physics, materials, environmental science, geology, engineering, mathematics, climatology, oceanography, computer science and related disciplines. It includes citations to report literature, conference papers, journal articles, books, dissertations, and patents.
  • At DOE R&D Project Summaries, we have about 10,000 projects into the system each year.

Slide14

Slide14

More Research Results

  • E-print Network – a searchable gateway to over 500,000 documents, access to more than 16,000 scientific Web sites
  • DOE R&D Accomplishments – where you can find remarkable advances in science

Our interagency collaborations:

  • Federal R&D Project Summaries
  • Science.gov: 50 million pages

All-in-all: 35 million transactions per year

Speaker Notes:

Other research results:

  • E-print Network is a searchable gateway to preprints, papers, and other documents circulated among the research community. We now have over 500,000 documents and access to more than 16,000 scientific Web sites.
  • DOE R&D Accomplishments – that's where you can find remarkable advances in science.

And our collaborations:

  • Federal R&D Project Summaries – it's a unique window to the Federal research community, with the capability to search almost half-a-million records from six Federal agencies.
  • Science.gov: Recognizing that the boundaries of science disciplines do not necessarily coincide with organizational boundaries, OSTI championed the interagency development of science.gov, the gateway for R&D results and related government science information with 50 million pages of science information from 12 federal agencies.

All-in-all for OSTI resources, 35 million transactions per year

Slide15

Slide15

OSTI Enhancing Search

  • Making search relevant
  • Fully searchable full text
  • Alert Services
  • Real-time search results
  • Deep Web search

Speaker Notes:

OSTI has sought ways to enhance search, through relevancy ranked results; fully searchable full text, alert services, real-time search results and Deep Web search. Soon we will be coming out with Science.gov 3.0, and continue our push to ease search for our patrons and to send science to desktops everywhere.

Slide16

Slide16

The Internet and advanced Web tools have created wonderful opportunities

But also great challenges for those along the leading edge in information dissemination

Speaker Notes:

As you can see, just by looking at OSTI's evolution since the 1940s, the world of communication has changed. The Internet and advancing Web tools have created wonderful opportunities, but also great challenges for those along the leading edge in information dissemination.

Slide17

Slide17

Collaborative search, enhancing knowledge,
advancing science

Global Discovery

Speaker Notes:

We call it Global Discovery, and we must aim for this place just barely within our imaginations, where collaborative search is readily available across all science disciplines to enhance knowledge and advance science.

Slide18

Slide18

Global Discovery – Collaborative search, enhancing knowledge, advancing science

The return on investment in science depends on this diffusion of scientific knowledge.

The opportunity exists to build a global community, to massively speed up and expand the diffusion of knowledge.

Slide19

Slide19

Global Discovery – Collaborative search, enhancing knowledge, advancing science

Full-text search across disciplines

Making available tools to enable researchers to find – and use – the information and data they need, regardless of the discipline.

Slide20

Slide20

Summary

  • Diffusion of scientific knowledge is subtle and complex
  • May never really be able to fully track or measure it
  • But global discovery is a powerful new approach