U.S. Department of Energy Office of Science Office of Scientific and Technical Information

Delivering R&D Results

Slide01
Slide01

Delivering R&D Results

Presented by:

Dr. Walter L. Warnick

Director

Office of Scientific and Technical Information (OSTI)

Delivering R&D Results

Slide01
Slide01

Delivering R&D Results

Presented by:

Dr. Walter L. Warnick

Director

Office of Scientific and Technical Information (OSTI)

Delivering R&D Results

Slide03
Slide03

OSTI and Science.gov

  • OSTI focuses on DOE R&D results and related STI

  • Science.gov integrates most STI across all agencies

    • 50 million pages of STI

    • All searchable

    • Relevance ranked

    • Alert service

  • These are the deliverables from hundreds of billions of dollars of R&D, over one million man-years of R&D

Slide03
Slide03

OSTI and Science.gov

  • OSTI focuses on DOE R&D results and related STI

  • Science.gov integrates most STI across all agencies

    • 50 million pages of STI

    • All searchable

    • Relevance ranked

    • Alert service

  • These are the deliverables from hundreds of billions of dollars of R&D, over one million man-years of R&D

Slide11
Slide11

Citations Are Narrow

  • Of primary interest to direct predecessors and others working the problem
  • Methods, techniques, instruments, etc., not usually cited
  • Problem: many high impact factors are not cited
Slide11
Slide11

Citations Are Narrow

  • Of primary interest to direct predecessors and others working the problem
  • Methods, techniques, instruments, etc., not usually cited
  • Problem: many high impact factors are not cited
Slide12
Slide12

"Global Discovery"

Full text, deep web search Mention and discussion, much broader than citation "Real time" sources, less delay than citations
Slide12
Slide12

"Global Discovery"

Full text, deep web search Mention and discussion, much broader than citation "Real time" sources, less delay than citations
Slide13
Slide13

Information Dissemination

  • Information Bridge: close to 90,000 full text documents, all searchable - and adding more all the time!
  • Energy Citations Database: 2 million bibliographic records from 1948 to the present
  • DOE R&D Project Summaries: about 10,000 projects into the system each year

Speaker Notes:

OSTI has engaged in an aggressive effort to capitalize on technological advances to provide state-of-the-art information tools and services to the DOE community, intergovernmental and international partners, students and the public.

  • At Information Bridge, we have close to 90,000 full-text documents, all searchable, and adding more all the time!
  • At Energy Citations Database we have approximately 2 million bibliographic records from 1948 forward, of literature in disciplines such as chemistry, physics, materials, environmental science, geology, engineering, mathematics, climatology, oceanography, computer science and related disciplines. It includes citations to report literature, conference papers, journal articles, books, dissertations, and patents.
  • At DOE R&D Project Summaries, we have about 10,000 projects into the system each year.
Slide13
Slide13

Information Dissemination

  • Information Bridge: close to 90,000 full text documents, all searchable - and adding more all the time!
  • Energy Citations Database: 2 million bibliographic records from 1948 to the present
  • DOE R&D Project Summaries: about 10,000 projects into the system each year

Speaker Notes:

OSTI has engaged in an aggressive effort to capitalize on technological advances to provide state-of-the-art information tools and services to the DOE community, intergovernmental and international partners, students and the public.

  • At Information Bridge, we have close to 90,000 full-text documents, all searchable, and adding more all the time!
  • At Energy Citations Database we have approximately 2 million bibliographic records from 1948 forward, of literature in disciplines such as chemistry, physics, materials, environmental science, geology, engineering, mathematics, climatology, oceanography, computer science and related disciplines. It includes citations to report literature, conference papers, journal articles, books, dissertations, and patents.
  • At DOE R&D Project Summaries, we have about 10,000 projects into the system each year.
Slide14
Slide14

More Research Results

  • E-print Network – a searchable gateway to over 500,000 documents, access to more than 16,000 scientific Web sites
  • DOE R&D Accomplishments – where you can find remarkable advances in science

Our interagency collaborations:

  • Federal R&D Project Summaries
  • Science.gov: 50 million pages

All-in-all: 35 million transactions per year

Speaker Notes:

Other research results:

  • E-print Network is a searchable gateway to preprints, papers, and other documents circulated among the research community. We now have over 500,000 documents and access to more than 16,000 scientific Web sites.
  • DOE R&D Accomplishments – that's where you can find remarkable advances in science.

And our collaborations:

  • Federal R&D Project Summaries – it's a unique window to the Federal research community, with the capability to search almost half-a-million records from six Federal agencies.
  • Science.gov: Recognizing that the boundaries of science disciplines do not necessarily coincide with organizational boundaries, OSTI championed the interagency development of science.gov, the gateway for R&D results and related government science information with 50 million pages of science information from 12 federal agencies.

All-in-all for OSTI resources, 35 million transactions per year

Slide14
Slide14

More Research Results

  • E-print Network – a searchable gateway to over 500,000 documents, access to more than 16,000 scientific Web sites
  • DOE R&D Accomplishments – where you can find remarkable advances in science

Our interagency collaborations:

  • Federal R&D Project Summaries
  • Science.gov: 50 million pages

All-in-all: 35 million transactions per year

Speaker Notes:

Other research results:

  • E-print Network is a searchable gateway to preprints, papers, and other documents circulated among the research community. We now have over 500,000 documents and access to more than 16,000 scientific Web sites.
  • DOE R&D Accomplishments – that's where you can find remarkable advances in science.

And our collaborations:

  • Federal R&D Project Summaries – it's a unique window to the Federal research community, with the capability to search almost half-a-million records from six Federal agencies.
  • Science.gov: Recognizing that the boundaries of science disciplines do not necessarily coincide with organizational boundaries, OSTI championed the interagency development of science.gov, the gateway for R&D results and related government science information with 50 million pages of science information from 12 federal agencies.

All-in-all for OSTI resources, 35 million transactions per year

Slide15
Slide15

OSTI Enhancing Search

  • Making search relevant
  • Fully searchable full text
  • Alert Services
  • Real-time search results
  • Deep Web search

Speaker Notes:

OSTI has sought ways to enhance search, through relevancy ranked results; fully searchable full text, alert services, real-time search results and Deep Web search. Soon we will be coming out with Science.gov 3.0, and continue our push to ease search for our patrons and to send science to desktops everywhere.

Slide15
Slide15

OSTI Enhancing Search

  • Making search relevant
  • Fully searchable full text
  • Alert Services
  • Real-time search results
  • Deep Web search

Speaker Notes:

OSTI has sought ways to enhance search, through relevancy ranked results; fully searchable full text, alert services, real-time search results and Deep Web search. Soon we will be coming out with Science.gov 3.0, and continue our push to ease search for our patrons and to send science to desktops everywhere.

Slide16
Slide16

The Internet and advanced Web tools have created wonderful opportunities

But also great challenges for those along the leading edge in information dissemination

Speaker Notes:

As you can see, just by looking at OSTI's evolution since the 1940s, the world of communication has changed. The Internet and advancing Web tools have created wonderful opportunities, but also great challenges for those along the leading edge in information dissemination.

Slide16
Slide16

The Internet and advanced Web tools have created wonderful opportunities

But also great challenges for those along the leading edge in information dissemination

Speaker Notes:

As you can see, just by looking at OSTI's evolution since the 1940s, the world of communication has changed. The Internet and advancing Web tools have created wonderful opportunities, but also great challenges for those along the leading edge in information dissemination.

Slide17
Slide17

Collaborative search, enhancing knowledge,
advancing science

Global Discovery

Speaker Notes:

We call it Global Discovery, and we must aim for this place just barely within our imaginations, where collaborative search is readily available across all science disciplines to enhance knowledge and advance science.

Slide17
Slide17

Collaborative search, enhancing knowledge,
advancing science

Global Discovery

Speaker Notes:

We call it Global Discovery, and we must aim for this place just barely within our imaginations, where collaborative search is readily available across all science disciplines to enhance knowledge and advance science.

Slide18
Slide18

Global Discovery – Collaborative search, enhancing knowledge, advancing science

The return on investment in science depends on this diffusion of scientific knowledge.

The opportunity exists to build a global community, to massively speed up and expand the diffusion of knowledge.

Slide18
Slide18

Global Discovery – Collaborative search, enhancing knowledge, advancing science

The return on investment in science depends on this diffusion of scientific knowledge.

The opportunity exists to build a global community, to massively speed up and expand the diffusion of knowledge.

Slide20
Slide20

Summary

  • Diffusion of scientific knowledge is subtle and complex
  • May never really be able to fully track or measure it
  • But global discovery is a powerful new approach
Slide20
Slide20

Summary

  • Diffusion of scientific knowledge is subtle and complex
  • May never really be able to fully track or measure it
  • But global discovery is a powerful new approach
Slide19
Slide19

Global Discovery – Collaborative search, enhancing knowledge, advancing science

Full-text search across disciplines

Making available tools to enable researchers to find – and use – the information and data they need, regardless of the discipline.

Slide19
Slide19

Global Discovery – Collaborative search, enhancing knowledge, advancing science

Full-text search across disciplines

Making available tools to enable researchers to find – and use – the information and data they need, regardless of the discipline.

Slide02
Slide02

R&D Deliverables

  • The main deliverable coming out of R&D projects is scientific and technical information (STI)
  • STI takes the form of journal articles, gray literature reports, e-prints
  • Federal STI function:

– Each R&D Agency has an organization dedicated to getting mileage out of its STI

– The DOE organization is the Office of Scientific and Technical Information (OSTI) (www.osti.gov)

Slide02
Slide02

R&D Deliverables

  • The main deliverable coming out of R&D projects is scientific and technical information (STI)
  • STI takes the form of journal articles, gray literature reports, e-prints
  • Federal STI function:

– Each R&D Agency has an organization dedicated to getting mileage out of its STI

– The DOE organization is the Office of Scientific and Technical Information (OSTI) (www.osti.gov)

Slide04
Slide04

Measures of Research Success

  • No perfect tool for measuring research success

  • With billions of dollars spent each year, you have to try

  • OSTI and Science.gov provide new tools and approaches

Slide04
Slide04

Measures of Research Success

  • No perfect tool for measuring research success

  • With billions of dollars spent each year, you have to try

  • OSTI and Science.gov provide new tools and approaches

Slide05
Slide05

Measures of Success

  • There are two measures of success
    • Direct performance
    • Impact on science and technology
      • Long-term
      • Short-term
Slide05
Slide05

Measures of Success

  • There are two measures of success
    • Direct performance
    • Impact on science and technology
      • Long-term
      • Short-term
Slide06
Slide06

Direct Performance

  • Typical–meeting loosely defined goals, targets and milestones, often done by peer review
  • Problem–low value, low risk research may score high
  • No measure of return on investment (ROI)
Slide06
Slide06

Direct Performance

  • Typical–meeting loosely defined goals, targets and milestones, often done by peer review
  • Problem–low value, low risk research may score high
  • No measure of return on investment (ROI)
Slide07
Slide07

Long-Term Impact Assessment
R&D Accomplishments

  • Provide compelling evidence that DOE R&D pays real dividends
  • Provide very incomplete accounting of dividends
  • Tell us very little/nothing about current or recent R&D
Slide07
Slide07

Long-Term Impact Assessment
R&D Accomplishments

  • Provide compelling evidence that DOE R&D pays real dividends
  • Provide very incomplete accounting of dividends
  • Tell us very little/nothing about current or recent R&D
Slide08
Slide08

Short-Term Impact on Science and Technology

  • Impact leads to ROI
  • Problem: impact is diffuse
  • Diffusion is subtle and complex – so hard to measure
  • Hard to see where ROI is occurring
Slide08
Slide08

Short-Term Impact on Science and Technology

  • Impact leads to ROI
  • Problem: impact is diffuse
  • Diffusion is subtle and complex – so hard to measure
  • Hard to see where ROI is occurring
Slide09
Slide09

Typical Short-Term Impact Measure

  • Journal citations
  • Problem: slow and narrow
  • Does not capture the diffusion process
Slide09
Slide09

Typical Short-Term Impact Measure

  • Journal citations
  • Problem: slow and narrow
  • Does not capture the diffusion process
Slide10
Slide10

Citations Are Slow

Results > Proposal > Research > Published with Citation

  • Problem: cycle time is 2-4 years
Slide10
Slide10

Citations Are Slow

Results > Proposal > Research > Published with Citation

  • Problem: cycle time is 2-4 years

More viewing options for this presentation: