Citations and Readership are Poor Indicators of Research Excellence
In this paper we show that citation counts and Mendeley readership are poor indicators of research excellence. Our experimental design builds on the assumption that a good evaluation metric should be able to distinguish publications that have changed a research field from those that have not. The experiment has been conducted on a new dataset for bibliometric research which we call TrueImpactDataset. TrueImpactDataset is a collection of research publications of two types -- research papers which are considered seminal work in their area and papers which provide a survey (a literature review) of a research area. The dataset also contains related metadata, which include DOIs, titles, authors and abstracts. We describe how the dataset was built and provide overview statistics of the dataset. We propose to use the dataset for validating research evaluation metrics. By using this data, we show that widely used research metrics only poorly distinguish excellent research.
- Research Organization:
- Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)
- Sponsoring Organization:
- USDOE
- DOE Contract Number:
- AC05-00OR22725
- OSTI ID:
- 1400214
- Resource Relation:
- Conference: ACM International Conference on Web Search and Data Mining - Cambridge, , United Kingdom - 2/6/2017 12:00:00 AM-2/10/2017 12:00:00 AM
- Country of Publication:
- United States
- Language:
- English
Similar Records
TH-C-204-00: Medical Physics Workshop: An Update On the Journal’s Improvement Activities and Guidance On Writing and Reviewing Papers
TH-C-204-01: Vision for Medical Physics and Status of Current Initiatives