skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: PDFDataExtractor: A Tool for Reading Scientific Text and Interpreting Metadata from the Typeset Literature in the Portable Document Format

Journal Article · · Journal of Chemical Information and Modeling
 [1]; ORCiD logo [2]
  1. University of Cambridge (United Kingdom). Cavendish Laboratory
  2. University of Cambridge (United Kingdom). Cavendish Laboratory; Harwell Science and Innovation Campus, Didcot (United Kingdom); University of Cambridge (United Kingdom)

The layout of portable document format (PDF) files is constant to any screen, and the metadata therein are latent, compared to mark-up languages such as HTML and XML. No semantic tags are usually provided, and a PDF file is not designed to be edited or its data interpreted by software. However, data held in PDF files need to be extracted in order to comply with opensource data requirements that are now government-regulated. In the chemical domain, related chemical and property data also need to be found, and their correlations need to be exploited to enable data science in areas such as data-driven materials discovery. Such relationships may be realized using text-mining software such as the “chemistry-aware” natural-language-processing tool, ChemDataExtractor; however, this tool has limited data-extraction capabilities from PDF files. This study presents the PDFDataExtractor tool, which can act as a plug-in to ChemDataExtractor. It outperforms other PDF-extraction tools for the chemical literature by coupling its functionalities to the chemical-named entityrecognition capabilities of ChemDataExtractor. The intrinsic PDF-reading abilities of ChemDataExtractor are much improved. The system features a template-based architecture. This enables semantic information to be extracted from the PDF files of scientific articles in order to reconstruct the logical structure of articles. While other existing PDF-extracting tools focus on quantity mining, this template-based system is more focused on quality mining on different layouts. PDFDataExtractor outputs information in JSON and plain text, including the metadata of a PDF file, such as paper title, authors, affiliation, email, abstract, keywords, journal, year, document object identifier (DOI), reference, and issue number. With a self-created evaluation article set, PDFDataExtractor achieved promising precision for all key assessed metadata areas of the document text.

Research Organization:
Argonne National Laboratory (ANL), Argonne, IL (United States); Univ. of Cambridge (United Kingdom)
Sponsoring Organization:
Science & Technology Facilities Council (STFC); USDOE Office of Science (SC)
Grant/Contract Number:
AC02-06CH11357
OSTI ID:
1981870
Journal Information:
Journal of Chemical Information and Modeling, Vol. 62, Issue 7; ISSN 1549-9596
Publisher:
American Chemical SocietyCopyright Statement
Country of Publication:
United States
Language:
English

References (7)

Information Retrieval and Text Mining Technologies for Chemistry journal May 2017
ChemDataExtractor: A Toolkit for Automated Extraction of Chemical Information from the Scientific Literature journal October 2016
PDFX: fully-automated PDF-to-XML conversion of scientific literature
  • Constantin, Alexandru; Pettifer, Steve; Voronkov, Andrei
  • DocEng '13: ACM Symposium on Document Engineering 2013, Proceedings of the 2013 ACM symposium on Document engineering https://doi.org/10.1145/2494266.2494271
conference September 2013
The Oligopoly of Academic Publishers in the Digital Era journal June 2015
CERMINE: automatic extraction of structured metadata from scientific literature journal July 2015
Layout-aware text extraction from full-text PDF of scientific articles journal May 2012
The Stanford CoreNLP Natural Language Processing Toolkit
  • Manning, Christopher; Surdeanu, Mihai; Bauer, John
  • Proceedings of 52nd Annual Meeting of the Association for Computational Linguistics: System Demonstrations https://doi.org/10.3115/v1/P14-5010
conference January 2014