ParaText : scalable text analysis and visualization.
Automated analysis of unstructured text documents (e.g., web pages, newswire articles, research publications, business reports) is a key capability for solving important problems in areas including decision making, risk assessment, social network analysis, intelligence analysis, scholarly research and others. However, as data sizes continue to grow in these areas, scalable processing, modeling, and semantic analysis of text collections becomes essential. In this paper, we present the ParaText text analysis engine, a distributed memory software framework for processing, modeling, and analyzing collections of unstructured text documents. Results on several document collections using hundreds of processors are presented to illustrate the exibility, extensibility, and scalability of the the entire process of text modeling from raw data ingestion to application analysis.
- Research Organization:
- Sandia National Laboratories (SNL), Albuquerque, NM, and Livermore, CA (United States)
- Sponsoring Organization:
- USDOE
- DOE Contract Number:
- AC04-94AL85000
- OSTI ID:
- 1021689
- Report Number(s):
- SAND2010-4595C; TRN: US201117%%283
- Resource Relation:
- Conference: Proposed for presentation at the SIAM Annual Meeting held July 12-16, 2010 in Pittsburgh, PA.
- Country of Publication:
- United States
- Language:
- English
Similar Records
TexTonic: Interactive Visualization for Exploration and discovery of Very Large Text Collections
ParaText : scalable solutions for processing and searching very large document collections : final LDRD report.