Integrating Natural Language Processing and Machine Learning Algorithms to Categorize Oncologic Response in Radiology Reports
- Hospital of the University of Pennsylvania, Department of Radiology, Perelman School of Medicine (United States)
A significant volume of medical data remains unstructured. Natural language processing (NLP) and machine learning (ML) techniques have shown to successfully extract insights from radiology reports. However, the codependent effects of NLP and ML in this context have not been well-studied. Between April 1, 2015 and November 1, 2016, 9418 cross-sectional abdomen/pelvis CT and MR examinations containing our internal structured reporting element for cancer were separated into four categories: Progression, Stable Disease, Improvement, or No Cancer. We combined each of three NLP techniques with five ML algorithms to predict the assigned label using the unstructured report text and compared the performance of each combination. The three NLP algorithms included term frequency-inverse document frequency (TF-IDF), term frequency weighting (TF), and 16-bit feature hashing. The ML algorithms included logistic regression (LR), random decision forest (RDF), one-vs-all support vector machine (SVM), one-vs-all Bayes point machine (BPM), and fully connected neural network (NN). The best-performing NLP model consisted of tokenized unigrams and bigrams with TF-IDF. Increasing N-gram length yielded little to no added benefit for most ML algorithms. With all parameters optimized, SVM had the best performance on the test dataset, with 90.6 average accuracy and F score of 0.813. The interplay between ML and NLP algorithms and their effect on interpretation accuracy is complex. The best accuracy is achieved when both algorithms are optimized concurrently.
- OSTI ID:
- 22795662
- Journal Information:
- Journal of Digital Imaging (Online), Vol. 31, Issue 2; Other Information: Copyright (c) 2018 Society for Imaging Informatics in Medicine; Country of input: International Atomic Energy Agency (IAEA); ISSN 1618-727X
- Country of Publication:
- United States
- Language:
- English
Similar Records
Machine Learning Classification of Molten Salt Heat Exchanger Channel Plugging using Synthetic Data
Real-Time Canister Welding Health Monitoring and Prediction System for Spent Fuel Dry Storage