DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Analysis and Benchmarking of feature reduction for classification under computational constraints

Journal Article · · Machine Learning: Science and Technology

Abstract Machine learning is most often expensive in terms of computational and memory costs due to training with large volumes of data. Current computational limitations of many computing systems motivate us to investigate practical approaches, such as feature selection and reduction, to reduce the time and memory costs while not sacrificing the accuracy of classification algorithms. In this work, we carefully review, analyze, and identify the feature reduction methods that have low costs/overheads in terms of time and memory. Then, we evaluate the identified reduction methods in terms of their impact on the accuracy, precision, time, and memory costs of traditional classification algorithms. Specifically, we focus on the least resource intensive feature reduction methods that are available in Scikit-Learn library. Since our goal is to identify the best performing low-cost reduction methods, we do not consider complex expensive reduction algorithms in this study. In our evaluation, we find that at quadratic-scale feature reduction, the classification algorithms achieve the best trade-off among competitive performance metrics. Results show that the overall training times are reduced 61%, the model sizes are reduced 6×, and accuracy scores increase 25% compared to the baselines on average with quadratic scale reduction.

Sponsoring Organization:
USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR); USDOE
Grant/Contract Number:
DEAC06-76RL01830
OSTI ID:
2336619
Alternate ID(s):
OSTI ID: 2327050
Journal Information:
Machine Learning: Science and Technology, Journal Name: Machine Learning: Science and Technology Vol. 5 Journal Issue: 2; ISSN 2632-2153
Publisher:
IOP PublishingCopyright Statement
Country of Publication:
United Kingdom
Language:
English

References (15)

Challenges in Deploying Machine Learning: A Survey of Case Studies journal December 2022
Deep Learning: A Comprehensive Overview on Techniques, Taxonomy, Applications and Research Directions journal August 2021
Gene Selection for Cancer Classification using Support Vector Machines journal January 2002
A survey on deep learning and its applications journal May 2021
Stability of Ranked Gene Lists in Large Microarray Analysis Studies journal January 2010
Feature dimensionality reduction: a review journal January 2022
Overview and comparative study of dimensionality reduction techniques for high dimensional data journal July 2020
Performance of feature-selection methods in the classification of high-dimension data journal March 2009
A Survey on Distributed Machine Learning journal March 2021
Benchmark for filter methods for feature selection in high-dimensional classification data journal March 2020
A review of unsupervised feature selection methods journal January 2019
An evaluation of feature selection methods for environmental data journal March 2021
The impact of feature reduction techniques on defect prediction models journal January 2019
Empirical study of feature selection methods based on individual feature evaluation for classification problems journal July 2011
Machine Learning at the Network Edge: A Survey journal October 2021