Feature Subset Selection, Class Separability, and Genetic Algorithms
The performance of classification algorithms in machine learning is affected by the features used to describe the labeled examples presented to the inducers. Therefore, the problem of feature subset selection has received considerable attention. Genetic approaches to this problem usually follow the wrapper approach: treat the inducer as a black box that is used to evaluate candidate feature subsets. The evaluations might take a considerable time and the traditional approach might be unpractical for large data sets. This paper describes a hybrid of a simple genetic algorithm and a method based on class separability applied to the selection of feature subsets for classification problems. The proposed hybrid was compared against each of its components and two other feature selection wrappers that are used widely. The objective of this paper is to determine if the proposed hybrid presents advantages over the other methods in terms of accuracy or speed in this problem. The experiments used a Naive Bayes classifier and public-domain and artificial data sets. The experiments suggest that the hybrid usually finds compact feature subsets that give the most accurate results, while beating the execution time of the other wrappers.
- Research Organization:
- Lawrence Livermore National Lab. (LLNL), Livermore, CA (United States)
- Sponsoring Organization:
- USDOE
- DOE Contract Number:
- W-7405-ENG-48
- OSTI ID:
- 15013963
- Report Number(s):
- UCRL-CONF-202041; TRN: US200803%%795
- Resource Relation:
- Journal Volume: 3102; Conference: Presented at: Genetic and Evolutionary Computation Conference, Seattle, WA, United States, Jun 26 - Jun 30, 2004
- Country of Publication:
- United States
- Language:
- English
Similar Records
WE-E-17A-02: Predictive Modeling of Outcome Following SABR for NSCLC Based On Radiomics of FDG-PET Images
GENIE: A HYBRID GENETIC ALGORITHM FOR FEATURE CLASSIFICATION IN MULTI-SPECTRAL IMAGES