Creating ensembles of decision trees through sampling

Kamath, Chandrika; Cantu-Paz, Erick

Title: Creating ensembles of decision trees through sampling

Full Record
Other Related Research

Abstract

A system for decision tree ensembles that includes a module to read the data, a module to sort the data, a module to evaluate a potential split of the data according to some criterion using a random sample of the data, a module to split the data, and a module to combine multiple decision trees in ensembles. The decision tree method is based on statistical sampling techniques and includes the steps of reading the data; sorting the data; evaluating a potential split according to some criterion using a random sample of the data, splitting the data, and combining multiple decision trees in ensembles.

Inventors:: Kamath, Chandrika; Cantu-Paz, Erick

Issue Date:: 2005-08-30

Research Org.:: Univ. of California, Oakland, CA (United States)

Sponsoring Org.:: USDOE

OSTI Identifier:: 1175481

Patent Number(s):: 6938049

Application Number:: 10/167,892

Assignee:: The Regents of the University of California (Oakland, CA)

Patent Classifications (CPCs):: G - PHYSICS G06 - COMPUTING G06N - COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS

Y - NEW / CROSS SECTIONAL TECHNOLOGIES Y10 - TECHNICAL SUBJECTS COVERED BY FORMER USPC Y10S - TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS

Show more

G - PHYSICS G06 - COMPUTING G06N - COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
G06N5/022 - {Knowledge engineering

Y - NEW / CROSS SECTIONAL TECHNOLOGIES Y10 - TECHNICAL SUBJECTS COVERED BY FORMER USPC Y10S - TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
Y10S707/99943 - Generating database or data structure, e.g. via user interface

G - PHYSICS G06 - COMPUTING G06K - RECOGNITION OF DATA
G06K9/6282 - {Tree-organised sequential classifiers}

Show less

DOE Contract Number:: W-7405-ENG-48

Resource Type:: Patent

Country of Publication:: United States

Language:: English

Subject:: 97 MATHEMATICS AND COMPUTING

Citation Formats


                    Kamath, Chandrika, and Cantu-Paz, Erick. Creating ensembles of decision trees through sampling.  United States: N. p., 2005. 
        Web.

Copy to clipboard


                    Kamath, Chandrika, & Cantu-Paz, Erick. Creating ensembles of decision trees through sampling.  United States.

Copy to clipboard


                    Kamath, Chandrika, and Cantu-Paz, Erick. Tue .  
        "Creating ensembles of decision trees through sampling".  United States.  https://www.osti.gov/servlets/purl/1175481.

Copy to clipboard


                    
@article{osti_1175481,

  title        = {Creating ensembles of decision trees through sampling},

  author       = {Kamath, Chandrika and Cantu-Paz, Erick},

  abstractNote = {A system for decision tree ensembles that includes a module to read the data, a module to sort the data, a module to evaluate a potential split of the data according to some criterion using a random sample of the data, a module to split the data, and a module to combine multiple decision trees in ensembles. The decision tree method is based on statistical sampling techniques and includes the steps of reading the data; sorting the data; evaluating a potential split according to some criterion using a random sample of the data, splitting the data, and combining multiple decision trees in ensembles.},

  doi          = {},

  journal      = {},
number       = ,

  volume       = ,

  place        = {United States},

  year         = {2005},

  month        = {8}

}

Copy to clipboard

Patent:

Save / Share:

Export Metadata

Save to My Library

Similar Records in DOE Patents and OSTI.GOV collections:

Creating ensembles of oblique decision trees with evolutionary algorithms and sampling

Patent Cantu-Paz, Erick [Oakland, CA]; Kamath, Chandrika [Tracy, CA]

A decision tree system that is part of a parallel object-oriented pattern recognition system, which in turn is part of an object oriented data mining system. A decision tree process includes the step of reading the data. If necessary, the data is sorted. A potential split of the data is evaluated according to some criterion. An initial split of the data is determined. The final split of the data is determined using evolutionary algorithms and statistical sampling techniques. The data is split. Multiple decision trees are combined in ensembles.
Full Text Available
Using histograms to introduce randomization in the generation of ensembles of decision trees

Patent Kamath, Chandrika; Cantu-Paz, Erick; Littau, David

A system for decision tree ensembles that includes a module to read the data, a module to create a histogram, a module to evaluate a potential split according to some criterion using the histogram, a module to select a split point randomly in an interval around the best split, a module to split the data, and a module to combine multiple decision trees in ensembles. The decision tree method includes the steps of reading the data; creating a histogram; evaluating a potential split according to some criterion using the histogram, selecting a split point randomly in an interval around themore » « less
Full Text Available
Creating ensembles of decision trees through sampling

Conference Kamath, C; Cantu-Paz, E

Recent work in classification indicates that significant improvements in accuracy can be obtained by growing an ensemble of classifiers and having them vote for the most popular class. This paper focuses on ensembles of decision trees that are created with a randomized procedure based on sampling. Randomization can be introduced by using random samples of the training data (as in bagging or arcing) and running a conventional tree-building algorithm, or by randomizing the induction algorithm itself. The objective of this paper is to describe our first experiences with a novel randomized tree induction method that uses a subset of samplesmore » « less
Full Text Available
Creating Ensembles of Decision Trees Through Sampling

Conference Kamath, C; Cantu-Paz, E

Recent work in classification indicates that significant improvements in accuracy can be obtained by growing an ensemble of classifiers and having them vote for the most popular class. This paper focuses on ensembles of decision trees that are created with a randomized procedure based on sampling. Randomization can be introduced by using random samples of the training data (as in bagging or boosting) and running a conventional tree-building algorithm, or by randomizing the induction algorithm itself. The objective of this paper is to describe the first experiences with a novel randomized tree induction method that uses a sub-sample of instancesmore » « less
Full Text Available
Parallel object-oriented decision tree system

Patent Kamath, Chandrika; Cantu-Paz, Erick

A data mining decision tree system that uncovers patterns, associations, anomalies, and other statistically significant structures in data by reading and displaying data files, extracting relevant features for each of the objects, and using a method of recognizing patterns among the objects based upon object features through a decision tree that reads the data, sorts the data if necessary, determines the best manner to split the data into subsets according to some criterion, and splits the data.
Full Text Available

Similar Records