Advanced Search

Browse by Discipline

Scientific Societies

E-print Alerts

Add E-prints

E-print Network

  Advanced Search  

Assessing and Comparing Classification Algorithms Ethem Alpaydn

Summary: Assessing and Comparing Classification Algorithms
Ethem Alpaydn
Department of Computer Engineering
Bo–gazic›i University
TR­80815 Istanbul, Turkey
Machine learning algorithms induce classifiers that depend on the training set and hyperparameters and there is a need for statistical testing for
(i) assessing the expected error rate of a classifier, and (ii) comparing the expected error rates of two classifiers. We review interval estimation
and hypothesis testing and discuss three tests for error rate assessment and four tests for error rate comparison.
1 Introduction
In the machine learning literature, there are several classifi­
cation algorithms and given a certain application, more than
one is applicable. In this paper, we are concerned with two
1. How can we assess the error rate of a classifier induced
by an algorithm ?
2. Given two classification algorithms, how can we say
one is better than the other one, for a given application ?
The classifiers compared can be trained with different


Source: Alpaydın, Ethem - Department of Computer Engineering, Bogaziçi University


Collections: Computer Technologies and Information Sciences