Summary: ETHEM ALPAYDIN
© The MIT Press, 2010
alpaydin@boun.edu.tr
http://www.cmpe.boun.edu.tr/~ethem/i2ml2e
Lecture Slides for
Nonparametric Estimation
Parametric (single global model), semiparametric (small
number of local models)
Nonparametric: Similar inputs have similar outputs
Functions (pdf, discriminant, regression) change smoothly
Keep the training data;"let the data speak for itself"
Given x, find a small number of closest training instances
and interpolate from these
Aka lazy/memory-based/case-based/instance-based
learning
3Lecture Notes for E Alpaydin 2010 Introduction to Machine Learning 2e © The MIT Press (V1.0)
 Given the training set X={xt}t drawn iid from p(x)
Divide data into bins of size h
Histogram:
Naive estimator:

Source: Alpaydýn, Ethem - Department of Computer Engineering, Bogaziçi University

Collections: Computer Technologies and Information Sciences