Home

About

Advanced Search

Browse by Discipline

Scientific Societies

E-print Alerts

Add E-prints

E-print Network
FAQHELPSITE MAPCONTACT US


  Advanced Search  

 
The Third Claude E. Shannon Memorial Lecture
 

Summary: The Third Claude E. Shannon
Memorial Lecture
April 29, 2005
Are There Turbo-Codes on Mars?
Robert J. McEliece
California Institute of Technology
"The fundamental problem of communication is that of
reproducing at one point either exactly or approximately a
message selected at another point."
To solve this problem, Shannon created a branch of applied
mathematics which is today called
Information Theory...
Information Theory
1101
Relative entropy H(X|Y) measures our
uncertainty about X after Y is observed
Entropy
H(X) = -
x
p(x) log p(x)

  

Source: Adolphs, Ralph - Psychology and Neuroscience, California Institute of Technology

 

Collections: Biology and Medicine