Advanced Search

Browse by Discipline

Scientific Societies

E-print Alerts

Add E-prints

E-print Network

  Advanced Search  

Foundations of Stochastic Processes 048868 Due 09:00, July 19, either by hand to Meir 1233 or electronically to

Summary: Foundations of Stochastic Processes 048868
Final Exam
Due 09:00, July 19, either by hand to Meir 1233 or electronically to
The exam might seem long, but, in the unforgettable words of The Hitch-
hiker's Guide to the Galaxy,
The reason each question is so long is that I broke it into small pieces so
that if there is one step that you cannot do you can still go on from there
to the next one.
Question 1: My home is equidistant to a cake shop and a chocolate shop,
and each day I choose, at random, to go to one of these shops to buy either
a cake or a chocolate for breakfast.
On the first day, I have no preference for either shop, and so choose
between them with equal probabilities. However, both the cakes and the
chocolates are very tasty, and so the positive reinforcement I get from my
choice affects my probabilities for later days, in the following fashion:
Let Nn be the number of times that I have visited the cake shop after n
days. Then, given the entire history of the process up to and including day
n, the probability of choosing the cake shop on day n + 1 is


Source: Adler, Robert J. - Faculty of Industrial Engineering and Management, Technion, Israel Institute of Technology


Collections: Mathematics; Engineering