| | |
Summary: A Markov Decision Process based Flow Assignment
Framework for Heterogeneous Network Access
Jatinder Pal Singh (jatinder.singh@telekom.de)
Deutsche Telekom Laboratories, 5050 El Camino Real, Los Altos, CA 94022, USA
Tansu Alpcan (tansu.alpcan@telekom.de)
Deutsche Telekom Laboratories, Ernst-Reuter Platz 7, 10587 Berlin, Germany
Piyush Agrawal (piyushag@stanford.edu)
Department of Electrical Engineering, Stanford University, Stanford, CA 94305,
USA
Varun Sharma
Lehman Brothers Inc., India
Abstract. We consider a scenario where devices with multiple networking capabili-
ties access networks with heterogeneous characteristics. In such a setting, we address
the problem of efficient utilization of multiple access networks (wireless and/or
wireline) by devices via optimal assignment of traffic flows with given utilities to
different networks. We develop and analyze a device middleware functionality that
monitors network characteristics and employs a Markov Decision Process (MDP)
based control scheme that in conjunction with stochastic characterization of the
available bit rate and delay of the networks generates an optimal policy for allocation
of flows to different networks. The optimal policy maximizes, under available bit
|
