
- Continuous-Time Markov Decision Processes 243 Vidale M.L. and Wolfe H.B. (1957). An Operations Research Study of Sales
- M d e ls d Disc re te Ev e nt Dy n m ic xi-RencndYu-Chi H
- Basic Ideas for Event-Based Optimization of Markov Systems
- Automatica 44 (2008) 10551061 www.elsevier.com/locate/automatica
- IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 49, NO. 12, DECEMBER 2004 2129 The Potential Structure of Sample Paths and
- 696 IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 50, NO. 5, MAY 2005 A Basic Formula for Online Policy Gradient Algorithms
- Discrete Event Dynamic Systems: Theory and Applications, 13, 939, 2003 # 2003 Kluwer Academic Publishers. Manufactured in The Netherlands.
- 1112 IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 47, NO. 7, JULY 2002 IV. CONCLUSION
- RECURSIVE APPROACHES FOR SINGLE SAMPLE PATH BASED MARKOV REWARD PROCESSES
- 482 IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY, VOL. 6, NO. 4, JULY 1998 Algorithms for Sensitivity Analysis of Markov
- 1382 IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 42, NO. 10, OCTOBER 1997 Perturbation Realization, Potentials, and
- IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 51, NO. 4, APRIL 2006 595 Generalized LQR Control and Kalman Filtering With
- *Corresponding author. Tel.: #65-790-6973; fax: #65-791-0128; e-mail: ejzhu@ntu.edu.sg Signal Processing 76 (1999) 105}115
- Partially Observable Markov Decision Processes With Reward Information
- Constructing Performance Sensitivities of Markov Systems with Potentials as Building Blocks
- Preface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . VII 1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
- 126 IEEE CONTROL SYSTEMS MAGAZINE DECEMBER 2008 1066-033X/08/$25.002008IEEE is then given to reveal the relationship between state-space
- SIAM J. CONTROL OPTIM. c 2005 Society for Industrial and Applied Mathematics Vol. 44, No. 1, pp. 2948
- Discrete Event Dynamic Systems: Theory and Applications, 12, 253264, 2002 # 2002 Kluwer Academic Publishers. Manufactured in The Netherlands.
- Stochastic Learning and Optimization
- Automatica 40 (2004) 17491759 www.elsevier.com/locate/automatica
- IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 52, NO. 4, APRIL 2007 677 Technical Notes and Correspondence
- Dear Editor: Attached below is a memo that was based on my own observations. The memo illustrates, by
- Wireless Networks 9, 393402, 2003 2003 Kluwer Academic Publishers. Manufactured in The Netherlands.
- Statistical Bounds on the Drop Probability of Assured Forwarding Services in DiffServ Interior Nodes under the Processor Sharing Scheduling Discipline
- IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 51, NO. 10, OCTOBER 2006 1699 j + brN(kr)_kr: (5.8)
- IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS--II: ANALOG AND DIGITAL SIGNAL PROCESSING, VOL. 46, NO. 6, JUNE 1999 755 A Blind Fractionally Spaced Equalizer
- IEEE Communications Magazine April 200054 QoS-Enabled Voice Support in the
- PotentialBased Online Policy Iteration Algorithms for Markov Decision Processes
- 208 IEEE/ACM TRANSACTIONS ON NETWORKING, VOL. 10, NO. 2, APRIL 2002 Internet Pricing With a Game Theoretical Approach
- Automatica 42 (2006) 393403 www.elsevier.com/locate/automatica
- IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 53, NO. 8, AUGUST 2005 2635 Nonlinear Adaptive Blind Whitening
- A System Theoretic Perspective of Learning and Optimization Xi-Ren Cao*
- IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, VOL. 17, NO. 3, MARCH 1999 411 Column-Anchored Zeroforcing Blind Equalization
- 1214 IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 48, NO. 5, MAY 2002 [31] S. Ohno, Y. Inouye, and K. Tanebe, "A numerical algorithm for
- Automatica 38 (2002) 929943 www.elsevier.com/locate/automatica
- 758 IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 48, NO. 5, MAY 2003 Semi-Markov Decision Problems and Performance
- 1676 IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 48, NO. 9, SEPTEMBER 2003 Book Review_____________________________________________________________________________
- 1222 IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 42, NO. 9, SEPTEMBER 1997 Controllability is Not Necessary for
- Queueing Syst (2006) 53:127145 DOI 10.1007/s11134-006-8306-0
- Discrete Event Dyn Syst (2011) 21:1138 DOI 10.1007/s10626-010-0093-4
- 496 IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 53, NO. 2, MARCH 2008 The nth-Order Bias Optimality for Multichain
- Stochastic learning and optimization--A sensitivity-based approach Department of Electronic and Computer Engineering, The Hong Kong University of Science and Technology, Clear Water Bay, Kowloon, Hong Kong, China
- Completion-of-squares: revisited and extended$ De-Xin Wanga
- Discrete Event Dyn Syst (2010) 20:317 DOI 10.1007/s10626-009-0078-3
- Automatica 45 (2009) 16281638 Contents lists available at ScienceDirect
- Automatica 45 (2009) 16391648 Contents lists available at ScienceDirect
- IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 56, NO. 5, MAY 2011 1097 Lebesgue-Sampling-Based Optimal Control Problems
- 1076 IEEE TRANSACTIONS ON AUTOMATIC CONTROL, VOL. 53, NO. 4, MAY 2008 is given as