Link Analysis for Solving Multiple-Access MDPs With Large State Spaces

Bozkus, Talha; Mitra, Urbashi

doi:10.1109/tsp.2023.3260562

Link Analysis for Solving Multiple-Access MDPs With Large State Spaces

Journal Article · 31 December 2022 · IEEE Transactions on Signal Processing

DOI:https://doi.org/10.1109/tsp.2023.3260562· OSTI ID:2421929

^[1]; ^[2]

Ming Hsieh Department of Electrical and Computer Engineering, University of Southern California, Los Angeles, CA, USA; OSTI
Ming Hsieh Department of Electrical and Computer Engineering, University of Southern California, Los Angeles, CA, USA

Not provided.

Research Organization:: Univ. of Southern California, Los Angeles, CA (United States)

Sponsoring Organization:: USDOE Office of Science (SC)

DOE Contract Number:: SC0021417

OSTI ID:: 2421929

Journal Information:: IEEE Transactions on Signal Processing, Journal Name: IEEE Transactions on Signal Processing Vol. 71; ISSN 1053-587X

Publisher:: IEEE

Country of Publication:: United States

Language:: English

References (41)

Online learning in wireless networks via directed graph lifting transform Gjika, Apostol T.; Levorato, Marco; Ortega, Antonio 2012 50th Annual Allerton Conference on Communication, Control, and Computing (Allerton) https://doi.org/10.1109/Allerton.2012.6483328	conference	October 2012
On Sampled Reinforcement Learning in Wireless Networks: Exploitation of Policy Structures Liu, Libin; Mitra, Urbashi IEEE Transactions on Communications, Vol. 68, Issue 5 https://doi.org/10.1109/TCOMM.2020.2974216	journal	May 2020
Minimizing the Age of Information of Cognitive Radio-Based IoT Systems Under a Collision Constraint Wang, Qian; Chen, He; Gu, Yifan IEEE Transactions on Wireless Communications, Vol. 19, Issue 12 https://doi.org/10.1109/TWC.2020.3019056	journal	December 2020
Optimal Probabilistic Policy for Dynamic Resource Activation Using Markov Decision Process in Green Wireless Networks Kong, Peng-Yong IEEE Transactions on Mobile Computing, Vol. 13, Issue 10 https://doi.org/10.1109/TMC.2014.2307328	journal	October 2014
Deep Deterministic Policy Gradient (DDPG)-Based Energy Harvesting Wireless Communications Qiu, Chengrun; Hu, Yang; Chen, Yan IEEE Internet of Things Journal, Vol. 6, Issue 5 https://doi.org/10.1109/JIOT.2019.2921159	journal	October 2019
Online policies for multiple access channel with common energy harvesting source Baknina, Abdulrahman; Ulukus, Sennur 2016 IEEE International Symposium on Information Theory (ISIT) https://doi.org/10.1109/ISIT.2016.7541797	conference	July 2016
Laplacians and the Cheeger Inequality for Directed Graphs Chung, Fan Annals of Combinatorics, Vol. 9, Issue 1 https://doi.org/10.1007/s00026-005-0237-z	journal	April 2005
Applied Numerical Linear Algebra Demmel, James W. Society for Industrial and Applied Mathematics https://doi.org/10.1137/1.9781611971446	book	January 1997
Reduced dimension policy iteration for wireless network control via multiscale analysis Levorato, Marco; Narang, Sunil; Mitra, Urbashi 2012 IEEE Global Communications Conference (GLOBECOM) https://doi.org/10.1109/GLOCOM.2012.6503723	conference	December 2012
MIMO Transmission Control in Fading Channels—A Constrained Markov Decision Process Formulation With Monotone Randomized Policies Djonin, Dejan V.; Krishnamurthy, Vikram IEEE Transactions on Signal Processing, Vol. 55, Issue 10 https://doi.org/10.1109/TSP.2007.897859	journal	October 2007
On Solving MDPs With Large State Space: Exploitation of Policy Structures and Spectral Properties Liu, Libin; Chattopadhyay, Arpan; Mitra, Urbashi IEEE Transactions on Communications, Vol. 67, Issue 6 https://doi.org/10.1109/TCOMM.2019.2899620	journal	June 2019
Optimal Kullback-Leibler Aggregation via Spectral Theory of Markov Chains Deng, Kun; Mehta, Prashant G.; Meyn, Sean P. IEEE Transactions on Automatic Control, Vol. 56, Issue 12 https://doi.org/10.1109/TAC.2011.2141350	journal	December 2011
Analyzing feature generation for value-function approximation Parr, Ronald; Painter-Wakefield, Christopher; Li, Lihong Proceedings of the 24th international conference on Machine learning https://doi.org/10.1145/1273496.1273589	conference	June 2007
Value Function Approximation in Reinforcement Learning Using the Fourier Basis Konidaris, George; Osentoski, Sarah; Thomas, Philip Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 25, Issue 1 https://doi.org/10.1609/aaai.v25i1.7903	journal	August 2011
Symmetrizations for clustering directed graphs Satuluri, Venu; Parthasarathy, Srinivasan Proceedings of the 14th International Conference on Extending Database Technology https://doi.org/10.1145/1951365.1951407	conference	March 2011
Weight-Discounted Symmetrization in Clustering Directed Graphs He, Bin; Liu, Hui; Zhao, Xiang Hui Advanced Materials Research, Vol. 756-759 https://doi.org/10.4028/www.scientific.net/AMR.756-759.2979	journal	September 2013
An analysis of linear models, linear value-function approximation, and feature selection for reinforcement learning Parr, Ronald; Li, Lihong; Taylor, Gavin Proceedings of the 25th international conference on Machine learning - ICML '08 https://doi.org/10.1145/1390156.1390251	conference	January 2008
Finite-state Markov channel-a useful model for radio communication channels No authors listed IEEE Transactions on Vehicular Technology, Vol. 44, Issue 1 https://doi.org/10.1109/25.350282	journal	February 1995
Graph Signal Processing: Overview, Challenges, and Applications Ortega, Antonio; Frossard, Pascal; Kovacevic, Jelena Proceedings of the IEEE, Vol. 106, Issue 5 https://doi.org/10.1109/JPROC.2018.2820126	journal	May 2018
Optimal Scheduling Strategy for Networked Estimation With Energy Harvesting Vasconcelos, Marcos M.; Gagrani, Mukul; Nayyar, Ashutosh IEEE Transactions on Control of Network Systems, Vol. 7, Issue 4 https://doi.org/10.1109/TCNS.2020.2997191	journal	December 2020
An optimal energy allocation algorithm for energy harvesting wireless sensor networks Mao, Shaobo; Cheung, Man Hon; Wong, Vincent W. S. 2012 IEEE International Conference on Communications (ICC) https://doi.org/10.1109/ICC.2012.6364174	conference	June 2012
A survey of Markov decision models for control of networks of queues Stidham, Shaler; Weber, Richard Queueing Systems, Vol. 13, Issue 1-3 https://doi.org/10.1007/BF01158935	journal	March 1993
Optimal energy management policies for energy harvesting sensor nodes Sharma, Vinod; Mukherji, Utpal; Joseph, Vinay IEEE Transactions on Wireless Communications, Vol. 9, Issue 4 https://doi.org/10.1109/TWC.2010.04.080749	journal	April 2010
Optimizing age of information in wireless networks with perfect channel state information Talak, Rajat; Karaman, Sertac; Modiano, Eytan 2018 16th International Symposium on Modeling and Optimization in Mobile, Ad Hoc, and Wireless Networks (WiOpt) https://doi.org/10.23919/WIOPT.2018.8362818	conference	May 2018
Discrete Signal Processing on Graphs Sandryhaila, Aliaksei; Moura, José M. F. IEEE Transactions on Signal Processing, Vol. 61, Issue 7 https://doi.org/10.1109/TSP.2013.2238935	journal	April 2013
On the Design of Temporal Compression Strategies for Energy Harvesting Sensor Networks Zordan, Davide; Melodia, Tommaso; Rossi, Michele IEEE Transactions on Wireless Communications, Vol. 15, Issue 2 https://doi.org/10.1109/TWC.2015.2489200	journal	February 2016
Effective Resistance Preserving Directed Graph Symmetrization Fitch, Katherine SIAM Journal on Matrix Analysis and Applications, Vol. 40, Issue 1 https://doi.org/10.1137/18M1172892	journal	January 2019
Optimal transmission scheduling over a fading channel with energy and deadline constraints Fu, A.; Modiano, E.; Tsitsiklis, J. N. IEEE Transactions on Wireless Communications, Vol. 5, Issue 3 https://doi.org/10.1109/TWC.2006.1611093	journal	March 2006
Deep Reinforcement Learning for Joint Spectrum and Power Allocation in Cellular Networks Nasir, Yasar Sinan; Guo, Dongning 2021 IEEE Globecom Workshops (GC Wkshps) https://doi.org/10.1109/GCWkshps52748.2021.9681985	conference	December 2021
Structural Properties of Optimal Transmission Policies for Delay-Sensitive Energy Harvesting Wireless Sensors Sharma, Nikhilesh; Mastronarde, Nicholas; Chakareski, Jacob 2018 IEEE International Conference on Communications (ICC) https://doi.org/10.1109/ICC.2018.8422092	conference	May 2018
Interference-Aware Cooperative Anti-Jamming Distributed Channel Selection in UAV Communication Networks Xu, Yifan; Ren, Guochun; Chen, Jin Applied Sciences, Vol. 8, Issue 10 https://doi.org/10.3390/app8101911	journal	October 2018
Generalized connection graph method for synchronization in asymmetrical networks Belykh, Igor; Belykh, Vladimir; Hasler, Martin Physica D: Nonlinear Phenomena, Vol. 224, Issue 1-2 https://doi.org/10.1016/j.physd.2006.09.014	journal	December 2006
Optimal and suboptimal scheduling over time varying flat fading channels Djonin, D. V.; Karmokar, A. K.; Bhargava, V. K. 2004 IEEE International Conference on Communications (IEEE Cat. No.04CH37577) https://doi.org/10.1109/ICC.2004.1312633	conference	January 2004
Circulant Matrices and Their Application to Vibration Analysis Olson, Brian J.; Shaw, Steven W.; Shi, Chengzhi Applied Mechanics Reviews, Vol. 66, Issue 4 https://doi.org/10.1115/1.4027722	journal	June 2014
Structure-based learning in wireless networks via sparse approximation Levorato, Marco; Mitra, Urbashi; Goldsmith, Andrea EURASIP Journal on Wireless Communications and Networking, Vol. 2012, Issue 1 https://doi.org/10.1186/1687-1499-2012-278	journal	August 2012
Online power control for the energy harvesting multiple access channel Inan, Huseyin A.; Ozgur, Ayfer 2016 14th International Symposium on Modeling and Optimization in Mobile, Ad Hoc, and Wireless Networks (WiOpt) https://doi.org/10.1109/WIOPT.2016.7492898	conference	May 2016
Learning Resilient Radio Resource Management Policies With Graph Neural Networks NaderiAlizadeh, Navid; Eisen, Mark; Ribeiro, Alejandro IEEE Transactions on Signal Processing, Vol. 71 https://doi.org/10.1109/TSP.2023.3255547	journal	January 2023
Harmonic analysis on directed graphs and applications: From Fourier analysis to wavelets Sevi, Harry; Rilling, Gabriel; Borgnat, Pierre Applied and Computational Harmonic Analysis, Vol. 62 https://doi.org/10.1016/j.acha.2022.10.003	journal	January 2023
Sequential Decision Algorithms for Measurement-Based Impromptu Deployment of a Wireless Relay Network Along a Line Chattopadhyay, Arpan; Coupechoux, Marceau; Kumar, Anurag IEEE/ACM Transactions on Networking, Vol. 24, Issue 5 https://doi.org/10.1109/TNET.2015.2496721	journal	October 2016
Energy Efficient Transmission in Multi-User MIMO Relay Channels With Perfect and Imperfect Channel State Information Gong, Shiqi; Xing, Chengwen; Yang, Nan IEEE Transactions on Wireless Communications, Vol. 16, Issue 6 https://doi.org/10.1109/TWC.2017.2689769	journal	June 2017
Optimal packet scheduling in a multiple access channel with energy harvesting transmitters Yang, Jing; Ulukus, Sennur Journal of Communications and Networks, Vol. 14, Issue 2 https://doi.org/10.1109/JCN.2012.6253062	journal	April 2012

Similar Records

A Generalized Framework for Social Learning Over State-Dependent Networks

Journal Article · 2023 · IEEE Transactions on Signal Processing · OSTI ID:2579880

Channel State Information-Free Location-Privacy Enhancement: Fake Path Injection

Journal Article · 2023 · IEEE Transactions on Signal Processing · OSTI ID:2579879

Informatics Strategies for Large-Scale Novel Cross-linking Analysis

Journal Article · 2007 · Journal of Proteome Research, 6(9):3412-3421 · OSTI ID:921366

Related Subjects

Engineering

Link Analysis for Solving Multiple-Access MDPs With Large State Spaces

Citation Formats

References (41)

Similar Records

Related Subjects