Demonstration of distributed collaborative learning with end-to-end QoT estimation in multi-domain elastic optical networks
Abstract
This paper proposes a distributed collaborative learning approach for cognitive and autonomous multi-domain elastic optical networking (EON). The proposed approach exploits a knowledge-defined networking framework which leverages a broker plane to coordinate the operations of multiple EON domains and applies machine learning (ML) to support autonomous and cognitive inter-domain service provisioning. By employing multiple distributed ML blocks learning domain-level features and working with broker plane aggregation ML blocks (through the chain rule-based training), the proposed approach enables to develop cognitive networking applications that can fully exploit the multi-domain EON states while obviating the need for the raw and confidential intra-domain data. In particular, we investigate end-to-end quality-of transmission estimation application using the distributed learning approach and propose three estimator designs incorporating the concepts of multi-task learning (MTL) and transfer learning (TL). Evaluations with experimental data demonstrate that the proposed designs can achieve estimation accuracies very close to (with differences less than 0.5%) or even higher than (with MTL/TL) those of the baseline models assuming full domain visibility.
- Authors:
- Publication Date:
- Research Org.:
- Univ. of California, Davis, CA (United States)
- Sponsoring Org.:
- USDOE Office of Science (SC)
- OSTI Identifier:
- 1607569
- Alternate Identifier(s):
- OSTI ID: 1803081
- Grant/Contract Number:
- SC0016700
- Resource Type:
- Published Article
- Journal Name:
- Optics Express
- Additional Journal Information:
- Journal Name: Optics Express Journal Volume: 27 Journal Issue: 24; Journal ID: ISSN 1094-4087
- Publisher:
- Optical Society of America
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSICS; Optics
Citation Formats
Chen, Xiaoliang, Li, Baojia, Proietti, Roberto, Liu, Che-Yu, Zhu, Zuqing, and Ben Yoo, S. J. Demonstration of distributed collaborative learning with end-to-end QoT estimation in multi-domain elastic optical networks. United States: N. p., 2019.
Web. doi:10.1364/OE.27.035700.
Chen, Xiaoliang, Li, Baojia, Proietti, Roberto, Liu, Che-Yu, Zhu, Zuqing, & Ben Yoo, S. J. Demonstration of distributed collaborative learning with end-to-end QoT estimation in multi-domain elastic optical networks. United States. https://doi.org/10.1364/OE.27.035700
Chen, Xiaoliang, Li, Baojia, Proietti, Roberto, Liu, Che-Yu, Zhu, Zuqing, and Ben Yoo, S. J. Wed .
"Demonstration of distributed collaborative learning with end-to-end QoT estimation in multi-domain elastic optical networks". United States. https://doi.org/10.1364/OE.27.035700.
@article{osti_1607569,
title = {Demonstration of distributed collaborative learning with end-to-end QoT estimation in multi-domain elastic optical networks},
author = {Chen, Xiaoliang and Li, Baojia and Proietti, Roberto and Liu, Che-Yu and Zhu, Zuqing and Ben Yoo, S. J.},
abstractNote = {This paper proposes a distributed collaborative learning approach for cognitive and autonomous multi-domain elastic optical networking (EON). The proposed approach exploits a knowledge-defined networking framework which leverages a broker plane to coordinate the operations of multiple EON domains and applies machine learning (ML) to support autonomous and cognitive inter-domain service provisioning. By employing multiple distributed ML blocks learning domain-level features and working with broker plane aggregation ML blocks (through the chain rule-based training), the proposed approach enables to develop cognitive networking applications that can fully exploit the multi-domain EON states while obviating the need for the raw and confidential intra-domain data. In particular, we investigate end-to-end quality-of transmission estimation application using the distributed learning approach and propose three estimator designs incorporating the concepts of multi-task learning (MTL) and transfer learning (TL). Evaluations with experimental data demonstrate that the proposed designs can achieve estimation accuracies very close to (with differences less than 0.5%) or even higher than (with MTL/TL) those of the baseline models assuming full domain visibility.},
doi = {10.1364/OE.27.035700},
journal = {Optics Express},
number = 24,
volume = 27,
place = {United States},
year = {Wed Nov 20 00:00:00 EST 2019},
month = {Wed Nov 20 00:00:00 EST 2019}
}
https://doi.org/10.1364/OE.27.035700
Works referenced in this record:
Self-Taught Anomaly Detection With Hybrid Unsupervised/Supervised Machine Learning in Optical Networks
journal, April 2019
- Chen, Xiaoliang; Li, Baojia; Proietti, Roberto
- Journal of Lightwave Technology, Vol. 37, Issue 7
Elastic optical networking: a new dawn for the optical layer?
journal, February 2012
- Gerstel, Ori; Jinno, Masahiko; Lord, Andrew
- IEEE Communications Magazine, Vol. 50, Issue 2
Deep learning
journal, May 2015
- LeCun, Yann; Bengio, Yoshua; Hinton, Geoffrey
- Nature, Vol. 521, Issue 7553
Highly efficient data migration and backup for big data applications in elastic optical inter-data-center networks
journal, September 2015
- Lu, Ping; Zhang, Liang; Liu, Xiahe
- IEEE Network, Vol. 29, Issue 5
Cognitive Assurance Architecture for Optical Network Fault Management
journal, April 2018
- Rafique, Danish; Szyrkowiec, Thomas; Grieser, Helmut
- Journal of Lightwave Technology, Vol. 36, Issue 7
Virtual Optical Network Embedding (VONE) Over Elastic Optical Networks
journal, February 2014
- Gong, Long; Zhu, Zuqing
- Journal of Lightwave Technology, Vol. 32, Issue 3
A Survey on Transfer Learning
journal, October 2010
- Pan, Sinno Jialin; Yang, Qiang
- IEEE Transactions on Knowledge and Data Engineering, Vol. 22, Issue 10
Experimental Demonstration of Machine-Learning-Aided QoT Estimation in Multi-Domain Elastic Optical Networks with Alien Wavelengths
journal, September 2018
- Proietti, Roberto; Chen, Xiaoliang; Zhang, Kaiqi
- Journal of Optical Communications and Networking, Vol. 11, Issue 1
An Overview on Application of Machine Learning Techniques in Optical Networks
journal, July 2019
- Musumeci, Francesco; Rottondi, Cristina; Nag, Avishek
- IEEE Communications Surveys & Tutorials, Vol. 21, Issue 2
Incentive-Driven Bidding Strategy for Brokers to Compete for Service Provisioning Tasks in Multi-Domain SD-EONs
journal, August 2016
- Chen, Xiaoliang; Zhu, Zuqing; Sun, Lu
- Journal of Lightwave Technology, Vol. 34, Issue 16
Efficient Resource Allocation for All-Optical Multicasting Over Spectrum-Sliced Elastic Optical Networks
journal, January 2013
- Gong, Long; Zhou, Xiang; Liu, Xiahe
- Journal of Optical Communications and Networking, Vol. 5, Issue 8
Dynamic Service Provisioning in Elastic Optical Networks With Hybrid Single-/Multi-Path Routing
journal, January 2013
- Zhu, Zuqing; Lu, Wei; Zhang, Liang
- Journal of Lightwave Technology, Vol. 31, Issue 1
DeepRMSA: A Deep Reinforcement Learning Framework for Routing, Modulation and Spectrum Assignment in Elastic Optical Networks
journal, August 2019
- Chen, Xiaoliang; Li, Baojia; Proietti, Roberto
- Journal of Lightwave Technology, Vol. 37, Issue 16
OpenFlow-Assisted Online Defragmentation in Single-/Multi-Domain Software-Defined Elastic Optical Networks [Invited]
journal, September 2014
- Zhu, Zuqing; Chen, Xiaoliang; Chen, Cen
- Journal of Optical Communications and Networking, Vol. 7, Issue 1
Spectral and Spatial 2D Fragmentation-Aware Routing and Spectrum Assignment Algorithms in Elastic Optical Networks [Invited]
journal, January 2013
- Yin, Yawei; Zhang, Huan; Zhang, Mingyang
- Journal of Optical Communications and Networking, Vol. 5, Issue 10
Machine-Learning Method for Quality of Transmission Prediction of Unestablished Lightpaths
journal, January 2018
- Rottondi, Cristina; Barletta, Luca; Giusti, Alessandro
- Journal of Optical Communications and Networking, Vol. 10, Issue 2
Knowledge-Based Autonomous Service Provisioning in Multi-Domain Elastic Optical Networks
journal, August 2018
- Chen, Xiaoliang; Proietti, Roberto; Lu, Hongbo
- IEEE Communications Magazine, Vol. 56, Issue 8
An Optical Communication's Perspective on Machine Learning and Its Applications
journal, January 2019
- Khan, Faisal Nadeem; Fan, Qirui; Lu, Chao
- Journal of Lightwave Technology, Vol. 37, Issue 2
Demonstration of Cooperative Resource Allocation in an OpenFlow-Controlled Multidomain and Multinational SD-EON Testbed
journal, April 2015
- Zhu, Zuqing; Chen, Cen; Chen, Xiaoliang
- Journal of Lightwave Technology, Vol. 33, Issue 8
Proactive H-PCE Architecture With BGP-LS Update for Multidomain Elastic Optical Networks [Invited]
journal, January 2015
- Giorgetti, Alessio
- Journal of Optical Communications and Networking, Vol. 7, Issue 11