DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Demonstration of distributed collaborative learning with end-to-end QoT estimation in multi-domain elastic optical networks

Abstract

This paper proposes a distributed collaborative learning approach for cognitive and autonomous multi-domain elastic optical networking (EON). The proposed approach exploits a knowledge-defined networking framework which leverages a broker plane to coordinate the operations of multiple EON domains and applies machine learning (ML) to support autonomous and cognitive inter-domain service provisioning. By employing multiple distributed ML blocks learning domain-level features and working with broker plane aggregation ML blocks (through the chain rule-based training), the proposed approach enables to develop cognitive networking applications that can fully exploit the multi-domain EON states while obviating the need for the raw and confidential intra-domain data. In particular, we investigate end-to-end quality-of transmission estimation application using the distributed learning approach and propose three estimator designs incorporating the concepts of multi-task learning (MTL) and transfer learning (TL). Evaluations with experimental data demonstrate that the proposed designs can achieve estimation accuracies very close to (with differences less than 0.5%) or even higher than (with MTL/TL) those of the baseline models assuming full domain visibility.

Authors:
ORCiD logo; ; ORCiD logo; ; ORCiD logo;
Publication Date:
Research Org.:
Univ. of California, Davis, CA (United States)
Sponsoring Org.:
USDOE Office of Science (SC)
OSTI Identifier:
1607569
Alternate Identifier(s):
OSTI ID: 1803081
Grant/Contract Number:  
SC0016700
Resource Type:
Published Article
Journal Name:
Optics Express
Additional Journal Information:
Journal Name: Optics Express Journal Volume: 27 Journal Issue: 24; Journal ID: ISSN 1094-4087
Publisher:
Optical Society of America
Country of Publication:
United States
Language:
English
Subject:
71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSICS; Optics

Citation Formats

Chen, Xiaoliang, Li, Baojia, Proietti, Roberto, Liu, Che-Yu, Zhu, Zuqing, and Ben Yoo, S. J. Demonstration of distributed collaborative learning with end-to-end QoT estimation in multi-domain elastic optical networks. United States: N. p., 2019. Web. doi:10.1364/OE.27.035700.
Chen, Xiaoliang, Li, Baojia, Proietti, Roberto, Liu, Che-Yu, Zhu, Zuqing, & Ben Yoo, S. J. Demonstration of distributed collaborative learning with end-to-end QoT estimation in multi-domain elastic optical networks. United States. https://doi.org/10.1364/OE.27.035700
Chen, Xiaoliang, Li, Baojia, Proietti, Roberto, Liu, Che-Yu, Zhu, Zuqing, and Ben Yoo, S. J. Wed . "Demonstration of distributed collaborative learning with end-to-end QoT estimation in multi-domain elastic optical networks". United States. https://doi.org/10.1364/OE.27.035700.
@article{osti_1607569,
title = {Demonstration of distributed collaborative learning with end-to-end QoT estimation in multi-domain elastic optical networks},
author = {Chen, Xiaoliang and Li, Baojia and Proietti, Roberto and Liu, Che-Yu and Zhu, Zuqing and Ben Yoo, S. J.},
abstractNote = {This paper proposes a distributed collaborative learning approach for cognitive and autonomous multi-domain elastic optical networking (EON). The proposed approach exploits a knowledge-defined networking framework which leverages a broker plane to coordinate the operations of multiple EON domains and applies machine learning (ML) to support autonomous and cognitive inter-domain service provisioning. By employing multiple distributed ML blocks learning domain-level features and working with broker plane aggregation ML blocks (through the chain rule-based training), the proposed approach enables to develop cognitive networking applications that can fully exploit the multi-domain EON states while obviating the need for the raw and confidential intra-domain data. In particular, we investigate end-to-end quality-of transmission estimation application using the distributed learning approach and propose three estimator designs incorporating the concepts of multi-task learning (MTL) and transfer learning (TL). Evaluations with experimental data demonstrate that the proposed designs can achieve estimation accuracies very close to (with differences less than 0.5%) or even higher than (with MTL/TL) those of the baseline models assuming full domain visibility.},
doi = {10.1364/OE.27.035700},
journal = {Optics Express},
number = 24,
volume = 27,
place = {United States},
year = {Wed Nov 20 00:00:00 EST 2019},
month = {Wed Nov 20 00:00:00 EST 2019}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record
https://doi.org/10.1364/OE.27.035700

Save / Share:

Works referenced in this record:

Self-Taught Anomaly Detection With Hybrid Unsupervised/Supervised Machine Learning in Optical Networks
journal, April 2019

  • Chen, Xiaoliang; Li, Baojia; Proietti, Roberto
  • Journal of Lightwave Technology, Vol. 37, Issue 7
  • DOI: 10.1109/JLT.2019.2902487

Elastic optical networking: a new dawn for the optical layer?
journal, February 2012


Deep learning
journal, May 2015

  • LeCun, Yann; Bengio, Yoshua; Hinton, Geoffrey
  • Nature, Vol. 521, Issue 7553
  • DOI: 10.1038/nature14539

Highly efficient data migration and backup for big data applications in elastic optical inter-data-center networks
journal, September 2015


Cognitive Assurance Architecture for Optical Network Fault Management
journal, April 2018

  • Rafique, Danish; Szyrkowiec, Thomas; Grieser, Helmut
  • Journal of Lightwave Technology, Vol. 36, Issue 7
  • DOI: 10.1109/JLT.2017.2781540

Virtual Optical Network Embedding (VONE) Over Elastic Optical Networks
journal, February 2014


A Survey on Transfer Learning
journal, October 2010

  • Pan, Sinno Jialin; Yang, Qiang
  • IEEE Transactions on Knowledge and Data Engineering, Vol. 22, Issue 10
  • DOI: 10.1109/TKDE.2009.191

Experimental Demonstration of Machine-Learning-Aided QoT Estimation in Multi-Domain Elastic Optical Networks with Alien Wavelengths
journal, September 2018

  • Proietti, Roberto; Chen, Xiaoliang; Zhang, Kaiqi
  • Journal of Optical Communications and Networking, Vol. 11, Issue 1
  • DOI: 10.1364/JOCN.11.0000A1

An Overview on Application of Machine Learning Techniques in Optical Networks
journal, July 2019

  • Musumeci, Francesco; Rottondi, Cristina; Nag, Avishek
  • IEEE Communications Surveys & Tutorials, Vol. 21, Issue 2
  • DOI: 10.1109/COMST.2018.2880039

Incentive-Driven Bidding Strategy for Brokers to Compete for Service Provisioning Tasks in Multi-Domain SD-EONs
journal, August 2016

  • Chen, Xiaoliang; Zhu, Zuqing; Sun, Lu
  • Journal of Lightwave Technology, Vol. 34, Issue 16
  • DOI: 10.1109/JLT.2016.2586141

Efficient Resource Allocation for All-Optical Multicasting Over Spectrum-Sliced Elastic Optical Networks
journal, January 2013

  • Gong, Long; Zhou, Xiang; Liu, Xiahe
  • Journal of Optical Communications and Networking, Vol. 5, Issue 8
  • DOI: 10.1364/JOCN.5.000836

Dynamic Service Provisioning in Elastic Optical Networks With Hybrid Single-/Multi-Path Routing
journal, January 2013


DeepRMSA: A Deep Reinforcement Learning Framework for Routing, Modulation and Spectrum Assignment in Elastic Optical Networks
journal, August 2019

  • Chen, Xiaoliang; Li, Baojia; Proietti, Roberto
  • Journal of Lightwave Technology, Vol. 37, Issue 16
  • DOI: 10.1109/JLT.2019.2923615

OpenFlow-Assisted Online Defragmentation in Single-/Multi-Domain Software-Defined Elastic Optical Networks [Invited]
journal, September 2014

  • Zhu, Zuqing; Chen, Xiaoliang; Chen, Cen
  • Journal of Optical Communications and Networking, Vol. 7, Issue 1
  • DOI: 10.1364/JOCN.7.0000A7

Spectral and Spatial 2D Fragmentation-Aware Routing and Spectrum Assignment Algorithms in Elastic Optical Networks [Invited]
journal, January 2013

  • Yin, Yawei; Zhang, Huan; Zhang, Mingyang
  • Journal of Optical Communications and Networking, Vol. 5, Issue 10
  • DOI: 10.1364/JOCN.5.00A100

Machine-Learning Method for Quality of Transmission Prediction of Unestablished Lightpaths
journal, January 2018

  • Rottondi, Cristina; Barletta, Luca; Giusti, Alessandro
  • Journal of Optical Communications and Networking, Vol. 10, Issue 2
  • DOI: 10.1364/JOCN.10.00A286

Knowledge-Based Autonomous Service Provisioning in Multi-Domain Elastic Optical Networks
journal, August 2018

  • Chen, Xiaoliang; Proietti, Roberto; Lu, Hongbo
  • IEEE Communications Magazine, Vol. 56, Issue 8
  • DOI: 10.1109/MCOM.2018.1701191

An Optical Communication's Perspective on Machine Learning and Its Applications
journal, January 2019

  • Khan, Faisal Nadeem; Fan, Qirui; Lu, Chao
  • Journal of Lightwave Technology, Vol. 37, Issue 2
  • DOI: 10.1109/JLT.2019.2897313

Demonstration of Cooperative Resource Allocation in an OpenFlow-Controlled Multidomain and Multinational SD-EON Testbed
journal, April 2015

  • Zhu, Zuqing; Chen, Cen; Chen, Xiaoliang
  • Journal of Lightwave Technology, Vol. 33, Issue 8
  • DOI: 10.1109/JLT.2015.2389526

Proactive H-PCE Architecture With BGP-LS Update for Multidomain Elastic Optical Networks [Invited]
journal, January 2015

  • Giorgetti, Alessio
  • Journal of Optical Communications and Networking, Vol. 7, Issue 11
  • DOI: 10.1364/JOCN.7.0000B1