UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Convolutional long short-term memory neural network equalizer for nonlinear Fourier transform-based optical transmission systems

Kotlyar, O; Kamalian-Kopae, M; Pankratova, M; Vasylchenkova, A; Prilepsky, JE; Turitsyn, SK; (2021) Convolutional long short-term memory neural network equalizer for nonlinear Fourier transform-based optical transmission systems. Optics Express , 29 (7) pp. 11254-11267. 10.1364/OE.419314. Green open access

[thumbnail of oe-29-7-11254.pdf]
Preview
Text
oe-29-7-11254.pdf - Published Version

Download (3MB) | Preview

Abstract

We evaluate improvement in the performance of the optical transmission systems operating with the continuous nonlinear Fourier spectrum by the artificial neural network equalisers installed at the receiver end. We propose here a novel equaliser designs based on bidirectional long short-term memory (BLSTM) gated recurrent neural network and compare their performance with the equaliser based on several fully connected layers. The proposed approach accounts for the correlations between different nonlinear spectral components. The application of BLSTM equaliser leads to a 16x improvement in terms of bit-error rate (BER) compared to the non-equalised case. The proposed equaliser makes it possible to reach the data rate of 170 Gbit/s for one polarisation conventional nonlinear Fourier transform (NFT) based system at 1000 km distance. We show that our new BLSTM equalisers significantly outperform the previously proposed scheme based on a feed-forward fully connected neural network. Moreover, we demonstrate that by adding a 1D convolutional layer for the data pre-processing before BLSTM recurrent layers, we can further enhance the performance of the BLSTM equaliser, reaching 23x BER improvement for the 170 Gbit/s system over 1000 km, staying below the 7% forward error correction hard decision threshold (HD-FEC).

Type: Article
Title: Convolutional long short-term memory neural network equalizer for nonlinear Fourier transform-based optical transmission systems
Open access status: An open access version is available from UCL Discovery
DOI: 10.1364/OE.419314
Publisher version: https://doi.org/10.1364/OE.419314
Language: English
Additional information: Published by The Optical Society under the terms of the Creative Commons Attribution 4.0 License. Further distribution of this work must maintain attribution to the author(s) and the published article's title, journal citation, and DOI.
UCL classification: UCL
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Electronic and Electrical Eng
URI: https://discovery.ucl.ac.uk/id/eprint/10127131
Downloads since deposit
31Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item