UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Learning Rate Optimization for Federated Learning Exploiting Over-the-air Computation

Xu, C; Liu, S; Yang, Z; Huang, Y; Wong, K-K; (2021) Learning Rate Optimization for Federated Learning Exploiting Over-the-air Computation. ArXiv: Ithaca, NY, USA. Green open access

[thumbnail of 2102.02946v3.pdf]
Preview
Text
2102.02946v3.pdf - Accepted Version

Download (601kB) | Preview

Abstract

Federated learning (FL) as a promising edge-learning framework can effectively address the latency and privacy issues by featuring distributed learning at the devices and model aggregation in the central server. In order to enable efficient wireless data aggregation, over-the-air computation (AirComp) has recently been proposed and attracted immediate attention. However, fading of wireless channels can produce aggregate distortions in an AirComp-based FL scheme. To combat this effect, the concept of dynamic learning rate (DLR) is proposed in this work. We begin our discussion by considering multiple-input-single-output (MISO) scenario, since the underlying optimization problem is convex and has closed-form solution. We then extend our studies to more general multiple-input-multiple-output (MIMO) case and an iterative method is derived. Extensive simulation results demonstrate the effectiveness of the proposed scheme in reducing the aggregate distortion and guaranteeing the testing accuracy using the MNIST and CIFAR10 datasets. In addition, we present the asymptotic analysis and give a near-optimal receive beamforming design solution in closed form, which is verified by numerical simulations.

Type: Working / discussion paper
Title: Learning Rate Optimization for Federated Learning Exploiting Over-the-air Computation
Open access status: An open access version is available from UCL Discovery
Publisher version: https://arxiv.org/abs/2102.02946v3
Language: English
Additional information: This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions.
UCL classification: UCL
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Electronic and Electrical Eng
URI: https://discovery.ucl.ac.uk/id/eprint/10129938
Downloads since deposit
0Downloads
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item