Xu, C;
Liu, S;
Yang, Z;
Huang, Y;
Wong, K-K;
(2021)
Learning Rate Optimization for Federated Learning Exploiting Over-the-air Computation.
ArXiv: Ithaca, NY, USA.
Preview |
Text
2102.02946v3.pdf - Accepted Version Download (601kB) | Preview |
Abstract
Federated learning (FL) as a promising edge-learning framework can effectively address the latency and privacy issues by featuring distributed learning at the devices and model aggregation in the central server. In order to enable efficient wireless data aggregation, over-the-air computation (AirComp) has recently been proposed and attracted immediate attention. However, fading of wireless channels can produce aggregate distortions in an AirComp-based FL scheme. To combat this effect, the concept of dynamic learning rate (DLR) is proposed in this work. We begin our discussion by considering multiple-input-single-output (MISO) scenario, since the underlying optimization problem is convex and has closed-form solution. We then extend our studies to more general multiple-input-multiple-output (MIMO) case and an iterative method is derived. Extensive simulation results demonstrate the effectiveness of the proposed scheme in reducing the aggregate distortion and guaranteeing the testing accuracy using the MNIST and CIFAR10 datasets. In addition, we present the asymptotic analysis and give a near-optimal receive beamforming design solution in closed form, which is verified by numerical simulations.
| Type: | Working / discussion paper |
|---|---|
| Title: | Learning Rate Optimization for Federated Learning Exploiting Over-the-air Computation |
| Open access status: | An open access version is available from UCL Discovery |
| Publisher version: | https://arxiv.org/abs/2102.02946v3 |
| Language: | English |
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Electronic and Electrical Eng |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10129938 |
Archive Staff Only
 |
View Item |
