TY - JOUR
T1 - Energy and Spectrum Efficient Federated Learning via High-Precision Over-the-Air Computation
AU - Li, Liang
AU - Huang, Chenpei
AU - Shi, Dian
AU - Wang, Hao
AU - Zhou, Xiangwei
AU - Shu, Minglei
AU - Pan, Miao
N1 - Publisher Copyright:
© 2002-2012 IEEE.
PY - 2024/2/1
Y1 - 2024/2/1
N2 - Federated learning (FL) enables mobile devices to collaboratively learn a shared prediction model while keeping data locally. However, there are two major research challenges to practically deploy FL over mobile devices: (i) frequent wireless updates of huge size gradients v.s. limited spectrum resources, and (ii) energy-hungry FL communication and local computing during training v.s. battery-constrained mobile devices. To address those challenges, in this paper, we propose a novel multi-bit over-the-air computation (M-AirComp) approach for spectrum-efficient aggregation of local model updates in FL and further present an energy-efficient FL design for mobile devices. Specifically, a high-precision digital modulation scheme is designed and incorporated in the M-AirComp, allowing mobile devices to upload model updates at the selected positions simultaneously in the multi-access channel. Moreover, we theoretically analyze the convergence property of our FL algorithm. Guided by FL convergence analysis, we formulate a joint transmission probability and local computing control optimization, aiming to minimize the overall energy consumption (i.e., iterative local computing + multi-round communications) of mobile devices in FL. Extensive simulation results show that our proposed scheme outperforms existing ones in terms of spectrum utilization, energy efficiency, and learning accuracy.
AB - Federated learning (FL) enables mobile devices to collaboratively learn a shared prediction model while keeping data locally. However, there are two major research challenges to practically deploy FL over mobile devices: (i) frequent wireless updates of huge size gradients v.s. limited spectrum resources, and (ii) energy-hungry FL communication and local computing during training v.s. battery-constrained mobile devices. To address those challenges, in this paper, we propose a novel multi-bit over-the-air computation (M-AirComp) approach for spectrum-efficient aggregation of local model updates in FL and further present an energy-efficient FL design for mobile devices. Specifically, a high-precision digital modulation scheme is designed and incorporated in the M-AirComp, allowing mobile devices to upload model updates at the selected positions simultaneously in the multi-access channel. Moreover, we theoretically analyze the convergence property of our FL algorithm. Guided by FL convergence analysis, we formulate a joint transmission probability and local computing control optimization, aiming to minimize the overall energy consumption (i.e., iterative local computing + multi-round communications) of mobile devices in FL. Extensive simulation results show that our proposed scheme outperforms existing ones in terms of spectrum utilization, energy efficiency, and learning accuracy.
KW - energy efficiency
KW - Federated learning
KW - gradient quantization
KW - over-the-air computation
UR - http://www.scopus.com/inward/record.url?scp=85163559194&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85163559194&partnerID=8YFLogxK
U2 - 10.1109/TWC.2023.3287549
DO - 10.1109/TWC.2023.3287549
M3 - Article
AN - SCOPUS:85163559194
SN - 1536-1276
VL - 23
SP - 1228
EP - 1242
JO - IEEE Transactions on Wireless Communications
JF - IEEE Transactions on Wireless Communications
IS - 2
ER -