Sparsity-Aware Intelligent Massive Random Access Control for Massive MIMO Networks: A Reinforcement Learning Based Approach

Xiao Tang, Sicong Liu, Xiaojiang Du, Mohsen Guizani

Research output: Contribution to journalArticlepeer-review

1 Scopus citations

Abstract

Massive random access of devices brings great challenge to the management of radio access networks. Most of the time, the access requests in the network are sporadic. Exploiting the bursting nature, sparse active user detection (SAUD) is an efficient enabler towards efficient active user detection. However, the sparsity might be deteriorated in case of high concurrent request periods. To dynamically coordinate the access requests, a reinforcement-learning (RL)-assisted scheme of closed-loop access control utilizing the access class barring (ACB) technique is proposed, where the control policy is determined through continuous interaction between the RL agent and the environment. The proposed RL agent can be deployed at the next generation node base (gNB), supporting rapid switching between heterogeneous vertical applications, such as mMTC and uRLLC services. Moreover, a data-driven scheme of deep-RL-assisted SAUD is proposed to resolve highly complex environments with continuous and high-dimensional state and action spaces, where a replay buffer is applied for automatic large-scale data collection. An Actor-Critic framework is formulated to incorporate the strategy-learning modules into the intelligent control agent. Simulation results show that the proposed schemes can achieve superior performance in both access efficiency and user detection accuracy over the benchmark scheme for different heterogeneous services with massive access requests.

Original languageEnglish
Pages (from-to)9730-9744
Number of pages15
JournalIEEE Transactions on Wireless Communications
Volume23
Issue number8
DOIs
StatePublished - 2024

Keywords

  • active user detection
  • compressed sensing
  • massive MIMO
  • Massive random access
  • reinforcement learning

Fingerprint

Dive into the research topics of 'Sparsity-Aware Intelligent Massive Random Access Control for Massive MIMO Networks: A Reinforcement Learning Based Approach'. Together they form a unique fingerprint.

Cite this