Traffic-aware online network selection in heterogeneous wireless networks

Qihui Wu, Zhiyong Du, Panlong Yang, Yu Dong Yao, Jinlong Wang

Research output: Contribution to journalArticlepeer-review

47 Scopus citations

Abstract

We focus on the network selection problem in heterogeneous wireless networks. Many traditional approaches select the best network according to quality of service (QoS)-related criteria, which neglects diverse user demands. We aim to select networks maximizing the quality of experience (QoE) of users. When the availability and dynamics of network state information (NSI) are considered, most of the existing approaches cannot make effective selection decisions since they are vulnerable to the uncertainty in NSI. To address this issue, we introduce the idea of online learning for network selection. In this paper, we formulate the network selection problem as a continuous-time multiarmed bandit (CT-MAB) problem. A traffic-aware online network selection (ONES) algorithm is designed to match typical traffic types of users with respective optimal networks in terms of QoE. Moreover, we found that the correlation among multiple traffic network selections can be exploited to improve the learning capability. This motivates us to propose another two more efficient algorithms: the decoupled ONES (D-ONES) algorithm and the virtual multiplexing ONES (VM-ONES) algorithm. Simulation results demonstrate that our ONES algorithms attain around 10% gain in QoE reward rate over nonlearning-based algorithms and learning-based algorithms without QoE considerations.

Original languageEnglish
Article number7018008
Pages (from-to)381-397
Number of pages17
JournalIEEE Transactions on Vehicular Technology
Volume65
Issue number1
DOIs
StatePublished - 1 Jan 2016

Keywords

  • Online learning
  • Online network selection (ONES)
  • Quality of experience (QoE)
  • Terms-Heterogeneous wireless networks
  • Traffic type

Fingerprint

Dive into the research topics of 'Traffic-aware online network selection in heterogeneous wireless networks'. Together they form a unique fingerprint.

Cite this