TY - JOUR
T1 - Opportunistic spectrum access in unknown dynamic environment
T2 - A game-theoretic stochastic learning solution
AU - Xu, Yuhua
AU - Wang, Jinlong
AU - Wu, Qihui
AU - Anpalagan, Alagan
AU - Yao, Yu Dong
PY - 2012/4
Y1 - 2012/4
N2 - We investigate the problem of distributed channel selection using a game-theoretic stochastic learning solution in an opportunistic spectrum access (OSA) system where the channel availability statistics and the number of the secondary users are apriori unknown. We formulate the channel selection problem as a game which is proved to be an exact potential game. However, due to the lack of information about other users and the restriction that the spectrum is time-varying with unknown availability statistics, the task of achieving Nash equilibrium (NE) points of the game is challenging. Firstly, we propose a genie-aided algorithm to achieve the NE points under the assumption of perfect environment knowledge. Based on this, we investigate the achievable performance of the game in terms of system throughput and fairness. Then, we propose a stochastic learning automata (SLA) based channel selection algorithm, with which the secondary users learn from their individual action-reward history and adjust their behaviors towards a NE point. The proposed learning algorithm neither requires information exchange, nor needs prior information about the channel availability statistics and the number of secondary users. Simulation results show that the SLA based learning algorithm achieves high system throughput with good fairness.
AB - We investigate the problem of distributed channel selection using a game-theoretic stochastic learning solution in an opportunistic spectrum access (OSA) system where the channel availability statistics and the number of the secondary users are apriori unknown. We formulate the channel selection problem as a game which is proved to be an exact potential game. However, due to the lack of information about other users and the restriction that the spectrum is time-varying with unknown availability statistics, the task of achieving Nash equilibrium (NE) points of the game is challenging. Firstly, we propose a genie-aided algorithm to achieve the NE points under the assumption of perfect environment knowledge. Based on this, we investigate the achievable performance of the game in terms of system throughput and fairness. Then, we propose a stochastic learning automata (SLA) based channel selection algorithm, with which the secondary users learn from their individual action-reward history and adjust their behaviors towards a NE point. The proposed learning algorithm neither requires information exchange, nor needs prior information about the channel availability statistics and the number of secondary users. Simulation results show that the SLA based learning algorithm achieves high system throughput with good fairness.
KW - Cognitive radio networks
KW - distributed channel selection
KW - exact potential game
KW - opportunistic spectrum access
KW - stochastic learning automata
UR - http://www.scopus.com/inward/record.url?scp=84862804804&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84862804804&partnerID=8YFLogxK
U2 - 10.1109/TWC.2012.020812.110025
DO - 10.1109/TWC.2012.020812.110025
M3 - Article
AN - SCOPUS:84862804804
SN - 1536-1276
VL - 11
SP - 1380
EP - 1391
JO - IEEE Transactions on Wireless Communications
JF - IEEE Transactions on Wireless Communications
IS - 4
M1 - 6151775
ER -