TY - JOUR
T1 - Green Heterogeneous Computing Powers Allocation Using Reinforcement Learning in SDN-IoV
AU - Liu, Yingjie
AU - Wang, Dan
AU - Song, Bin
AU - Du, Xiaojiang
N1 - Publisher Copyright:
© 2017 IEEE.
PY - 2023/6/1
Y1 - 2023/6/1
N2 - In the era of 6G-driven Internet of Vehicles (IoV), the form of services centered on computing power has promoted the development of applications such as In-Vehicle Infotainment (IVI) and smart driving assistance. The collaboration of computing power deployed between edge and end provides computing services for IoV applications. However, due to the diversity of computing tasks and the heterogeneity of computing power resources, it is a challenge to allocate computing power resources reasonably to meet user needs. To solve this problem, we propose a green heterogeneous computing power allocation method to reduce the energy consumption. First, we design a Heterogeneous Computing Power-IoV (HCP-IoV) architecture based on Software Defined Network (SDN) to realize the deep integration of computing power and network through the hybrid network architecture of vehicle-road collaboration and road-road collaboration. Then, to ensure the reasonable allocation of different computing tasks, we design an intelligent heterogeneous computing power allocation scheme to reduce energy consumption on HCP-IoV. Furthermore, we formulate the joint communication and computing power allocation as a Markov Decision Process (MDP) and use the improved Proximal Policy Optimization (PPO) method to achieve an adaptive allocation of heterogeneous computing powers. Simulation results show the effectiveness of the proposed method.
AB - In the era of 6G-driven Internet of Vehicles (IoV), the form of services centered on computing power has promoted the development of applications such as In-Vehicle Infotainment (IVI) and smart driving assistance. The collaboration of computing power deployed between edge and end provides computing services for IoV applications. However, due to the diversity of computing tasks and the heterogeneity of computing power resources, it is a challenge to allocate computing power resources reasonably to meet user needs. To solve this problem, we propose a green heterogeneous computing power allocation method to reduce the energy consumption. First, we design a Heterogeneous Computing Power-IoV (HCP-IoV) architecture based on Software Defined Network (SDN) to realize the deep integration of computing power and network through the hybrid network architecture of vehicle-road collaboration and road-road collaboration. Then, to ensure the reasonable allocation of different computing tasks, we design an intelligent heterogeneous computing power allocation scheme to reduce energy consumption on HCP-IoV. Furthermore, we formulate the joint communication and computing power allocation as a Markov Decision Process (MDP) and use the improved Proximal Policy Optimization (PPO) method to achieve an adaptive allocation of heterogeneous computing powers. Simulation results show the effectiveness of the proposed method.
KW - IoV
KW - heterogeneous computing power
KW - multivariate Gaussian distribution
KW - reinforcement learning
UR - http://www.scopus.com/inward/record.url?scp=85133747204&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85133747204&partnerID=8YFLogxK
U2 - 10.1109/TGCN.2022.3187077
DO - 10.1109/TGCN.2022.3187077
M3 - Article
AN - SCOPUS:85133747204
VL - 7
SP - 983
EP - 995
JO - IEEE Transactions on Green Communications and Networking
JF - IEEE Transactions on Green Communications and Networking
IS - 2
ER -