Transmission control and optimization in next-generation hybrid wireless networks: an online reinforcement learning approach

Son Dinha; Hang Liu; Qi Zhao; Yi Li; Nicholas DeCorte; Genshe Chen

doi:10.1117/12.2623041

3 June 2022 Transmission control and optimization in next-generation hybrid wireless networks: an online reinforcement learning approach

Son Dinha, Hang Liu, Qi Zhao, Yi Li, Nicholas DeCorte, Genshe Chen

Author Affiliations +

Proceedings Volume 12121, Sensors and Systems for Space Applications XV; 121210E (2022) https://doi.org/10.1117/12.2623041
Event: SPIE Defense + Commercial Sensing, 2022, Orlando, Florida, United States

Abstract

Next-generation (5G & beyond) cellular networks promise much higher throughput and lower latency. However, mobile users experiencing poor channel quality not only suffer low data-rate connections with the base station but also reduce cell’s aggregate throughput and increase overall delay. In this paper, we consider a hybrid cellular and mobile ad hoc Device-to-Device (D2D) network that leverages the advantages of both wide-area cellular coverage and high-speed ad hoc D2D relaying to enhance network performance and scalability. Dedicated relay devices, such as Unmanned Aerial Vehicles (UAVs)/drones, can also be deployed to further improve network connectivity and thus throughput. The base station may send the packets destined for a mobile user with poor cellular channel quality to a proxy mobile device with better cellular channel quality. The proxy mobile device will relay the packets to the destination, thereby significanltly improving network throughput and delay. We formulate the data transmission problem and design an online reinforcement learning-based algorithm to achieve the best transmission performance.

Conference Presentation

Citation Download Citation

Son Dinha, Hang Liu, Qi Zhao, Yi Li, Nicholas DeCorte, and Genshe Chen "Transmission control and optimization in next-generation hybrid wireless networks: an online reinforcement learning approach", Proc. SPIE 12121, Sensors and Systems for Space Applications XV, 121210E (3 June 2022); https://doi.org/10.1117/12.2623041

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available