Virtual reality in metaverse over wireless networks with user-centered deep reinforcement learning

• Main Authors: Yu, Wenhan, Chua, Terence Jie, Zhao, Jun
• Other Authors: Interdisciplinary Graduate School (IGS)
• Format: Conference or Workshop Item
• Language: English
• Published: 2023
• Subjects: Engineering::Computer science and engineering; Metaverse; Computation Offloading; Reinforcement Learning; Wireless Networks
• Online Access: https://hdl.handle.net/10356/170134
• Institution: Nanyang Technological University

The Metaverse and its promises are fast becoming reality as maturing technologies are empowering the different facets. One of the highlights of the Metaverse is that it offers the possibility for highly immersive and interactive socialization. Virtual reality (VR) technologies are the backbone for the virtual universe within the Metaverse as they enable a hyper-realistic and immersive experience, and especially so in the context of socialization. As the virtual world 3D scenes to be rendered are of high resolution and frame rate, these scenes will be offloaded to an edge server for computation. Besides, the metaverse is user-center by design, and human users are always the core. In this work, we introduce a multi-user VR computation offloading over wireless communication scenario. In addition, we devised a novel user-centered deep reinforcement learning approach to find a near-optimal solution. Extensive experiments demonstrate that our approach can lead to remarkable results under various requirements and constraints.