Deep reinforcement learning for secrecy energy efficiency maximization in RIS-assisted networks

This paper investigates the deep reinforcement learning (DRL) for maximization of the secrecy energy efficiency (SEE) in reconfigurable intelligent surface (RIS)-assisted networks. An SEE maximization problem is formulated under constraints of the rate requirement of each (legitimate) user, the powe...

Full description

Saved in:
Bibliographic Details
Main Authors: Zhang, Yichi, Lu, Yang, Zhang, Ruichen, Ai, Bo, Niyato, Dusit
Other Authors: School of Computer Science and Engineering
Format: Article
Language:English
Published: 2023
Subjects:
Online Access:https://hdl.handle.net/10356/170813
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
Description
Summary:This paper investigates the deep reinforcement learning (DRL) for maximization of the secrecy energy efficiency (SEE) in reconfigurable intelligent surface (RIS)-assisted networks. An SEE maximization problem is formulated under constraints of the rate requirement of each (legitimate) user, the power budget of the transmitter and the discrete phase shift coefficient of each reflecting element at the RIS by jointly optimizing the beamforming vectors for users and the artificial noise vectors for eavesdroppers as well as the phase shift matrix. The considered problem is first reformulated into a Markov decision process with the designed state space, action space and reward function, and then solved under a proximal policy optimization (PPO) framework. Numerical results are provided to evaluate the optimality, the generalization performance and the running time of proposed PPO-based algorithm.