RL-Based Adaptive UAV Swarm Formation and Clustering for Secure 6G Wireless Communications in Dynamic Dense Environments

Abstract

The wireless communication landscape in beyond 5G and 6G systems, particularly in dense smart city environments, presents significant interference challenges. UAV-mounted Reconfigurable Intelligent Surfaces (RIS) offer a promising solution to counter interference from unknown jammers. However, the system’s dynamic nature, especially real-time fluctuations in device and jammer distribution and UAV resources, complicates UAV and RIS management. Current approaches, which rely on a single UAV-mounted RIS or a fixed number of UAVs covering static device clusters, fail to adapt to these dynamic conditions. Smaller swarms may lead to inadequate coverage, while larger swarms can cause inefficiency and higher energy consumption. Additionally, these approaches often target a single objective, such as maximizing sum rates or minimizing energy use, without considering UAV battery constraints. Our work introduces an adaptive UAV swarm formation and dynamic device clustering technique designed for efficient anti-jamming in dynamic multi-user clusters threatened by unknown jammers during critical public events. This approach creates a flexible UAV-borne RIS swarm that dynamically adjusts the number of UAVs and the clustering to real-time changes of mobile devices and jammers, ensuring uninterrupted operations through UAV recharging and swapping while conserving total energy by deploying the minimum sufficient number of UAVs. Using Reinforcement Learning (RL), our solution optimizes the number of UAVs, device-to-UAV associations, UAV trajectories, RIS phase shifts, and base station power to effectively balance the sum rate and energy consumption. Simulations demonstrate the superior performance of our approach in coverage, jamming mitigation, energy conservation, connectivity, and scalability compared to existing methods and baselines.

Keywords

• Anti-jamming
• reinforcement learning
• wireless communications
• swarm UAVs
• reconfigurable intelligent surfaces (RIS)
• clustering