Deep Reinforcement Learning for Resource Constrained Multiclass Scheduling in Wireless Networks - Equipe Communications numériques
Article Dans Une Revue IEEE Transactions on Machine Learning in Communications and Networking Année : 2023

Deep Reinforcement Learning for Resource Constrained Multiclass Scheduling in Wireless Networks

Apostolos Avranas
  • Fonction : Auteur
  • PersonId : 977252
  • IdRef : 245231471
Marios Kountouris

Résumé

The problem of multiclass scheduling in a dynamic wireless setting is considered here, where the available limited bandwidth resources are allocated to handle random service demand arrivals, belonging to different classes in terms of payload data request, delay tolerance, and importance/priority. In addition to heterogeneous traffic, another major challenge stems from random service rates due to time-varying wireless communication channels. Existing scheduling and resource allocation approaches, ranging from simple greedy heuristics and constrained optimization to combinatorics, are tailored to specific network or application configuration and are usually suboptimal. On this account, we resort to deep reinforcement learning (DRL) and propose a distributional Deep Deterministic Policy Gradient (DDPG) algorithm combined with Deep Sets to tackle the aforementioned problem. Furthermore, we present a novel way to use a Dueling Network, which leads to further performance improvement. Our proposed algorithm is tested on both synthetic and real data, showing consistent gains against baseline methods from combinatorics and optimization, and state-of-the-art scheduling metrics. Our method can, for instance, achieve with 13% less power and bandwidth resources the same user satisfaction rate as a myopic algorithm using knapsack optimization
Fichier principal
Vignette du fichier
Deep_Reinforcement_Learning_for_Resource_Constrained_Multiclass_Scheduling_in_Wireless_Networks.pdf (1.65 Mo) Télécharger le fichier
Origine Fichiers éditeurs autorisés sur une archive ouverte

Dates et versions

hal-04285681 , version 1 (18-06-2024)

Identifiants

Citer

Apostolos Avranas, Philippe Ciblat, Marios Kountouris. Deep Reinforcement Learning for Resource Constrained Multiclass Scheduling in Wireless Networks. IEEE Transactions on Machine Learning in Communications and Networking, 2023, 1, pp.225-241. ⟨10.1109/TMLCN.2023.3314705⟩. ⟨hal-04285681⟩
170 Consultations
38 Téléchargements

Altmetric

Partager

More