Pasar al contenido principal

MACHINE LEARNING FOR WIRELESS NETWORKING IN HIGHLY DYNAMIC SCENARIOS

PGC2018-099959-B-I00

•
Nombre agencia financiadora Agencia Estatal de Investigación
Acrónimo agencia financiadora AEI
Programa Programa Estatal de Generación de Conocimiento y Fortalecimiento Científico y Tecnológico del Sistema de I+D+i
Subprograma Subprograma Estatal de Generación de Conocimiento
Convocatoria Proyectos de I+D (Excelencia / Generación de Conocimiento)
Año convocatoria 2018
Plan Estatal 2017-2020 Plan Estatal de Investigación Científica y Técnica y de Innovación
Centro beneficiario UNIVERSITAT POMPEU FABRA CCT

Resultados relacionados

Resultados totales (Incluyendo duplicados): 20
Encontrada(s) 1 página(s)

Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Multi-link operation in IEEE 802.11be WLANs

  • López Raventós, Álvaro
  • Bellalta, Boris
The multi-link operation (MLO) is a new feature proposed to be part of the IEEE 802.11be Extremely High Throughput (EHT) amendment. Such feature represents a paradigm shift towards multi-link communications, as nodes will be allowed to transmit and receive data over multiple radio interfaces concurrently. To make it possible, the 802.11be Task Group has proposed different modifications in regards to nodes' architecture, transmission operation, and management functionalities. This article reviews such changes and tackles the question of how traffic should be distributed over multiple links, as it is still unresolved. To that end, we evaluate different load balancing strategies over the active links. Results show that in high load, dense and complex scenarios, implementing congestion aware load balancing policies to significantly enhance next-generation WLAN performance using MLO is a must., This work has been partially supported by the Spanish Government under grant WINDMAL PGC2018-099959-B-I00 (MCIU/AEI/FEDER,UE), by the Catalan Government under grant 2017-SGR1188, and Cisco.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Wi-Fi meets ML: a survey on improving IEEE 802.11 performance with machine learning

  • Szott, Szymon
  • Kosek-Szott, Katarzyna
  • Gawłowicz, Piotr
  • Torres Gómez, Jorge
  • Bellalta, Boris
  • Zubow, Anatolij
  • Dressler, Falko
Wireless local area networks (WLANs) empowered by IEEE 802.11 (Wi-Fi) hold a dominant position in providing Internet access thanks to their freedom of deployment and configuration as well as the existence of affordable and highly interoperable devices. The Wi-Fi community is currently deploying Wi-Fi 6 and developing Wi-Fi 7, which will bring higher data rates, better multi-user and multi-AP support, and, most importantly, improved configuration flexibility. These technical innovations, including the plethora of configuration parameters, are making next-generation WLANs exceedingly complex as the dependencies between parameters and their joint optimization usually have a non-linear impact on network performance. The complexity is further increased in the case of dense deployments and coexistence in shared bands. While classical optimization approaches fail in such conditions, machine learning (ML) is able to handle complexity. Much research has been published on using ML to improve Wi-Fi performance and solutions are slowly being adopted in existing deployments. In this survey, we adopt a structured approach to describe the various Wi-Fi areas where ML is applied. To this end, we analyze over 250 papers in the field, providing readers with an overview of the main trends. Based on this review, we identify specific open challenges and provide general future research directions., This work was supported in part by the National Science Centre, Poland, under Grant DEC-2020/39/I/ST7/01457; in part by the Federal Ministry of Education and Research (BMBF, Germany) Project OTB-5G+ under Grant 16KIS0985; in part by the 6G Research and Innovation Cluster 6G-RIC under Grant 16KISK020K; in part by the Project ML4WIFI funded by the German Research Foundation (DFG) under Grant DR 639/28-1; in part by the Ministerio de Ciencia e Innovación/Agencia Española de Investigación/Fondo Europeo de Desarrollo Regional (MCIU/AEI/FEDER), European Union (UE) under Grant WINDMAL PGC2018-099959-B-I00; and in part by Agència de Gestió d’Ajuts Universitaris i de Recerca (AGAUR) under Grant SGR017-1188.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

On the Low-latency region of best-effort links for delay-sensitive streaming traffic

  • Bellalta, Boris
This letter analyzes the Low-latency Region (LLR) of a best-effort link (i.e., no traffic differentiation, and first come first serve scheduling) carrying both delay-sensitive (DS) streaming and non-delay-sensitive (NDS) background traffic. Moreover, inside the LLR, we show it exists a proportional fair arrival rate allocation for both the DS and NDS traffic streams. This optimal operating point results from maximizing a simple throughput-delay trade-off that considers the NDS traffic load, and the mean delay of the DS packets. To show how the presented trade-off could be used to allocate NDS traffic in a realistic scenario, we use Google Stadia traffic traces to generate the DS flow. Results from this use-case confirm that the throughput-delay trade-off also works regardless the distribution of the packet arrival and packet service times., The author would like to thank Marc Carrascosa for his contribution in taking the Google Stadia measurements. Also, the author wants to especially thank the anonymous reviewers for their constructive, insightful and challenging comments. This work was supported by WINDMAL PGC2018-099959-B-I00 (MCIU/AEI/FEDER,UE), and SGR017-1188 (AGAUR).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Concurrent decentralized channel allocation and access point selection using multi-armed bandits in multi BSS WLANs

  • López Raventós, Álvaro
  • Bellalta, Boris
Enterprise Wireless Local Area Networks (WLANs) consist of multiple Access Points (APs) covering a given area. In these networks, interference is mitigated by allocating different channels to neighboring APs. Besides, stations are allowed to associate to any AP in the network, selecting by default the one from which receive higher power, even if it is not the best option in terms of the network performance. Finding a suitable network configuration able to maximize the performance of enterprise WLANs is a challenging task given the complex dependencies between APs and stations. Recently, in wireless networking, the use of reinforcement learning techniques has emerged as an effective solution to efficiently explore the impact of different network configurations in the system performance, identifying those that provide better performance. In this paper, we study if Multi-Armed Bandits (MABs) are able to offer a feasible solution to the decentralized channel allocation and AP selection problems in Enterprise WLAN scenarios. To do so, we empower APs and stations with agents that, by means of implementing the Thompson sampling algorithm, explore and learn which is the best channel to use, and which is the best AP to associate, respectively. Our evaluation is performed over randomly generated scenarios, which enclose different network topologies and traffic loads. The presented results show that the proposed adaptive framework using MABs outperform the static approach (i.e., using always the initial default configuration, usually random) regardless of the network density and the traffic requirements. Moreover, we show that the use of the proposed framework reduces the performance variability between different scenarios. Also, results show that we achieve the same performance (or better) than static strategies with less APs for the same number of stations. Finally, special attention is placed on how the agents interact. Even if the agents operate in a completely independent manner, their decisions have interrelated effects, as they take actions over the same set of channel resources., This work has been partially supported by the Spanish Ministry of Economy and Competitiveness under the Maria de Maeztu Units of Excellence Programme (MDM2015-0502), by the Spanish Government under grant WINDMAL PGC2018-099959-B-I00 (MCIU/AEI/FEDER,UE), by the Catalan Government under grant 2017-SGR-1188, and by a Gift from the Cisco University Research Program (CG#890107, Towards Deterministic Channel Access in High-Density WLANs) Fund, a corporate advised fund of Silicon Valley Community Foundation.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Usage of network simulators in machine-learning-assisted 5G/6G networks

  • Wilhelmi Roca, Francesc
  • Carrascosa Zamacois, Marc
  • Cano, Cristina
  • Jonsson, Anders, 1973-
  • Ram, Vishnu
  • Bellalta, Boris
Without any doubt, Machine Learning (ML) will be an important driver of future communications due to its foreseen performance when applied to complex problems. However, the application of ML to networking systems raises concerns among network operators and other stakeholders, especially regarding trustworthiness and reliability. In this article, we devise the role of network simulators for bridging the gap between ML and communications systems. In particular, we present an architectural integration of simulators in ML-aware networks for training, testing, and validating ML models before being applied to the operative network. Moreover, we provide insights into the main challenges resulting from this integration, and then give hints discussing how they can be overcome. Finally, we illustrate the integration of network simulators into ML-assisted communications through a proof-of-concept testbed implementation of a residential WiFi network., This work has been partially supported by grants MDM-2015-0502, WINDMAL PGC2018-099959- B-I00 (MCIU/AEI/FEDER,UE), 2017-SGR-11888, and by SPOTS project (RTI2018-095438-A-I00) funded by the Spanish Ministry of Science, Innovation and Universities.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Multi-armed bandits for spectrum allocation in multi-agent channel bonding WLANs

  • Bellalta, Boris
While dynamic channel bonding (DCB) is proven to boost the capacity of wireless local area networks (WLANs) by adapting the bandwidth on a per-frame basis, its performance is tied to the primary and secondary channel selection. Unfortunately, in uncoordinated high-density deployments where multiple basic service sets (BSSs) may potentially overlap, hand-crafted spectrum management techniques perform poorly given the complex hidden/exposed nodes interactions. To cope with such challenging Wi-Fi environments, in this paper, we first identify machine learning (ML) approaches applicable to the problem at hand and justify why model-free RL suits it the most. We then design a complete RL framework and call into question whether the use of complex RL algorithms helps the quest for rapid learning in realistic scenarios. Through extensive simulations, we derive that stateless RL in the form of lightweight multi-armed-bandits (MABs) is an efficient solution for rapid adaptation avoiding the definition of broad and/or meaningless states. In contrast to most current trends, we envision lightweight MABs as an appropriate alternative to the cumbersome and slowly convergent methods such as Q-learning, and especially, deep reinforcement learning., The work of Sergio Barrachina-Muñoz and Boris Bellalta was supported in part by Cisco, Machine Learning for Wireless Networking in Highly Dynamic Scenarios (WINDMAL), under Grant PGC2018-099959-B-I00 [Ministerio de Ciencia e Innovación (MCIU)/Agencia Estatal de Innovación (AEI)/Fondo Europeo de Desarrollo Regional (FEDER), Union Europea (UE)] and Grant SGR-2017-1188. The work of Alessandro Chiumento was supported in part by the ECSEL Joint Undertaking (JU) through the Intelligent Secure Trustable Things (InSecTT) Project (https://www.insectt.eu/) under Grant 876038., The work of Sergio Barrachina-Muñoz and Boris Bellalta was supported in part by Cisco, Machine Learning for Wireless Networking in Highly Dynamic Scenarios (WINDMAL), under Grant PGC2018-099959-B-I00 [Ministerio de Ciencia e Innovación (MCIU)/Agencia Estatal de Innovación (AEI)/Fondo Europeo de Desarrollo Regional (FEDER), Union Europea (UE)] and Grant SGR-2017-1188. The work of Alessandro Chiumento was supported in part by the ECSEL Joint Undertaking (JU) through the Intelligent Secure Trustable Things (InSecTT) Project (https://www.insectt.eu/) under Grant 876038.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Channel estimation and hybrid combining for wideband terahertz massive MIMO systems

  • Dovelos, Konstantinos
  • Matthaiou, Michail
  • Ngo, Hien Quoc
  • Bellalta, Boris
Terahertz (THz) communication is widely considered as a key enabler for future 6G wireless systems. However, THz links are subject to high propagation losses and inter-symbol interference due to the frequency selectivity of the channel. Massive multiple-input multiple-output (MIMO) along with orthogonal frequency division multiplexing (OFDM) can be used to deal with these problems. Nevertheless, when the propagation delay across the base station (BS) antenna array exceeds the symbol period, the spatial response of the BS array varies over the OFDM subcarriers. This phenomenon, known as beam squint, renders narrowband combining approaches ineffective. Additionally, channel estimation becomes challenging in the absence of combining gain during the training stage. In this work, we address the channel estimation and hybrid combining problems in wideband THz massive MIMO with uniform planar arrays. Specifically, we first introduce a low-complexity beam squint mitigation scheme based on true-time-delay. Next, we propose a novel variant of the popular orthogonal matching pursuit (OMP) algorithm to accurately estimate the channel with low training overhead. Our channel estimation and hybrid combining schemes are analyzed both theoretically and numerically. Moreover, the proposed schemes are extended to the multi-antenna user case. Simulation results are provided showcasing the performance gains offered by our design compared to standard narrowband combining and OMP-based channel estimation., Manuscript received July 7, 2020; revised November 20, 2020, and February 12, 2021; accepted March 1, 2021. The work of K. Dovelos and B. Bellalta was supported by grants WINDMAL PGC2018-099959-B-I00 (MCIU/AEI/FEDER,UE), and SGR017-1188 (AGAUR). The work of M. Matthaiou was supported by the EPSRC, U.K., under Grant EP/P000673/1 and by a research grant from the Department for the Economy Northern Ireland under the US-Ireland R&D Partnership Programme. The work of H. Q. Ngo was supported by the U.K. Research and Innovation Future Leaders Fellowships under Grant MR/S017666/1.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Combining software defined networks and machine learning to enable self organizing WLANs

  • López Raventós, Álvaro
  • Wilhelmi Roca, Francesc
  • Barrachina Muñoz, Sergio
  • Bellalta, Boris
Comunicació presentada al International Conference on Wireless and Mobile Computing, Networking and Communications (WiMob 2019), celebrat del 21 al 23 d'octubre de 2020 a Barcelona, Espanya., Next generation of wireless local area networks (WLANs) will operate in dense, chaotic and highly dynamic scenarios that in a significant number of cases may result in a low user experience due to uncontrolled high interference levels. Flexible network architectures, such as the software-defined networking (SDN) paradigm, will provide WLANs with new capabilities to deal with users' demands, while achieving greater levels of efficiency and flexibility in those complex scenarios. On top of SDN, the use of machine learning (ML) techniques may improve network resource usage and management by identifying feasible configurations through learning. ML techniques can drive WLANs to reach optimal working points by means of parameter adjustment, in order to cope with different network requirements and policies, as well as with the dynamic conditions. In this paper we overview the work done in SDN for WLANs, as well as the pioneering works considering ML for WLAN optimization. Finally, in order to demonstrate the potential of ML techniques in combination with SDN to improve the network operation, we evaluate different use cases for intelligent-based spatial reuse and dynamic channel bonding operation in WLANs using Multi-Armed Bandits., This work has been partially supported by the Spanish Ministry of Economy and Competitiveness under the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502), by the Catalan Government under grant 2017-SGR-1188, by the Spanish Government under grant PGC2018-099959-B-I00 (MCIU/AEI/FEDER,UE), and by a Gift from the Cisco University Research Program (CG#890107, Towards Deterministic Channel Access in High-Density WLANs) Fund, a corporate advised fund of Silicon Valley Community Foundation. The work done by S. Barrachina-Mu ˜noz is supported by a FI grant from the Generalitat de Catalunya.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Cloud-gaming: analysis of Google Stadia traffic

  • Carrascosa Zamacois, Marc
  • Bellalta, Boris
Interactive, real-time, and high-quality cloud video games pose a serious challenge to the Internet due to simultaneous high-throughput and low round trip delay requirements. In this paper, we investigate the traffic characteristics of Stadia, the cloud-gaming solution from Google, which is likely to become one of the dominant players in the gaming sector. To do that, we design several experiments, and perform an extensive traffic measurement campaign to obtain all required data. Our first goal is to gather a deep understanding of Stadia traffic characteristics by identifying the different protocols involved for both signaling and video/audio contents, the traffic generation patterns, and the packet size and inter-packet time probability distributions. Then, our second goal is to understand how different Stadia games and configurations, such as the video codec and the video resolution selected, impact on the characteristics of the generated traffic. We also evaluate the ability of Stadia to adapt to different link capacity conditions, including cases where the capacity drops suddenly, as well as sudden increases in the network latency. Our results and findings, besides illustrating the characteristics of Stadia traffic, are also valuable for planning and dimensioning future networks, as well as for designing new resource management strategies. Finally, we compare Stadia traffic to other video streaming applications, showcasing the main differences between them, and introduce a traffic model using our captures. We show that this model can be used in simulations to further investigate the network performance in presence of Stadia traffic., This work was supported by grants WINDMAL, Spain PGC2018-099959-B-I00 (MCIU/AEI/FEDER,UE), and SGR017-1188 (AGAUR).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Dynamic traffic allocation in IEEE 802.11be multi-Link WLANs

  • López Raventós, Álvaro
  • Bellalta, Boris
The multi-link operation (MLO) is a key feature of the next IEEE 802.11be Extremely High Throughput amendment. Through its adoption, it is expected to enhance users’ experience by improving throughput rates and latency. However, potential MLO gains are tied to how traffic is distributed across the multiple radio interfaces. In this letter, we introduce a traffic manager atop MLO, and evaluate different high-level traffic-to-link allocation policies to distribute incoming traffic over the set of enabled interfaces. Following a flow-level approach, we compare both non-dynamic and dynamic traffic balancing policy types. The results show that the use of a dynamic policy, along with MLO, allows to significantly reduce the congestion suffered by traffic flows, enhancing the traffic delivery in all the evaluated scenarios, and in particular improving the quality of service received by video flows. Moreover, we show that the adoption of MLO in future Wi-Fi networks improves also the coexistence with non-MLO networks, which results in performance gains for both MLO and non-MLO networks., This work was supported in part by the Spanish Government under Grant WINDMAL PGC2018-099959-B-I00 (MCIU/AEI/FEDER,UE), and in part by Cisco.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Multi-armed bandits for spectrum allocation in multi-agent channel bonding WLANs

  • Bellalta, Boris
While dynamic channel bonding (DCB) is proven to boost the capacity of wireless local area networks (WLANs) by adapting the bandwidth on a per-frame basis, its performance is tied to the primary and secondary channel selection. Unfortunately, in uncoordinated high-density deployments where multiple basic service sets (BSSs) may potentially overlap, hand-crafted spectrum management techniques perform poorly given the complex hidden/exposed nodes interactions. To cope with such challenging Wi-Fi environments, in this paper, we first identify machine learning (ML) approaches applicable to the problem at hand and justify why model-free RL suits it the most. We then design a complete RL framework and call into question whether the use of complex RL algorithms helps the quest for rapid learning in realistic scenarios. Through extensive simulations, we derive that stateless RL in the form of lightweight multi-armed-bandits (MABs) is an efficient solution for rapid adaptation avoiding the definition of broad and/or meaningless states. In contrast to most current trends, we envision lightweight MABs as an appropriate alternative to the cumbersome and slowly convergent methods such as Q-learning, and especially, deep reinforcement learning., The work of Sergio Barrachina-Muñoz and Boris Bellalta was supported in part by Cisco, Machine Learning for Wireless Networking in Highly Dynamic Scenarios (WINDMAL), under Grant PGC2018-099959-B-I00 [Ministerio de Ciencia e Innovación (MCIU)/Agencia Estatal de Innovación (AEI)/Fondo Europeo de Desarrollo Regional (FEDER), Union Europea (UE)] and Grant SGR-2017-1188. The work of Alessandro Chiumento was supported in part by the ECSEL Joint Undertaking (JU) through the Intelligent Secure Trustable Things (InSecTT) Project (https://www.insectt.eu/) under Grant 876038., The work of Sergio Barrachina-Muñoz and Boris Bellalta was supported in part by Cisco, Machine Learning for Wireless Networking in Highly Dynamic Scenarios (WINDMAL), under Grant PGC2018-099959-B-I00 [Ministerio de Ciencia e Innovación (MCIU)/Agencia Estatal de Innovación (AEI)/Fondo Europeo de Desarrollo Regional (FEDER), Union Europea (UE)] and Grant SGR-2017-1188. The work of Alessandro Chiumento was supported in part by the ECSEL Joint Undertaking (JU) through the Intelligent Secure Trustable Things (InSecTT) Project (https://www.insectt.eu/) under Grant 876038.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Dynamic traffic allocation in IEEE 802.11be multi-Link WLANs

  • López Raventós, Álvaro
  • Bellalta, Boris
The multi-link operation (MLO) is a key feature of the next IEEE 802.11be Extremely High Throughput amendment. Through its adoption, it is expected to enhance users’ experience by improving throughput rates and latency. However, potential MLO gains are tied to how traffic is distributed across the multiple radio interfaces. In this letter, we introduce a traffic manager atop MLO, and evaluate different high-level traffic-to-link allocation policies to distribute incoming traffic over the set of enabled interfaces. Following a flow-level approach, we compare both non-dynamic and dynamic traffic balancing policy types. The results show that the use of a dynamic policy, along with MLO, allows to significantly reduce the congestion suffered by traffic flows, enhancing the traffic delivery in all the evaluated scenarios, and in particular improving the quality of service received by video flows. Moreover, we show that the adoption of MLO in future Wi-Fi networks improves also the coexistence with non-MLO networks, which results in performance gains for both MLO and non-MLO networks., This work was supported in part by the Spanish Government under Grant WINDMAL PGC2018-099959-B-I00 (MCIU/AEI/FEDER,UE), and in part by Cisco.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Cloud-gaming: analysis of Google Stadia traffic

  • Carrascosa Zamacois, Marc
  • Bellalta, Boris
Interactive, real-time, and high-quality cloud video games pose a serious challenge to the Internet due to simultaneous high-throughput and low round trip delay requirements. In this paper, we investigate the traffic characteristics of Stadia, the cloud-gaming solution from Google, which is likely to become one of the dominant players in the gaming sector. To do that, we design several experiments, and perform an extensive traffic measurement campaign to obtain all required data. Our first goal is to gather a deep understanding of Stadia traffic characteristics by identifying the different protocols involved for both signaling and video/audio contents, the traffic generation patterns, and the packet size and inter-packet time probability distributions. Then, our second goal is to understand how different Stadia games and configurations, such as the video codec and the video resolution selected, impact on the characteristics of the generated traffic. We also evaluate the ability of Stadia to adapt to different link capacity conditions, including cases where the capacity drops suddenly, as well as sudden increases in the network latency. Our results and findings, besides illustrating the characteristics of Stadia traffic, are also valuable for planning and dimensioning future networks, as well as for designing new resource management strategies. Finally, we compare Stadia traffic to other video streaming applications, showcasing the main differences between them, and introduce a traffic model using our captures. We show that this model can be used in simulations to further investigate the network performance in presence of Stadia traffic., This work was supported by grants WINDMAL, Spain PGC2018-099959-B-I00 (MCIU/AEI/FEDER,UE), and SGR017-1188 (AGAUR).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Channel estimation and hybrid combining for wideband terahertz massive MIMO systems

  • Dovelos, Konstantinos
  • Matthaiou, Michail
  • Ngo, Hien Quoc
  • Bellalta, Boris
Terahertz (THz) communication is widely considered as a key enabler for future 6G wireless systems. However, THz links are subject to high propagation losses and inter-symbol interference due to the frequency selectivity of the channel. Massive multiple-input multiple-output (MIMO) along with orthogonal frequency division multiplexing (OFDM) can be used to deal with these problems. Nevertheless, when the propagation delay across the base station (BS) antenna array exceeds the symbol period, the spatial response of the BS array varies over the OFDM subcarriers. This phenomenon, known as beam squint, renders narrowband combining approaches ineffective. Additionally, channel estimation becomes challenging in the absence of combining gain during the training stage. In this work, we address the channel estimation and hybrid combining problems in wideband THz massive MIMO with uniform planar arrays. Specifically, we first introduce a low-complexity beam squint mitigation scheme based on true-time-delay. Next, we propose a novel variant of the popular orthogonal matching pursuit (OMP) algorithm to accurately estimate the channel with low training overhead. Our channel estimation and hybrid combining schemes are analyzed both theoretically and numerically. Moreover, the proposed schemes are extended to the multi-antenna user case. Simulation results are provided showcasing the performance gains offered by our design compared to standard narrowband combining and OMP-based channel estimation., Manuscript received July 7, 2020; revised November 20, 2020, and February 12, 2021; accepted March 1, 2021. The work of K. Dovelos and B. Bellalta was supported by grants WINDMAL PGC2018-099959-B-I00 (MCIU/AEI/FEDER,UE), and SGR017-1188 (AGAUR). The work of M. Matthaiou was supported by the EPSRC, U.K., under Grant EP/P000673/1 and by a research grant from the Department for the Economy Northern Ireland under the US-Ireland R&D Partnership Programme. The work of H. Q. Ngo was supported by the U.K. Research and Innovation Future Leaders Fellowships under Grant MR/S017666/1.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Combining software defined networks and machine learning to enable self organizing WLANs

  • López Raventós, Álvaro
  • Wilhelmi Roca, Francesc
  • Barrachina Muñoz, Sergio
  • Bellalta, Boris
Comunicació presentada al International Conference on Wireless and Mobile Computing, Networking and Communications (WiMob 2019), celebrat del 21 al 23 d'octubre de 2020 a Barcelona, Espanya., Next generation of wireless local area networks (WLANs) will operate in dense, chaotic and highly dynamic scenarios that in a significant number of cases may result in a low user experience due to uncontrolled high interference levels. Flexible network architectures, such as the software-defined networking (SDN) paradigm, will provide WLANs with new capabilities to deal with users' demands, while achieving greater levels of efficiency and flexibility in those complex scenarios. On top of SDN, the use of machine learning (ML) techniques may improve network resource usage and management by identifying feasible configurations through learning. ML techniques can drive WLANs to reach optimal working points by means of parameter adjustment, in order to cope with different network requirements and policies, as well as with the dynamic conditions. In this paper we overview the work done in SDN for WLANs, as well as the pioneering works considering ML for WLAN optimization. Finally, in order to demonstrate the potential of ML techniques in combination with SDN to improve the network operation, we evaluate different use cases for intelligent-based spatial reuse and dynamic channel bonding operation in WLANs using Multi-Armed Bandits., This work has been partially supported by the Spanish Ministry of Economy and Competitiveness under the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502), by the Catalan Government under grant 2017-SGR-1188, by the Spanish Government under grant PGC2018-099959-B-I00 (MCIU/AEI/FEDER,UE), and by a Gift from the Cisco University Research Program (CG#890107, Towards Deterministic Channel Access in High-Density WLANs) Fund, a corporate advised fund of Silicon Valley Community Foundation. The work done by S. Barrachina-Mu ˜noz is supported by a FI grant from the Generalitat de Catalunya.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Wi-Fi meets ML: a survey on improving IEEE 802.11 performance with machine learning

  • Szott, Szymon
  • Kosek-Szott, Katarzyna
  • Gawłowicz, Piotr
  • Torres Gómez, Jorge
  • Bellalta, Boris
  • Zubow, Anatolij
  • Dressler, Falko
Wireless local area networks (WLANs) empowered by IEEE 802.11 (Wi-Fi) hold a dominant position in providing Internet access thanks to their freedom of deployment and configuration as well as the existence of affordable and highly interoperable devices. The Wi-Fi community is currently deploying Wi-Fi 6 and developing Wi-Fi 7, which will bring higher data rates, better multi-user and multi-AP support, and, most importantly, improved configuration flexibility. These technical innovations, including the plethora of configuration parameters, are making next-generation WLANs exceedingly complex as the dependencies between parameters and their joint optimization usually have a non-linear impact on network performance. The complexity is further increased in the case of dense deployments and coexistence in shared bands. While classical optimization approaches fail in such conditions, machine learning (ML) is able to handle complexity. Much research has been published on using ML to improve Wi-Fi performance and solutions are slowly being adopted in existing deployments. In this survey, we adopt a structured approach to describe the various Wi-Fi areas where ML is applied. To this end, we analyze over 250 papers in the field, providing readers with an overview of the main trends. Based on this review, we identify specific open challenges and provide general future research directions., This work was supported in part by the National Science Centre, Poland, under Grant DEC-2020/39/I/ST7/01457; in part by the Federal Ministry of Education and Research (BMBF, Germany) Project OTB-5G+ under Grant 16KIS0985; in part by the 6G Research and Innovation Cluster 6G-RIC under Grant 16KISK020K; in part by the Project ML4WIFI funded by the German Research Foundation (DFG) under Grant DR 639/28-1; in part by the Ministerio de Ciencia e Innovación/Agencia Española de Investigación/Fondo Europeo de Desarrollo Regional (MCIU/AEI/FEDER), European Union (UE) under Grant WINDMAL PGC2018-099959-B-I00; and in part by Agència de Gestió d’Ajuts Universitaris i de Recerca (AGAUR) under Grant SGR017-1188.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Usage of network simulators in machine-learning-assisted 5G/6G networks

  • Wilhelmi Roca, Francesc
  • Carrascosa Zamacois, Marc
  • Cano, Cristina
  • Jonsson, Anders, 1973-
  • Ram, Vishnu
  • Bellalta, Boris
Without any doubt, Machine Learning (ML) will be an important driver of future communications due to its foreseen performance when applied to complex problems. However, the application of ML to networking systems raises concerns among network operators and other stakeholders, especially regarding trustworthiness and reliability. In this article, we devise the role of network simulators for bridging the gap between ML and communications systems. In particular, we present an architectural integration of simulators in ML-aware networks for training, testing, and validating ML models before being applied to the operative network. Moreover, we provide insights into the main challenges resulting from this integration, and then give hints discussing how they can be overcome. Finally, we illustrate the integration of network simulators into ML-assisted communications through a proof-of-concept testbed implementation of a residential WiFi network., This work has been partially supported by grants MDM-2015-0502, WINDMAL PGC2018-099959- B-I00 (MCIU/AEI/FEDER,UE), 2017-SGR-11888, and by SPOTS project (RTI2018-095438-A-I00) funded by the Spanish Ministry of Science, Innovation and Universities.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Multi-link operation in IEEE 802.11be WLANs

  • López Raventós, Álvaro
  • Bellalta, Boris
The multi-link operation (MLO) is a new feature proposed to be part of the IEEE 802.11be Extremely High Throughput (EHT) amendment. Such feature represents a paradigm shift towards multi-link communications, as nodes will be allowed to transmit and receive data over multiple radio interfaces concurrently. To make it possible, the 802.11be Task Group has proposed different modifications in regards to nodes' architecture, transmission operation, and management functionalities. This article reviews such changes and tackles the question of how traffic should be distributed over multiple links, as it is still unresolved. To that end, we evaluate different load balancing strategies over the active links. Results show that in high load, dense and complex scenarios, implementing congestion aware load balancing policies to significantly enhance next-generation WLAN performance using MLO is a must., This work has been partially supported by the Spanish Government under grant WINDMAL PGC2018-099959-B-I00 (MCIU/AEI/FEDER,UE), by the Catalan Government under grant 2017-SGR1188, and Cisco.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Concurrent decentralized channel allocation and access point selection using multi-armed bandits in multi BSS WLANs

  • López Raventós, Álvaro
  • Bellalta, Boris
Enterprise Wireless Local Area Networks (WLANs) consist of multiple Access Points (APs) covering a given area. In these networks, interference is mitigated by allocating different channels to neighboring APs. Besides, stations are allowed to associate to any AP in the network, selecting by default the one from which receive higher power, even if it is not the best option in terms of the network performance. Finding a suitable network configuration able to maximize the performance of enterprise WLANs is a challenging task given the complex dependencies between APs and stations. Recently, in wireless networking, the use of reinforcement learning techniques has emerged as an effective solution to efficiently explore the impact of different network configurations in the system performance, identifying those that provide better performance. In this paper, we study if Multi-Armed Bandits (MABs) are able to offer a feasible solution to the decentralized channel allocation and AP selection problems in Enterprise WLAN scenarios. To do so, we empower APs and stations with agents that, by means of implementing the Thompson sampling algorithm, explore and learn which is the best channel to use, and which is the best AP to associate, respectively. Our evaluation is performed over randomly generated scenarios, which enclose different network topologies and traffic loads. The presented results show that the proposed adaptive framework using MABs outperform the static approach (i.e., using always the initial default configuration, usually random) regardless of the network density and the traffic requirements. Moreover, we show that the use of the proposed framework reduces the performance variability between different scenarios. Also, results show that we achieve the same performance (or better) than static strategies with less APs for the same number of stations. Finally, special attention is placed on how the agents interact. Even if the agents operate in a completely independent manner, their decisions have interrelated effects, as they take actions over the same set of channel resources., This work has been partially supported by the Spanish Ministry of Economy and Competitiveness under the Maria de Maeztu Units of Excellence Programme (MDM2015-0502), by the Spanish Government under grant WINDMAL PGC2018-099959-B-I00 (MCIU/AEI/FEDER,UE), by the Catalan Government under grant 2017-SGR-1188, and by a Gift from the Cisco University Research Program (CG#890107, Towards Deterministic Channel Access in High-Density WLANs) Fund, a corporate advised fund of Silicon Valley Community Foundation.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

On the Low-latency region of best-effort links for delay-sensitive streaming traffic

  • Bellalta, Boris
This letter analyzes the Low-latency Region (LLR) of a best-effort link (i.e., no traffic differentiation, and first come first serve scheduling) carrying both delay-sensitive (DS) streaming and non-delay-sensitive (NDS) background traffic. Moreover, inside the LLR, we show it exists a proportional fair arrival rate allocation for both the DS and NDS traffic streams. This optimal operating point results from maximizing a simple throughput-delay trade-off that considers the NDS traffic load, and the mean delay of the DS packets. To show how the presented trade-off could be used to allocate NDS traffic in a realistic scenario, we use Google Stadia traffic traces to generate the DS flow. Results from this use-case confirm that the throughput-delay trade-off also works regardless the distribution of the packet arrival and packet service times., The author would like to thank Marc Carrascosa for his contribution in taking the Google Stadia measurements. Also, the author wants to especially thank the anonymous reviewers for their constructive, insightful and challenging comments. This work was supported by WINDMAL PGC2018-099959-B-I00 (MCIU/AEI/FEDER,UE), and SGR017-1188 (AGAUR).