Pasar al contenido principal

Resultados relacionados

Resultados totales (Incluyendo duplicados): 11
Encontrada(s) 1 página(s)

IMDEA Networks Institute Digital Repository
Publicación Tesis doctoral (DoctoralThesis)

User-Plane Algorithms for Stateless and Stateful Inference in Programmable Networks

  • Akem, Aristide Tanyi-Jong
Over the past decade, network complexity has grown exponentially to support the emergence of new and innovative applications. This increased sophistication has rendered most human-in-the-loop approaches to network management tasks obsolete, calling for more automation and flexibility in the network. The advent of Software Defined Networking (SDN) with a programmable control plane was a huge step in the right direction, giving rise to a variety of network automation applications running in the SDN control plane. With the vulgarization of Machine Learning (ML) in recent years, many network automation applications use ML techniques to address network problems like intrusion detection, routing optimization, quality of service prioritization, and fault detection. Yet, as these applications run in the control plane, many of them cannot respond in real-time to network issues and incur a response delay in the order of milliseconds to seconds, which is undesirable in ultra-low-latency applications that will abound in 6G networks. Recent advances in user-plane programmability have led to the current availability of off-the-shelf programmable user-plane equipment like Intel Tofino switches, alongside compatible network programming languages like P4. This has sparked a strong interest in in-network computation, with efforts to offload ML models from the control plane to the user plane to reduce their response time and enable inference at line rate with low latency and high throughput. Most work on user-plane inference has focused on programmable switches due to their ubiquitous presence in the network and the availability of multiple high-speed ports. However, switches are highly constrained in terms of available memory, support for mathematical operations, and the number of allowed operations per packet. This makes it impossible to train ML models in the switch and shifts the focus to deploying trained models into user-plane switches. The constraints above also make complex models like Neural Networks (NN) less feasible for in-switch deployment. Instead, most prior works have deployed tree-based models like Decision Trees (DT) and Random Forests (RF) for in-switch inference due to their simple logical structure and few operations required at inference, which make them ideal for constrained environments. Yet, these works have several limitations such as limited scalability and adaptability which translate into performance barriers when handling complex inference tasks. This thesis proposes efficient solutions for embedding ML models into production-grade programmable switches, thereby addressing the above limitations and advancing the state of the art in ML-based user-plane inference. To illustrate the evolution across the solutions presented in the thesis, a practical application of user-plane inference is considered to show how in-switch inference can enable rapid detection of cyberattacks on SDN-based Smart Grid (SG) networks. Current power grids are smart, with millions of electronic devices interconnected by data networks. This exposes them to many cyberattacks which could lead to power outages and data breaches with far-reaching impacts. Thus, the timely detection of cyberattacks is critical. ML models are widely used for cyberattack detection in SDN-based SGs, where the models either run in external servers or in-network but fully in the control plane or distributed between the control and user planes. In these cases, the models do not run at line rate and incur millisecond-level delays in attack detection. The application developed in this thesis explores how ML inference in programmable switches at Packet-Level (PL) can enable accelerated attack detection and mitigation in SGs at line rate with sub-microsecond delay. The proposed workflow brings the concept of user-plane inference to SDN-based SGs for the first time, and deploys a trained DT model into the switch pipeline for real-time inference on live traffic. Results produced in this thesis show how a pure user plane solution achieves up to 99% accuracy in attack detection and classification, while operating up to four orders of magnitude faster than solutions running entirely in the control plane. The above solution and all earlier solutions for PL inference in the user-plane focus on flat classification, and have significant structural limitations that prevent them from scaling when handling complex inference tasks. To tackle these limitations, this thesis proposes Henna, the pioneer implementation of an in-switch multi-stage hierarchical classification system. The concept upon which Henna hinges is that of splitting a difficult classification task into easier cascaded inference tasks, which can then be addressed with separate resource-efficient tree-based classifiers. The design of Henna aligns with the internal organization of the Protocol Independent Switch Architecture (PISA), and integrates state-of-the-art strategies for mapping decision trees to switch hardware. Henna is then implemented into a real-world testbed with off-the-shelf Intel Tofino programmable switches using the P4 language. Experiments with a complex 21-category classification task based on measurement data exhibit how Henna improves the F1-score of an advanced single-stage model by 21%, while maintaining usage of switch resources at 8% on average. Despite the improvements brought about by Henna, existing hardware-compatible in switch inference solutions are still either limited to only PL operation, lack support for rich statistical features, or are not scalable, hitting performance barriers in complex tasks involving large decision spaces. To address this limitation, Flowrest is presented as a first complete RF model implementation that operates at the level of individual flows in commercial switches. The proposed solution builds on (i) novel guidelines for tailoring RF models to operation in programmable switches right from the design phase, (ii) an original framework to embed flow-level (FL) machine learning models into programmable switch ASICs, and (iii) efficient strategies for maintaining state within switches to compute, store and employ FL features for inference. Flowrest is implemented in a hardware switch as an open-source software using the P4 language. Flowrest sets a new standard for FL inference in the user plane. To validate this claim, a thorough evaluation of the proposed solution is conducted in an experimental platform based on Intel Tofino switches in two steps; (i) Flowrest is evaluated on unencrypted traffic, comparing it to major existing proposals for in-switch inference which all target unencrypted traffic, and (ii) it is then evaluated on encrypted traffic classification. Results from the evaluation with tasks of unprecedented complexity show how Flowrest achieves accuracy gains in the 10% − 39% range over previous approaches to implement DT and RF models in real-world equipment. Despite the improved performance resulting from FL classification, a major dichotomy still exists between works for in-switch inference, based on whether they operate at PL or FL. The former relies on simple features from packet headers that are simple to implement but limit accuracy in challenging use cases; the latter exploits richer flow based statistical features to improve accuracy, but leaves early packets in each flow unclassified. To close this gap, this thesis presents Jewel, an in-switch ML solution based on a fully joint PL and FL design, which offers the best of both worlds by classifying early flow packets individually at PL and shifting to FL inference as soon as possible. The proposed solution involves (i) a single RF model trained to classify both packets and flows, and (ii) hardware-aware model selection and training techniques for resource footprint minimization. Jewel is implemented in P4 and deployed in a testbed with Intel Tofino switches, where extensive experiments are conducted with a variety of real world use cases. Results from experiments conducted in this thesis reveal how Jewel outperforms four state-of-the-art benchmarks, with absolute accuracy gains in the 2.0%−5.3% range, while consuming a modest amount of switch resources. In summary, this thesis proposes novel solutions for inference in programmable network user planes. Technical details on the design and implementation of the proposed solutions are described first, followed by thorough experimental evaluations that shed light on the merits of each solution in comparison to prior work. Through these contributions, this thesis sets new standards in user-plane ML inference and makes steps towards enabling and encouraging the pervasive adoption of user-plane inference in programmable networks by making all the solutions open-source., Project PCI2022-133013 (ECOMOME), funded by MICIU/AEI/10.13039/501100011033 and the European Union "NextGenerationEU"/PRTR, European Union’s Horizon Europe research and innovation programme under Marie Skłodowska-Curie grant agreement no. 860239 "BANYAN", Telematics Engineering, Universidad Carlos III de Madrid, Spain
IMDEA Networks Institute Digital Repository
Publicación Contribución de congreso (ConferenceOutput)

Showcasing In-Switch Machine Learning Inference

  • Akem, Aristide Tanyi-Jong
  • Bütün, Beyza|||0000-0001-7442-9668
  • Gucciardo, Michele|||0000-0001-5689-9949
  • Fiore, Marco|||0000-0002-0772-9967
Recent endeavours have enabled the integration of trained machine learning models like Random Forests in resource-constrained programmable switches for line rate inference. In this work, we first show how packet-level information can be used to classify individual packets in production-level hardware with very low latency. We then demonstrate how the newly proposed Flowrest framework improves classification performance relative to the packet-level approach by exploiting flow-level statistics to instead classify traffic flows entirely within the switch without considerably increasing latency. We conduct experiments using measurement data in a real-world testbed with an Intel Tofino switch and shed light on how Flowrest achieves an F1-score of 99% in a service classification use case, outperforming its packet-level counterpart by 8%., European Union Horizon 2020 research and innovation program under grant agreement no. 101017109 “DAEMON”, European Union Horizon 2020 research and innovation program under Marie Skłodowska-Curie grant agreement no. 860239 “BANYAN”, CHIST-ERA grant no. CHIST-ERA-20-SICT- 001 “ECOMOME”, via grant PCI2022-133013 of Agencia Estatal de Investigación, Best Demo Award, TRUE, pub
IMDEA Networks Institute Digital Repository
Publicación Contribución de congreso (ConferenceOutput)

Stochastic Evaluation of Indoor Wireless Network Performance with Data-Driven Propagation Models

  • Bakirtzis, Stefanos
  • Wassell, Ian
  • Fiore, Marco|||0000-0002-0772-9967
  • Zhang, Jie
Cell densification through the installation of small- cells and femtocells in indoor environments is an emerging solution to enhance the operation of wireless networks. The deployment of new components within the heart of the radio access network calls for expedient tools that assist and ensure their optimal placement within the existing network infrastructure. In this paper, we introduce metrics that can characterize indoor wireless network performance (IWNP) in terms of coverage and capacity, and we evaluate them via physics-based propagation models. In particular, we exploit a deterministic propagation model, i.e., a ray-tracer, as well as a novel machine learning-based propagation model. We demonstrate that data-driven propagation models can be leveraged for the rigorous evaluation of the IWNP metrics, yielding a remarkable computational efficiency compared to the conventional deterministic models. The use of physics-based site- specific propagation models allows for the particularities of each indoor geometry to be taken into account, and also makes feasible the consideration of uncertainties related to the indoor environment. In this case, the IWNP metrics are expressed as stochastic quantities and a stochastic solution is derived through an efficient polynomial chaos expansion representation, enabling on-the-fly computation of the IWNP metrics statistics., European Commission, TRUE, pub
IMDEA Networks Institute Digital Repository
Publicación Contribución de congreso (ConferenceOutput)

Flowrest: Practical Flow-Level Inference in Programmable Switches with Random Forests

  • Akem, Aristide Tanyi-Jong
  • Gucciardo, Michele|||0000-0001-5689-9949
  • Fiore, Marco|||0000-0002-0772-9967
User-plane machine learning facilitates low-latency, high-throughput inference at line rate. Yet, user planes are highly constrained environments, and restrictions are especially marked in programmable switches with limited memory and minimum support for mathematical operations or data types. Thus, current solutions for in-switch inference that are compatible with production-level hardware lack support for complex features or suffer from limited scalability, and hit performance barriers in complex tasks involving large decision spaces. To address this limitation, we present Flowrest, a first complete Random Forest (RF) model implementation that operates at the level of individual flows in commercial switches. Our solution builds on (i) an original framework to embed flow-level machine learning models into programmable switch ASICs, and (ii) novel guidelines for tailoring RF models to operations in programmable switches already at the design stage. We implement Flowrest as an open-source software using the P4 language, and assess its performance in an experimental platform based on Intel Tofino switches. Tests with tasks of unprecedented complexity show how our model can improve accuracy by up to 39% over previous approaches to implement RF models in real-world equipment., European Union Horizon 2020 research and innovation program under Marie Skłodowska-Curie grant agreement no. 860239 “BANYAN”, European Union Horizon 2020 research and innovation program under grant agreement no. 101017109 “DAEMON”, TRUE, pub
IMDEA Networks Institute Digital Repository
Publicación Contribución de congreso (ConferenceOutput)

Henna: hierarchical machine learning inference in programmable switches

  • Akem, Aristide Tanyi-Jong
  • Bütün, Beyza|||0000-0001-7442-9668
  • Gucciardo, Michele|||0000-0001-5689-9949
  • Fiore, Marco|||0000-0002-0772-9967
The recent proliferation of programmable network equipment has opened up new possibilities for embedding intelligence into the data plane. Deploying models directly in the data plane promises to achieve high throughput and low latency inference capabilities that cannot be attained with traditional closed loops involving control-plane operations. Recent efforts have paved the way for the integration of trained machine learning models in resource-constrained programmable switches, yet current solutions have significant limitations that translate into performance barriers when coping with complex inference tasks. In this paper, we present Henna, a first in-switch implementation of a hierarchical classification system. The concept underpinning our solution is that of splitting a difficult classification task into easier cascaded decisions, which can then be addressed with separated and resource-efficient tree-based classifiers. We propose a design of Henna that aligns with the internal organization of the Protocol Independent Switch Architecture (PISA), and integrates state-of-the-art strategies for mapping decision trees to switch hardware. We then implement Henna into a real testbed with off-the-shelf Intel Tofino programmable switches using the P4 language. Experiments with a complex 21-category classification task based on measurement data demonstrate how Henna improves the F1 score of an advanced single-stage model by 21%, while keeping usage of switch resources at 8% on average., European Union Horizon 2020 research and innovation program under Marie Skłodowska-Curie grant agreement no. 860239 “BANYAN”, CHIST-ERA grant no. CHIST-ERA-20-SICT- 001 “ECOMOME”, via grant PCI2022-133013 of Agencia Estatal de Investigación, European Union Horizon 2020 research and innovation program under grant agreement no. 101017109 “DAEMON”, TRUE, pub
IMDEA Networks Institute Digital Repository
Publicación Contribución de congreso (ConferenceOutput)

Implementation and Scalability Evaluation of Random Forests for In-Switch Inference

  • Akem, Aristide Tanyi-Jong
  • Gucciardo, Michele|||0000-0001-5689-9949
  • Fiore, Marco|||0000-0002-0772-9967
We comparatively evaluate state-of-the-art solutions for in-switch machine learning inference. We demonstrate that random forest (RF) models attain accuracies on par with those of approaches based on neural networks, which are also less amenable to in-switch operation. Next, we implement the top two solutions for in-switch random forest representation using a unified framework that we propose to ensure their fair comparison. We then verify their performance, resource consumption and scalability with respect to the capabilities of production-grade programmable switches., European Union Horizon 2020 research and innovation program under grant agreement no. 101017109 “DAEMON”, European Union Horizon 2020 research and innovation program under Marie Skłodowska-Curie grant agreement no. 860239 “BANYAN”, FALSE, pub
IMDEA Networks Institute Digital Repository
Publicación Contribución de congreso (ConferenceOutput)

Encrypted Traffic Classification at Line Rate in Programmable Switches with Machine Learning

  • Akem, Aristide Tanyi-Jong
  • Fraysse, Guillaume
  • Fiore, Marco|||0000-0002-0772-9967
Encrypted Traffic Classification (ETC) has become an important area of research with Machine Learning (ML) methods being the state-of-the-art. However, most existing solutions either rely on offline ETC based on collected network data or on online ETC with models running in the control plane of Software-Defined Networks (SDN), all of which do not run at line rate and would not meet latency requirements of time-sensitive applications in modern networks. This work leverages recent advances in data plane programmability to achieve real-time ETC in programmable switches at line rate, with high throughput and low latency. The proposed solution comprises (i) an ETC-aware Random Forest (RF) modelling process where only features based on packet size and packet arrival times are used, and (ii) an encoding of the trained RF model into production-grade P4-programmable switches. The performance of the proposed in-switch ETC framework is evaluated using 3 encrypted traffic datasets with experiments in a real-world testbed with Intel Tofino switches, in the presence of background traffic at 40 Gbps. Results show how the solution achieves high classification accuracy of up to 95%, with sub-microsecond delay, while consuming on average less than 10% of total available switch hardware resources., Smart Networks and Services Joint Undertaking (SNS JU) under the European Union’s Horizon Europe research and innovation programme under grant agreement no. 101139270, European Union’s Horizon Europe research and innovation programme under Marie Skłodowska-Curie grant agreement no. 860239, TRUE, pub
IMDEA Networks Institute Digital Repository
Publicación Contribución de congreso (ConferenceOutput)

Demonstrating Flow-Level In-Switch Inference

  • Gucciardo, Michele|||0000-0001-5689-9949
  • Akem, Aristide Tanyi-Jong
  • Bütün, Beyza|||0000-0001-7442-9668
  • Fiore, Marco|||0000-0002-0772-9967
Existing approaches for in-switch inference with Random Forest (RF) models that can run on production-level hardware do not support flow-level features and have limited scalability to the task size. This leads to performance barriers when tackling complex inference problems with sizable decision spaces. Flowrest is a complete RF model framework that fills existing gaps in the existing literature and enables practical flow-level inference in commercial programmable switches. In this demonstration, we exhibit how Flowrest can classify individual traffic flows at line rate in an experimental platform based on Intel Tofino switches. To this end, we run experiments with real-world measurement data, and show how Flowrest yields improvements in accuracy with respect to solutions that are limited to packet-level inference in programmable hardware., European Union Horizon 2020 research and innovation program under grant agreement no. 101017109 “DAEMON”, European Union Horizon 2020 research and innovation program under Marie Skłodowska-Curie grant agreement no. 860239 “BANYAN”, CHIST-ERA grant no. CHIST-ERA-20-SICT- 001 “ECOMOME”, via grant PCI2022-133013 of Agencia Estatal de Investigación, TRUE, pub
IMDEA Networks Institute Digital Repository
Publicación Artículo científico (JournalArticle)

Deep Learning-based Multivariate Time Series Classification for Indoor/Outdoor Detection

  • Bakirtzis, Stefanos
  • Qiu, Kehai
  • Wassell, Ian
  • Fiore, Marco|||0000-0002-0772-9967
  • Zhang, Jie
Recently, the topic of indoor outdoor detection (IOD) has seen its popularity increase, as IOD models can be leveraged to augment the performance of numerous Internet of Things and other applications. IOD aims at distinguishing in an efficient manner whether a user resides in an indoor or an outdoor environment, by inspecting the cellular phone sensor recordings. Legacy IOD models attempt to determine a user’s environment by comparing the sensor measurements to some threshold values. However, as we also observe in our experiments, such models exhibit limited scalability, and their accuracy can be poor. Machine learning (ML)-based IOD models aim at removing this limitation, by utilizing a large volume of measurements to train ML algorithms to classify a user’s environment. Yet, in most of the existing research, the temporal dimension of the problem is disregarded. In this paper, we propose treating IOD as a multivariate time series classification (TSC) problem, and we explore the performance of various deep learning (DL) models. We demonstrate that a multivariate TSC approach can be used to monitor a user’s environment, and predict changes in its state, with greater accuracy compared to conventional approaches that ignore the feature variation over time. Additionally, we introduce a new DL model for multivariate TSC, exploiting the concept of self-attention and atrous spatial pyramid pooling. The proposed DL multivariate TSC framework exploits only low power consumption sensors to infer a user’s environment, and it outperforms state-of-the-art models, yielding a higher accuracy combined with a smaller computational cost., European Commission, TRUE, pub
IMDEA Networks Institute Digital Repository
Publicación Artículo científico (JournalArticle)

Forecasting Network Traffic: A Survey and Tutorial with Open-Source Comparative Evaluation

  • Ferreira, Gabriel O.
  • Ravazzi, Chiara
  • Dabbene, Fabrizio
  • Calafiore, Giuseppe C.
  • Fiore, Marco|||0000-0002-0772-9967
This paper presents a review of the literature on network traffic prediction, while also serving as a tutorial to the topic. We examine works based on autoregressive moving average models, like ARMA, ARIMA and SARIMA, as well as works based on Artifical Neural Networks approaches, such as RNN, LSTM, GRU, and CNN. In all cases, we provide a complete and self-contained presentation of the mathematical foundations of each technique, which allows the reader to get a full understanding of the operation of the different proposed methods. Further, we perform numerical experiments based on real data sets, which allows comparing the various approaches directly in terms of fitting quality and computational costs. We make our code publicly available, so that readers can readily access a wide range of forecasting tools, and possibly use them as benchmarks for more advanced solutions., European Commission, TRUE, pub
IMDEA Networks Institute Digital Repository
Publicación Contribución de congreso (ConferenceOutput)

Towards Data-Driven Management of Mobile Networks through User Plane Inference

  • Akem, Aristide Tanyi-Jong
  • Fiore, Marco|||0000-0002-0772-9967
Growing network complexity has rendered human-in-the-loop network management approaches obsolete. The advent of Software-Defined Networking (SDN) has enabled network automation, with Machine Learning (ML) models running in the control plane. However, such control plane models do not run at line rate and would not satisfy the stringent latency requirements of time-sensitive next-generation applications. In this PhD project, we exploit recent advances in programmable switches and associated languages like P4 to enable data-driven management of networks by running ML models for inference in programmable switches at line rate, with high throughput and low latency. Resulting contributions include solutions for in-switch classification at packet level, flow level, or both, with use cases in network security, service identification, and device fingerprinting in commercial off-the-shelf switches., European Union’s Horizon Europe research and innovation programme under Marie Skłodowska-Curie grant agreement no. 860239, Smart Networks and Services Joint Undertaking (SNS JU) under the European Union’s Horizon Europe research and innovation programme under grant agreement no. 101139270, TRUE, pub