Skip to main content

MONITORIZACION IOT DE LA CALIDAD DEL AIRE

PID2019-107910RB-I00

•
Funding agency name Agencia Estatal de Investigación
Funding agency acronym AEI
Program Programa Estatal de I+D+i Orientado a los Retos de la Sociedad
Call Proyectos de I+D+i (Generación de Conocimiento y Retos Investigación)
Call year 2019
State Plan 2017-2020 Plan Estatal de Investigación Científica y Técnica y de Innovación
Beneficiary centre UNIVERSITAT POLITECNICA DE CATALUNYA

Resultados relacionados

Resultados totales (Incluyendo duplicados): 25
Encontrada(s) 1 página(s)

DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Artículo científico (JournalArticle)

Non-linear models for black carbon exposure modelling using air pollution datasets

  • Rovira, J.
  • Paredes-Ahumada, J. A.
  • Barceló-Ordinas, José María
  • García-Vidal, Jorge
  • Reche, Cristina
  • Sola, Y.
  • Fung, P. L.
  • Petäjä, Tuukka
  • Hussein, T.
  • Viana, Mar
Black carbon (BC) is a product of incomplete combustion, present in urban aerosols and sourcing mainly from road traffic. Epidemiological evidence reports positive associations between BC and cardiovascular and respiratory disease. Despite this, BC is currently not regulated by the EU Air Quality Directive, and as a result BC data are not available in urban areas from reference air quality monitoring networks in many countries. To fill this gap, a machine learning approach is proposed to develop a BC proxy using air pollution datasets as an input. The proposed BC proxy is based on two machine learning models, support vector regression (SVR) and random forest (RF), using observations of particle mass and number concentrations (N), gaseous pollutants and meteorological variables as the input. Experimental data were collected from a reference station in Barcelona (Spain) over a 2-year period (2018-2019). Two months of additional data were available from a second urban site in Barcelona, for model validation. BC concentrations estimated by SVR showed a high degree of correlation with the measured BC concentrations (R2 = 0.828) with a relatively low error (RMSE = 0.48 μg/m3). Model performance was dependent on seasonality and time of the day, due to the influence of new particle formation events. When validated at the second station, performance indicators decreased (R2 = 0.633; RMSE = 1.19 μg/m3) due to the lack of N data and PM2.5 and the smaller size of the dataset (2 months). New particle formation events critically impacted model performance, suggesting that its application would be optimal in environments where traffic is the main source of ultrafine particles. Due to its flexibility, it is concluded that the model can act as a BC proxy, even based on EU-regulatory air quality parameters only, to complement experimental measurements for exposure assessment in urban areas., The authors would like to acknowledge the support from the Generalitat de Catalunya (Dept. Medi Ambient) by providing the air quality data. This work was partly supported by H2020 project RI-URBANS (H2020-LC-GD-2020-6, reference 101036245), the Spanish Ministry of Science and Innovation (projects CEX2018-000794-S and PID2019-107910RB-I00), Academy of Finland via flagship on Atmosphere and Climate Competence Center (ACCC, project number 337549) and by AGAUR (project 2017 SGR41 and 2017 SGR 990). It was carried out in the framework of a joint collaboration between IDAEA-CSIC and University of Barcelona (Physics Faculty)., Peer reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Artículo científico (JournalArticle)

Data reconstruction applications for IoT air pollution sensor networks using graph signal processing

  • Ferrer Cid, Pau|||0000-0003-2112-8516
  • Barceló Ordinas, José María|||0000-0002-9738-2425
  • García Vidal, Jorge|||0000-0001-5969-1182
The analysis of sensor networks for air pollution monitoring is challenging. Recent studies have demonstrated the ability to reconstruct the network measurements with graphs derived from the acquired data, thus describing the complex relationships between the sensors that compose the network. In this work, we propose a graph-based data reconstruction framework that can be used to carry out different post-processing applications that arise in real-world low-cost sensor deployments for air pollution monitoring. This data reconstruction framework first describes the relationships between the different network sensors by means of a graph learned from the measured data, and then a signal reconstruction model is superimposed to reconstruct sensor data. This methodology allows reconstructing sensor data to carry out missing value imputation, signal reconstruction at points where there are no physical sensors (virtual sensing), or data fusion. The results, using real data taken with an air pollution monitoring network including reference stations and low-cost sensors, show how this framework performs well for these applications compared to estimates obtained from individual sensors and task-specific state-of-the-art methods that are not able to deal with this necessary range of applications. In short, the results show the potential of using graphs, whose topology is based on the measurements taken, to calibrate and reconstruct signals in heterogeneous networks of low-cost air pollution sensors for a wide variety of applications., This work is supported by the National Spanish funding PID2019-107910RB-I00, by regional project 2017SGR-990, and with the support of Secretaria d’Universitats i Recerca de la Generalitat de Catalunya i del Fons Social Europeu., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Artículo científico (JournalArticle)

Graph signal reconstruction techniques for IoT air pollution monitoring platforms

  • Ferrer Cid, Pau|||0000-0003-2112-8516
  • Barceló Ordinas, José María|||0000-0002-9738-2425
  • García Vidal, Jorge|||0000-0001-5969-1182
Air pollution monitoring platforms play a very important role in preventing and mitigating the effects of pollution. Recent advances in the field of graph signal processing have made it possible to describe and analyze air pollution monitoring networks using graphs. One of the main applications is the reconstruction of the measured signal in a graph using a subset of sensors. Reconstructing the signal using information from neighboring sensors is a key technique for maintaining network data quality, with examples including filling in missing data with correlated neighboring nodes, creating virtual sensors, or correcting a drifting sensor with neighboring sensors that are more accurate. This paper proposes a signal reconstruction framework for air pollution monitoring data where a graph signal reconstruction model is superimposed on a graph learned from the data. Different graph signal reconstruction methods are compared on actual air pollution data sets measuring O3, NO2, and PM10. The ability of the methods to reconstruct the signal of a pollutant is shown, as well as the computational cost of this reconstruction. The results indicate the superiority of methods based on kernel-based graph signal reconstruction, as well as the difficulties of the methods to scale in an air pollution monitoring network with a large number of low-cost sensors. However, we show that the scalability of the framework can be improved with simple methods, such as partitioning the network using a clustering algorithm., This work is supported by the National Spanish funding PID2019-107910RB-I00, by regional project 2017SGR-990, and with the support of Secretaria d’Universitats i Recerca de la Generalitat de Catalunya i del Fons Social Europeu., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

Quality aware graph learning regularization for heterogeneous air quality sensor networks

  • Ferrer Cid, Pau|||0000-0003-2112-8516
  • Barceló Ordinas, José María|||0000-0002-9738-2425
  • García Vidal, Jorge|||0000-0001-5969-1182
© Owner/Author | ACM 2023. This is the author's version of the work. It is posted here for your personal use. Not for redistribution. The definitive Version of Record was published in EWSN '23: Proceedings of the 2023 International Conference on embedded Wireless Systems and Networks, http://dx.doi.org/10.5555/3639940.3639954., In recent years, the graph signal processing (GSP) field has brought signal processing techniques to numerous areas. Among them, graphs have been used for various applications in sensor networks for air quality monitoring. One of the main tasks consists of learning the graph that describes the relationships between sensors in a network. Although many data-driven graph learning techniques exist, the heterogeneous nature of air quality low-cost sensor networks, where low-cost sensors and high-precision instruments coexist, imposes the need to include information about the quality of the sensors used. Therefore, in this paper, we propose a graph learning regularization framework that allows for taking into account the reliability of the different nodes of an IoT network, in what we call quality-aware graph learning regularization (QAGLR). The regularization framework is evaluated for signal reconstruction and it is also assessed in the case of the creation of GSP-based virtual sensors, showing the benefits of introducing information about sensors’ reliability., Work supported by projects PID 2019-107910RB-I00, 2021 SGR-01059, and CDTI MIG-20221061., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Artículo científico (JournalArticle)

Graph learning techniques using structured data for IoT air pollution monitoring platforms

  • Ferrer Cid, Pau|||0000-0003-2112-8516
  • Barceló Ordinas, José María|||0000-0002-9738-2425
  • García Vidal, Jorge|||0000-0001-5969-1182
Existing air pollution monitoring networks use reference stations as the main nodes. The addition of low-cost sensors calibrated in-situ with machine learning techniques allows the creation of heterogeneous air pollution monitoring networks. However, current monitoring networks or calibration techniques have limitations in estimating missing data, adding virtual sensors or recalibrating sensors. The use of graphs to represent structured data is an emerging area of research that allows the use of powerful techniques to process and analyze data for air pollution monitoring networks. In this paper, we compare two techniques that rely on structured data, one based on statistical methods and the other on signal smoothness, with a baseline technique based on the distance between nodes and that does not rely on the measured signal data. To compare these techniques, the sensor signal is reconstructed with a supervised method based on linear regression and a semi-supervised method based on Laplacian interpolation, which allows reconstruction even when data is missing. The results, on data sets measuring O3, NO2 and PM10, show that the signal smoothness-based technique behaves better than the other two, and used together with the Laplacian interpolation is near-optimal with respect to the linear regression method. Moreover, in the case of heterogeneous networks, the results show a reconstruction accuracy similar to the in-situ calibrated sensors. Thus, the use of the network data increases the robustness of the network against possible sensor failures., This work is supported by the National Spanish funding PID2019-107910RB-I00, by regional project 2017SGR-990, and with the support of Secretaria d’Universitats i Recerca de la Generalitat de Catalunya i del Fons Social Europeu., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Artículo científico (JournalArticle)

Temporal pattern-based denoising and calibration for low-cost sensors in IoT monitoring platforms

  • Allka, Xhensilda|||0000-0003-2187-9985
  • Ferrer Cid, Pau|||0000-0003-2112-8516
  • Barceló Ordinas, José María|||0000-0002-9738-2425
  • García Vidal, Jorge|||0000-0001-5969-1182
The introduction of low-cost sensors (LCSs) in air quality Internet of Things (IoT) monitoring platforms presents the challenge of improving the quality of the data that these sensors provide. In this article, we propose two algorithms to perform denoising and calibration for LCSs used in IoT monitoring platforms. Sensors are first calibrated in situ using linear or nonlinear machine learning models that only take into account instantaneous measurements. The best calibration model is used to estimate the values measured by the sensor during the sensor deployment. To improve the values of the estimates produced by the in situ calibration model, we propose to take into account the temporal patterns present in signals, such as temperature or tropospheric ozone that have regular patterns, e.g., daily. The first method, which we call temporal pattern-based denoising (TPB-D), performs signal denoising by projecting the daily signals of the in situ calibrated LCS onto a subspace generated by the daily signals stored in a database taken by reference instruments. The second method, which we call temporal pattern-based calibration (TPB-C), considers that if we also have a reference instrument colocated to the LCSs over a period of time, we can correct with a linear mapping with regularization the daily LCS signals projected in the subspace produced by the reference database to be as similar as possible to the projected signals of the colocated reference instrument. The results show that the TPB-D improves the estimates made by in situ calibration by up to 10%–20%, while the TPB-C improves the estimates made by in situ calibration by up to 20%–40%., This work was supported in part by the National Spanish Funding under Grant PID2019-107910RB-I00 and in part by the Regional Project under Grant 2021 SGR 01059., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Artículo científico (JournalArticle)

A low-power IoT device for measuring water table levels and soil moisture to ease increased crop yields

  • López, Emiliano
  • Vionnet, Carlos
  • Ferrer Cid, Pau|||0000-0003-2112-8516
  • Barceló Ordinas, José María|||0000-0002-9738-2425
  • García Vidal, Jorge|||0000-0001-5969-1182
  • Contini, Guillermo
  • Prodolliet, Jorge
  • Maiztegui, José
The simultaneous measurement of soil water content and water table levels is of great agronomic and hydrological interest. Not only does soil moisture represent the water available for plant growth but also water table levels can affect crop productivity. Furthermore, monitoring soil saturation and water table levels is essential for an early warning of extreme rainfall situations. However, the measurement of these parameters employing commercial instruments has certain disadvantages, with a high cost of purchase and maintenance. In addition, the handling of commercial devices makes it difficult to adapt them to the specific requirements of farmers or decision-makers. Open-source IoT hardware platforms are emerging as an attractive alternative to developing flexible and low-cost devices. This paper describes the design of a datalogger device based on open-source hardware platforms to register water table levels and soil moisture data for agronomic applications. The paper begins by describing energy-saving and wireless transmission techniques. Then, it summarizes the linear calibration of the phreatimeter sensor obtained with laboratory and field data. Finally, it shows how non-linear machine-learning techniques improve predictions over classical tools for the moisture sensor (SKU: SEN0193)., This work is supported by Universidad Nacional del Litoral, research grants CAID 50520190100249LI and CAAT 03012020, and the National Spanish funding PID2019-107910RB-I00, by regional project 2017SGR-990, and with the support of Secretaria d’Universitats i Recerca de la Generalitat de Catalunya i del Fons Social Europeu., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Artículo científico (JournalArticle)

Raw data collected from NO2, O3 and NO air pollution electrochemical low-cost sensors

  • Ferrer Cid, Pau|||0000-0003-2112-8516
  • Barceló Ordinas, José María|||0000-0002-9738-2425
  • García Vidal, Jorge|||0000-0001-5969-1182
Recently, the monitoring of air pollution by means of lowcost sensors has become a growing research field due to the study of techniques based on machine learning to improve the sensors’ data quality. For this purpose, sensors undergo a calibration process, where these are placed in-situ nearby a regulatory reference station. The data set explained in this paper contains data from two self-built low-cost air pollution nodes deployed for four months, from January 16, 2021 to May 15, 2021, at an official air quality reference station in Barcelona, Spain. The goal of the deployment was to have five electrochemical sensors at a high sampling rate of 0.5 Hz; two NO2 sensors, two O3 sensors, and one NO sensor. It should be noted that the reference stations publish air pollution data every hour, thus at a rate of 2.7 × 10-4 Hz. In addition, the nodes have also captured temperature and relative humidity data, which are typically used as correctors in the calibration of low-cost sensors. The availability of the sensors’ time series at this high resolution is important in order to be able to carry out analysis from the signal processing perspective, allowing the study of sensor sampling strategies, sensor signal filtering, and the calibration of low-cost sensors among others., This work was supported by National Spanish project PID2019-107910RB-I00, and regional project 2017SGR-990, and with the support of Secretaria d’Universitats i Recerca de la Generalitat de Catalunya i del Fons Social Europeu., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

Robust proxy sensor model for estimating black carbon concentrations using low-cost sensors

  • Paredes Ahumada, Juan Antonio
  • Ferrer Cid, Pau|||0000-0003-2112-8516
  • Barceló Ordinas, José María|||0000-0002-9738-2425
  • García Vidal, Jorge|||0000-0001-5969-1182
  • Reche Andúgar, Cristina
  • Viana Rodríguez, Mar
Air quality monitoring sensor networks focusing on air pollution measure pollutants that are regulated by the authorities, such as CO, NO2, NO, SO2, O3, and particulate matter (PM10, PM2.5). However, there are other pollutants, such as black carbon (BC), which are not regulated, have a major impact on health, and are rarely measured. One solution is to use proxies, which consist of creating a mathematical model that infers the measurement of the pollutant from indirect measurements of other pollutants. In this paper, we propose a robust machine learning proxy (RMLP) framework for estimating BC based on nonlinear machine learning methods, calibrating the low-cost sensors (LCSs), and adding robustness against noise and data missing in the LCS. We show the impact of LCS data aggregation, denoising and missing imputation on BC estimation, and how the concentrations estimated by the BC proxy approximate the values obtained by a reference instrument with an accurate BC sensor., This work is supported by projects H2020 FIRE-RES, PID 2019-107910RB-I00, CEX 2018-000794-S, 2017 SGR41, 2021 SGR01059, and the support of Sec. d’Universitats i Recerca de la Generalitat de Catalunya i del Fons Social Europeu., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Artículo científico (JournalArticle)

Sampling trade-offs in duty-cycled systems for air quality low-cost sensors

  • Ferrer Cid, Pau|||0000-0003-2112-8516
  • García Calvete, Julio
  • Main Nadal, Aina
  • Ye, Zhe
  • Barceló Ordinas, José María|||0000-0002-9738-2425
  • García Vidal, Jorge|||0000-0001-5969-1182
The use of low-cost sensors in conjunction with high-precision instrumentation for air pollution monitoring has shown promising results in recent years. One of the main challenges for these sensors has been the quality of their data, which is why the main efforts have focused on calibrating the sensors using machine learning techniques to improve the data quality. However, there is one aspect that has been overlooked, that is, these sensors are mounted on nodes that may have energy consumption restrictions if they are battery-powered. In this paper, we show the usual sensor data gathering process and we study the existing trade-offs between the sampling of such sensors, the quality of the sensor calibration, and the power consumption involved. To this end, we conduct experiments on prototype nodes measuring tropospheric ozone, nitrogen dioxide, and nitrogen monoxide at high frequency. The results show that the sensor sampling strategy directly affects the quality of the air pollution estimation and that each type of sensor may require different sampling strategies. In addition, duty cycles of 0.1 can be achieved when the sensors have response times in the order of two minutes, and duty cycles between 0.01 and 0.02 can be achieved when the sensor response times are negligible, calibrating with hourly reference values and maintaining a quality of calibrated data similar to when the node is connected to an uninterruptible power supply., This work is supported by the National Spanish funding PID2019-107910RB-I00, by regional project 2017 SGR-990, and with the support of Secretaria d’Universitats i Recerca de la Generalitat de Catalunya i del Fons Social Europeu., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Artículo científico (JournalArticle)

Volterra graph-based outlier detection for air pollution sensor networks

  • Ferrer Cid, Pau|||0000-0003-2112-8516
  • Barceló Ordinas, José María|||0000-0002-9738-2425
  • García Vidal, Jorge|||0000-0001-5969-1182
Today's air pollution sensor networks pose new challenges given their heterogeneity of low-cost sensors and high-cost instrumentation. Recently, with the advent of graph signal processing, sensor network measurements have been successfully represented by graphs depicting the relationships between sensors. However, one of the main problems of these sensor networks is their reliability, especially due to the inclusion of low-cost sensors, so the detection and identification of outliers is extremely important for maintaining the quality of the network data. In order to better identify the outliers of the sensors composing a network, we propose the Volterra graph-based outlier detection (VGOD) mechanism, which uses a graph learned from data and a Volterra-like graph signal reconstruction model to detect and localize abnormal measurements in air pollution sensor networks. The proposed unsupervised decision process is compared with other outlier detection methods, state-of-the-art graph-based methods and non-graph-based methods, showing improvements in both detection and localization of anomalous measurements, so that anomalous measurements can be corrected and malfunctioning sensors can be replaced., This work is supported by the National Spanish funding PID2019-107910RB-I00, by regional project 2017SGR-990, and with the support of Secretaria d’Universitats i Recerca de la Generalitat de Catalunya i del Fons Social Europeu., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Artículo científico (JournalArticle)

H2020 project CAPTOR dataset: Raw data collected by low-cost MOX ozone sensors in a real air pollution monitoring network

  • Barceló Ordinas, José María|||0000-0002-9738-2425
  • Ferrer Cid, Pau|||0000-0003-2112-8516
  • García Vidal, Jorge|||0000-0001-5969-1182
  • Viana Rodríguez, Mar
  • Ripoll, Anna
The H2020 CAPTOR project deployed three testbeds in Spain, Italy and Austria with low-cost sensors for the measurement of tropospheric ozone (O3). The aim of the H2020 CAPTOR project was to raise public awareness in a project focused on citizen science. Each testbed was supported by an NGO in charge of deciding how to raise citizen awareness according to the needs of each country. The data presented in this document correspond to the raw data captured by the sensor nodes in the Spanish testbed using SGX Sensortech MICS 2614 metal-oxide sensors. The Spanish testbed consisted of the deployment of twenty-five nodes. Each sensor node included four SGX Sensortech MICS 2614 ozone sensors, one temperature sensor and one relative humidity sensor. Each node underwent a calibration process by co-locating the node at an EU reference air quality monitoring station, followed by a deployment in a sub-urban or rural area in Catalonia, Spain. All nodes spent two to three weeks co-located at a reference station in Barcelona, Spain (urban area), followed by two to three weeks co-located at three sub-urban reference stations near the final deployment site. The nodes were then deployed in volunteers' homes for about two months and, finally, the nodes were co-located again at the sub-urban reference stations for two weeks for final calibration and assessment of potential drifts. All data presented in this paper are raw data taken by the sensors that can be used for scientific purposes such as calibration studies using machine learning algorithms, or once the concentration values of the nodes are obtained, they can be used to create tropospheric ozone pollution maps with heterogeneous data sources (reference stations and low-cost sensors)., This work was funded by H2020 project CAPTOR, and supported by National Spanish project PID2019–107910RB-I00, and regional project 2017SGR-990, and with the support of Secretaria d’Universitats i Recerca de la Generalitat de Catalunya i del Fons Social Europeu. The authors gratefully acknowledge the collaboration of the staff at the Department of the Environment of the Generalitat de Catalunya who kindly provided support for the deployment of the sensing nodes at reference stations for calibrating the sensors and provided access to the reference data., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

Black carbon proxy sensor model for air quality IoT monitoring networks

  • Paredes Ahumada, Juan Antonio
  • Ferrer Cid, Pau|||0000-0003-2112-8516
  • Barceló Ordinas, José María|||0000-0002-9738-2425
  • García Vidal, Jorge|||0000-0001-5969-1182
© Owner/Author | ACM 2023. This is the author's version of the work. It is posted here for your personal use. Not for redistribution. The definitive Version of Record was published in EWSN'23: Proceedings of the 2023 International Conference on Embedded Wireless Systems and Networks, http://dx.doi.org/10.5555/3639940, Most Internet of Things (IoT) air quality monitoring networks measure and report regulated pollutants such as O3, NO, NO2, SO2 or CO and PM2.5, PM10 particulates. However, there are pollutants such as black carbon that are not regulated by the authorities and are rarely measured, and if they are measured, the instrumentation is very expensive. One way to obtain measurements with cheaper equipment is to use the proxy concept, where from indirect measurements of other pollutants a virtual sensor is constructed using machine learning techniques. In this work, we design a machine learning-based proxy for black carbon based on low-cost sensor (LCS) nodes. We compare three techniques to build the proxy: support vector regression, random forest and a neural network. The LCSs have to be pre-calibrated also using machine learning techniques, linear or nonlinear. The results show, using data from a real deployment of IoT air quality sensor nodes, that the results obtained by the proxy with LCSs (R2=0.72) using support vector regression are a good approximation in terms of performance to those obtained by a proxy using high-cost reference instrumentation (R2=0.76)., This work is supported by projects PID 2019-107910RB-I00, 2021 SGR-01059, CDTI MIG-20221061., Peer Reviewed
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Temporal pattern-based denoising and calibration for low-cost sensors in IoT monitoring platforms

  • Allka, Xhensilda
  • Ferrer Cid, Pau
  • Barceló Ordinas, José María
  • García Vidal, Jorge
The introduction of low-cost sensors (LCSs) in air quality Internet of Things (IoT) monitoring platforms presents the challenge of improving the quality of the data that these sensors provide. In this article, we propose two algorithms to perform denoising and calibration for LCSs used in IoT monitoring platforms. Sensors are first calibrated in situ using linear or nonlinear machine learning models that only take into account instantaneous measurements. The best calibration model is used to estimate the values measured by the sensor during the sensor deployment. To improve the values of the estimates produced by the in situ calibration model, we propose to take into account the temporal patterns present in signals, such as temperature or tropospheric ozone that have regular patterns, e.g., daily. The first method, which we call temporal pattern-based denoising (TPB-D), performs signal denoising by projecting the daily signals of the in situ calibrated LCS onto a subspace generated by the daily signals stored in a database taken by reference instruments. The second method, which we call temporal pattern-based calibration (TPB-C), considers that if we also have a reference instrument colocated to the LCSs over a period of time, we can correct with a linear mapping with regularization the daily LCS signals projected in the subspace produced by the reference database to be as similar as possible to the projected signals of the colocated reference instrument. The results show that the TPB-D improves the estimates made by in situ calibration by up to 10%–20%, while the TPB-C improves the estimates made by in situ calibration by up to 20%–40%., This work was supported in part by the National Spanish Funding under Grant PID2019-107910RB-I00 and in part by the Regional Project under Grant 2021 SGR 01059., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

H2020 project CAPTOR dataset: Raw data collected by low-cost MOX ozone sensors in a real air pollution monitoring network

  • Barceló Ordinas, José María
  • Ferrer Cid, Pau
  • García Vidal, Jorge
  • Viana Rodríguez, Mar
  • Ripoll, Anna
The H2020 CAPTOR project deployed three testbeds in Spain, Italy and Austria with low-cost sensors for the measurement of tropospheric ozone (O3). The aim of the H2020 CAPTOR project was to raise public awareness in a project focused on citizen science. Each testbed was supported by an NGO in charge of deciding how to raise citizen awareness according to the needs of each country. The data presented in this document correspond to the raw data captured by the sensor nodes in the Spanish testbed using SGX Sensortech MICS 2614 metal-oxide sensors. The Spanish testbed consisted of the deployment of twenty-five nodes. Each sensor node included four SGX Sensortech MICS 2614 ozone sensors, one temperature sensor and one relative humidity sensor. Each node underwent a calibration process by co-locating the node at an EU reference air quality monitoring station, followed by a deployment in a sub-urban or rural area in Catalonia, Spain. All nodes spent two to three weeks co-located at a reference station in Barcelona, Spain (urban area), followed by two to three weeks co-located at three sub-urban reference stations near the final deployment site. The nodes were then deployed in volunteers' homes for about two months and, finally, the nodes were co-located again at the sub-urban reference stations for two weeks for final calibration and assessment of potential drifts. All data presented in this paper are raw data taken by the sensors that can be used for scientific purposes such as calibration studies using machine learning algorithms, or once the concentration values of the nodes are obtained, they can be used to create tropospheric ozone pollution maps with heterogeneous data sources (reference stations and low-cost sensors)., This work was funded by H2020 project CAPTOR, and supported by National Spanish project PID2019–107910RB-I00, and regional project 2017SGR-990, and with the support of Secretaria d’Universitats i Recerca de la Generalitat de Catalunya i del Fons Social Europeu. The authors gratefully acknowledge the collaboration of the staff at the Department of the Environment of the Generalitat de Catalunya who kindly provided support for the deployment of the sensing nodes at reference stations for calibrating the sensors and provided access to the reference data., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Volterra graph-based outlier detection for air pollution sensor networks

  • Ferrer Cid, Pau
  • Barceló Ordinas, José María
  • García Vidal, Jorge
Today's air pollution sensor networks pose new challenges given their heterogeneity of low-cost sensors and high-cost instrumentation. Recently, with the advent of graph signal processing, sensor network measurements have been successfully represented by graphs depicting the relationships between sensors. However, one of the main problems of these sensor networks is their reliability, especially due to the inclusion of low-cost sensors, so the detection and identification of outliers is extremely important for maintaining the quality of the network data. In order to better identify the outliers of the sensors composing a network, we propose the Volterra graph-based outlier detection (VGOD) mechanism, which uses a graph learned from data and a Volterra-like graph signal reconstruction model to detect and localize abnormal measurements in air pollution sensor networks. The proposed unsupervised decision process is compared with other outlier detection methods, state-of-the-art graph-based methods and non-graph-based methods, showing improvements in both detection and localization of anomalous measurements, so that anomalous measurements can be corrected and malfunctioning sensors can be replaced., This work is supported by the National Spanish funding PID2019-107910RB-I00, by regional project 2017SGR-990, and with the support of Secretaria d’Universitats i Recerca de la Generalitat de Catalunya i del Fons Social Europeu., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Data reconstruction applications for IoT air pollution sensor networks using graph signal processing

  • Ferrer Cid, Pau
  • Barceló Ordinas, José María
  • García Vidal, Jorge
The analysis of sensor networks for air pollution monitoring is challenging. Recent studies have demonstrated the ability to reconstruct the network measurements with graphs derived from the acquired data, thus describing the complex relationships between the sensors that compose the network. In this work, we propose a graph-based data reconstruction framework that can be used to carry out different post-processing applications that arise in real-world low-cost sensor deployments for air pollution monitoring. This data reconstruction framework first describes the relationships between the different network sensors by means of a graph learned from the measured data, and then a signal reconstruction model is superimposed to reconstruct sensor data. This methodology allows reconstructing sensor data to carry out missing value imputation, signal reconstruction at points where there are no physical sensors (virtual sensing), or data fusion. The results, using real data taken with an air pollution monitoring network including reference stations and low-cost sensors, show how this framework performs well for these applications compared to estimates obtained from individual sensors and task-specific state-of-the-art methods that are not able to deal with this necessary range of applications. In short, the results show the potential of using graphs, whose topology is based on the measurements taken, to calibrate and reconstruct signals in heterogeneous networks of low-cost air pollution sensors for a wide variety of applications., This work is supported by the National Spanish funding PID2019-107910RB-I00, by regional project 2017SGR-990, and with the support of Secretaria d’Universitats i Recerca de la Generalitat de Catalunya i del Fons Social Europeu., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Raw data collected from NO2, O3 and NO air pollution electrochemical low-cost sensors

  • Ferrer Cid, Pau
  • Barceló Ordinas, José María
  • García Vidal, Jorge
Recently, the monitoring of air pollution by means of lowcost sensors has become a growing research field due to the study of techniques based on machine learning to improve the sensors’ data quality. For this purpose, sensors undergo a calibration process, where these are placed in-situ nearby a regulatory reference station. The data set explained in this paper contains data from two self-built low-cost air pollution nodes deployed for four months, from January 16, 2021 to May 15, 2021, at an official air quality reference station in Barcelona, Spain. The goal of the deployment was to have five electrochemical sensors at a high sampling rate of 0.5 Hz; two NO2 sensors, two O3 sensors, and one NO sensor. It should be noted that the reference stations publish air pollution data every hour, thus at a rate of 2.7 × 10-4 Hz. In addition, the nodes have also captured temperature and relative humidity data, which are typically used as correctors in the calibration of low-cost sensors. The availability of the sensors’ time series at this high resolution is important in order to be able to carry out analysis from the signal processing perspective, allowing the study of sensor sampling strategies, sensor signal filtering, and the calibration of low-cost sensors among others., This work was supported by National Spanish project PID2019-107910RB-I00, and regional project 2017SGR-990, and with the support of Secretaria d’Universitats i Recerca de la Generalitat de Catalunya i del Fons Social Europeu., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Graph signal reconstruction techniques for IoT air pollution monitoring platforms

  • Ferrer Cid, Pau
  • Barceló Ordinas, José María
  • García Vidal, Jorge
Air pollution monitoring platforms play a very important role in preventing and mitigating the effects of pollution. Recent advances in the field of graph signal processing have made it possible to describe and analyze air pollution monitoring networks using graphs. One of the main applications is the reconstruction of the measured signal in a graph using a subset of sensors. Reconstructing the signal using information from neighboring sensors is a key technique for maintaining network data quality, with examples including filling in missing data with correlated neighboring nodes, creating virtual sensors, or correcting a drifting sensor with neighboring sensors that are more accurate. This paper proposes a signal reconstruction framework for air pollution monitoring data where a graph signal reconstruction model is superimposed on a graph learned from the data. Different graph signal reconstruction methods are compared on actual air pollution data sets measuring O3, NO2, and PM10. The ability of the methods to reconstruct the signal of a pollutant is shown, as well as the computational cost of this reconstruction. The results indicate the superiority of methods based on kernel-based graph signal reconstruction, as well as the difficulties of the methods to scale in an air pollution monitoring network with a large number of low-cost sensors. However, we show that the scalability of the framework can be improved with simple methods, such as partitioning the network using a clustering algorithm., This work is supported by the National Spanish funding PID2019-107910RB-I00, by regional project 2017SGR-990, and with the support of Secretaria d’Universitats i Recerca de la Generalitat de Catalunya i del Fons Social Europeu., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Black carbon proxy sensor model for air quality IoT monitoring networks

  • Paredes Ahumada, Juan Antonio
  • Ferrer Cid, Pau
  • Barceló Ordinas, José María
  • García Vidal, Jorge
© Owner/Author | ACM 2023. This is the author's version of the work. It is posted here for your personal use. Not for redistribution. The definitive Version of Record was published in EWSN'23: Proceedings of the 2023 International Conference on Embedded Wireless Systems and Networks, http://dx.doi.org/10.5555/3639940, Most Internet of Things (IoT) air quality monitoring networks measure and report regulated pollutants such as O3, NO, NO2, SO2 or CO and PM2.5, PM10 particulates. However, there are pollutants such as black carbon that are not regulated by the authorities and are rarely measured, and if they are measured, the instrumentation is very expensive. One way to obtain measurements with cheaper equipment is to use the proxy concept, where from indirect measurements of other pollutants a virtual sensor is constructed using machine learning techniques. In this work, we design a machine learning-based proxy for black carbon based on low-cost sensor (LCS) nodes. We compare three techniques to build the proxy: support vector regression, random forest and a neural network. The LCSs have to be pre-calibrated also using machine learning techniques, linear or nonlinear. The results show, using data from a real deployment of IoT air quality sensor nodes, that the results obtained by the proxy with LCSs (R2=0.72) using support vector regression are a good approximation in terms of performance to those obtained by a proxy using high-cost reference instrumentation (R2=0.76)., This work is supported by projects PID 2019-107910RB-I00, 2021 SGR-01059, CDTI MIG-20221061., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Sampling trade-offs in duty-cycled systems for air quality low-cost sensors

  • Ferrer Cid, Pau
  • García Calvete, Julio
  • Main Nadal, Aina
  • Ye, Zhe
  • Barceló Ordinas, José María
  • García Vidal, Jorge
The use of low-cost sensors in conjunction with high-precision instrumentation for air pollution monitoring has shown promising results in recent years. One of the main challenges for these sensors has been the quality of their data, which is why the main efforts have focused on calibrating the sensors using machine learning techniques to improve the data quality. However, there is one aspect that has been overlooked, that is, these sensors are mounted on nodes that may have energy consumption restrictions if they are battery-powered. In this paper, we show the usual sensor data gathering process and we study the existing trade-offs between the sampling of such sensors, the quality of the sensor calibration, and the power consumption involved. To this end, we conduct experiments on prototype nodes measuring tropospheric ozone, nitrogen dioxide, and nitrogen monoxide at high frequency. The results show that the sensor sampling strategy directly affects the quality of the air pollution estimation and that each type of sensor may require different sampling strategies. In addition, duty cycles of 0.1 can be achieved when the sensors have response times in the order of two minutes, and duty cycles between 0.01 and 0.02 can be achieved when the sensor response times are negligible, calibrating with hourly reference values and maintaining a quality of calibrated data similar to when the node is connected to an uninterruptible power supply., This work is supported by the National Spanish funding PID2019-107910RB-I00, by regional project 2017 SGR-990, and with the support of Secretaria d’Universitats i Recerca de la Generalitat de Catalunya i del Fons Social Europeu., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Quality aware graph learning regularization for heterogeneous air quality sensor networks

  • Ferrer Cid, Pau
  • Barceló Ordinas, José María
  • García Vidal, Jorge
© Owner/Author | ACM 2023. This is the author's version of the work. It is posted here for your personal use. Not for redistribution. The definitive Version of Record was published in EWSN '23: Proceedings of the 2023 International Conference on embedded Wireless Systems and Networks, http://dx.doi.org/10.5555/3639940.3639954., In recent years, the graph signal processing (GSP) field has brought signal processing techniques to numerous areas. Among them, graphs have been used for various applications in sensor networks for air quality monitoring. One of the main tasks consists of learning the graph that describes the relationships between sensors in a network. Although many data-driven graph learning techniques exist, the heterogeneous nature of air quality low-cost sensor networks, where low-cost sensors and high-precision instruments coexist, imposes the need to include information about the quality of the sensors used. Therefore, in this paper, we propose a graph learning regularization framework that allows for taking into account the reliability of the different nodes of an IoT network, in what we call quality-aware graph learning regularization (QAGLR). The regularization framework is evaluated for signal reconstruction and it is also assessed in the case of the creation of GSP-based virtual sensors, showing the benefits of introducing information about sensors’ reliability., Work supported by projects PID 2019-107910RB-I00, 2021 SGR-01059, and CDTI MIG-20221061., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Robust proxy sensor model for estimating black carbon concentrations using low-cost sensors

  • Paredes Ahumada, Juan Antonio
  • Ferrer Cid, Pau
  • Barceló Ordinas, José María
  • García Vidal, Jorge
  • Reche Andúgar, Cristina
  • Viana Rodríguez, Mar
Air quality monitoring sensor networks focusing on air pollution measure pollutants that are regulated by the authorities, such as CO, NO2, NO, SO2, O3, and particulate matter (PM10, PM2.5). However, there are other pollutants, such as black carbon (BC), which are not regulated, have a major impact on health, and are rarely measured. One solution is to use proxies, which consist of creating a mathematical model that infers the measurement of the pollutant from indirect measurements of other pollutants. In this paper, we propose a robust machine learning proxy (RMLP) framework for estimating BC based on nonlinear machine learning methods, calibrating the low-cost sensors (LCSs), and adding robustness against noise and data missing in the LCS. We show the impact of LCS data aggregation, denoising and missing imputation on BC estimation, and how the concentrations estimated by the BC proxy approximate the values obtained by a reference instrument with an accurate BC sensor., This work is supported by projects H2020 FIRE-RES, PID 2019-107910RB-I00, CEX 2018-000794-S, 2017 SGR41, 2021 SGR01059, and the support of Sec. d’Universitats i Recerca de la Generalitat de Catalunya i del Fons Social Europeu., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Graph learning techniques using structured data for IoT air pollution monitoring platforms

  • Ferrer Cid, Pau
  • Barceló Ordinas, José María
  • García Vidal, Jorge
Existing air pollution monitoring networks use reference stations as the main nodes. The addition of low-cost sensors calibrated in-situ with machine learning techniques allows the creation of heterogeneous air pollution monitoring networks. However, current monitoring networks or calibration techniques have limitations in estimating missing data, adding virtual sensors or recalibrating sensors. The use of graphs to represent structured data is an emerging area of research that allows the use of powerful techniques to process and analyze data for air pollution monitoring networks. In this paper, we compare two techniques that rely on structured data, one based on statistical methods and the other on signal smoothness, with a baseline technique based on the distance between nodes and that does not rely on the measured signal data. To compare these techniques, the sensor signal is reconstructed with a supervised method based on linear regression and a semi-supervised method based on Laplacian interpolation, which allows reconstruction even when data is missing. The results, on data sets measuring O3, NO2 and PM10, show that the signal smoothness-based technique behaves better than the other two, and used together with the Laplacian interpolation is near-optimal with respect to the linear regression method. Moreover, in the case of heterogeneous networks, the results show a reconstruction accuracy similar to the in-situ calibrated sensors. Thus, the use of the network data increases the robustness of the network against possible sensor failures., This work is supported by the National Spanish funding PID2019-107910RB-I00, by regional project 2017SGR-990, and with the support of Secretaria d’Universitats i Recerca de la Generalitat de Catalunya i del Fons Social Europeu., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

A low-power IoT device for measuring water table levels and soil moisture to ease increased crop yields

  • López, Emiliano
  • Vionnet, Carlos
  • Ferrer Cid, Pau
  • Barceló Ordinas, José María
  • García Vidal, Jorge
  • Contini, Guillermo
  • Prodolliet, Jorge
  • Maiztegui, José
The simultaneous measurement of soil water content and water table levels is of great agronomic and hydrological interest. Not only does soil moisture represent the water available for plant growth but also water table levels can affect crop productivity. Furthermore, monitoring soil saturation and water table levels is essential for an early warning of extreme rainfall situations. However, the measurement of these parameters employing commercial instruments has certain disadvantages, with a high cost of purchase and maintenance. In addition, the handling of commercial devices makes it difficult to adapt them to the specific requirements of farmers or decision-makers. Open-source IoT hardware platforms are emerging as an attractive alternative to developing flexible and low-cost devices. This paper describes the design of a datalogger device based on open-source hardware platforms to register water table levels and soil moisture data for agronomic applications. The paper begins by describing energy-saving and wireless transmission techniques. Then, it summarizes the linear calibration of the phreatimeter sensor obtained with laboratory and field data. Finally, it shows how non-linear machine-learning techniques improve predictions over classical tools for the moisture sensor (SKU: SEN0193)., This work is supported by Universidad Nacional del Litoral, research grants CAID 50520190100249LI and CAAT 03012020, and the National Spanish funding PID2019-107910RB-I00, by regional project 2017SGR-990, and with the support of Secretaria d’Universitats i Recerca de la Generalitat de Catalunya i del Fons Social Europeu., Peer Reviewed, Postprint (published version)