Pasar al contenido principal

HERRAMIENTAS DE BASE FOTONICA PARA LA GESTION AGRONOMICA Y EL USO DE PRODUCTOS FITOSANITARIOS SOSTENIBLE EN CULTIVOS ARBOREOS EN EL MARCO DE LA AGRICULTURA DE PRECISION

AGL2013-48297-C2-2-R

•
Nombre agencia financiadora Ministerio de Economía y Competitividad
Acrónimo agencia financiadora MINECO
Programa Programa Estatal de I+D+i Orientado a los Retos de la Sociedad
Convocatoria Proyectos I+D+i Retos de Investigación
Año convocatoria 2013
Plan Estatal 2013-2016 Plan Estatal de Investigación Científica y Técnica y de Innovación
Unidad de gestión Secretaría de Estado de Educación, Formación Profesional y Universidades
Centro beneficiario UNIVERSIDAD DE LLEIDA
Identificador persistente http://dx.doi.org/10.13039/501100003329

Resultados relacionados

Resultados totales (Incluyendo duplicados): 94
Encontrada(s) 1 página(s)

IRTA Pubpro. Open Digital Archive
Publicación Artículo científico (JournalArticle)

Determination of spray drift and buffer zones in 3D crops using the ISO standard and new LiDAR methodologies

  • Torrent, Xavier
  • Gregorio, Eduard
  • Rosell-Polo, Joan R.
  • Arnó, Jaume
  • Peris, Miquel
  • van de Zande, Jan C.
  • Planas, Santiago
Spray drift generated in the application of plant protection products in tree crops (3D crops) is a major source of environmental contamination, with repercussions for human health and the environment. Spray drift contamination acquires greater relevance in the EU Southern Zone due to the crops structure and the weather conditions. Hence, there is a need to evaluate spray drift when treating the most representative 3D crops in this area. For this purpose, 4 spray drift tests, measuring airborne and sedimenting spray drift in accordance with ISO 22866:2005, were carried out for 4 different crops (peach, citrus, apple and grape) in orchards of the EU Southern Zone, using an air-blast sprayer equipped with standard (STN) and spray drift reduction (DRN) nozzle types. A further 3 tests were carried out to test a new methodology for the evaluation of spray drift in real field conditions using a LiDAR system, in which the spray drift generated by different sprayer and nozzle types was contrasted. The airborne spray drift potential reduction (DPRV) values, obtained following the ISO 22866:2005, were higher than those for sedimenting spray drift potential reduction (DPRH) (63.82%–94.42% vs. 39.75%–69.28%, respectively). For each crop and nozzle type combination, a sedimenting spray drift model was also developed and used to determine buffer zone width. The highest buffer width reduction (STN vs DRN) was obtained in peach (˃75%), while in grape, citrus and apple only 50% was reached. These results can be used as the starting point to determine buffer zone width in the countries of the EU Southern Zone depending on different environmental threshold values. Tests carried out using LiDAR system demonstrated high capacity and efficiency of this system and this newly defined methodology, allowing sprayer and nozzle types in real field conditions to be differentiated and classified., info:eu-repo/semantics/acceptedVersion
IRTA Pubpro. Open Digital Archive
Publicación Artículo científico (JournalArticle)

LiDAR-derived indices and their relationship with productivity and oil quality attributes in high-density olive orchards

  • Sandonis-Pozo, L.
  • Rufat, Josep
  • Pascual, M.
  • Villar, J.M.
  • Arnó, J.
  • Escolà, A.
  • Rosell-Polo, J.R.
  • Martínez-Casasnovas, J.A.
Optimising the leaf area index (LAI) and light exposure are key aspects to improve yield and quality in high-density olive orchards. Traditionally, these characteristics are estimated using ceptometers, but this method is both labour intensive and dependent on light conditions, with limitations in effectiveness for precision horticulture management purposes. This study investigates the potential of four LiDAR-derived indices to: i) estimate the LAI and canopy light interception under different fertigation treatments, and ii) to assess their impact on yield and oil quality throughout a growing season in a high-density olive orchard. The treatments included two nitrogen dose rates (N0: 0 kg ha-¹ and N50: 50 kg ha-¹) combined with full irrigation (FI) and deficit irrigation (DI). The results provide strong evidence for the effectiveness of these indices in monitoring canopy response to treatments over time. The N50 and FI treatments increased the LAI and yield but led to poorer light attenuation within the canopy and lower oil quality. In contrast, N0 and DI promoted more light-permeable canopies and improved oil quality, with higher phenolic content, better oxidative stability and improved organoleptic oil attributes. These indices can improve the understanding of canopy light environments, help to optimise management practices, and ultimately improve the sustainability and profitability of intensive olive cultivation., This work was carried out with data acquired in the project IRTA2012–00059-C02–01 funded by Spain’s National Institute for Agricultural and Food Research and Technology, as well as in the projects AGL2010–22304-C04–03 and AGL2013–48297-C2–2-R funded by the Spanish Ministry of Economy and Competitiveness. The study was carried out under the framework of the grants RTI2018–094222-B-I00 (PAgFRUIT project) and PID2021–126648OB-I00 (PAgPROTECT project) through MCIN/AEI/10.13039/501100011033 and the European Union’s “ERDF, a way of making Europe”., info:eu-repo/semantics/publishedVersion
IRTA Pubpro. Open Digital Archive
Publicación Artículo científico (JournalArticle)

Pesticide dose adjustment in fruit and grapevine orchards by DOSA3D: Fundamentals of the system and on-farm validation

  • Román, Carla
  • Peris, Miquel
  • Esteve, Joan
  • Tejerina, Miguel
  • Cambray, Jordi
  • Vilardell, Pere
  • Planas, Santiago
Agricultural productivity cannot be sustained without the application of plant protection measures. Within the framework of integrated pest management (IPM), the use of chemical pesticides should be limited to the last option among the available practices. Even though their use remains common, it carries associated environmental and human health risks. One of the most accepted practices within IPM is the reduction of spraying events and/or pesticide applied doses. DOSA3D is a decision support system that allows the dose to be adjusted to the specific treatment scenario. For this, DOSA3D calculates the optimal application volume rate by estimating the leaf area index and takes into account the overall spraying efficiency and the pest or disease to be controlled. The system adopts specific minimum volume rates for fruit trees and vineyards without compromising the crop health status. To establish the adjusted dose, the labeled or the adviser prescription concentration is kept. Resulting adjusted doses provided by DOSA3D achieved pesticide savings up to 53% in fruit trees and 60% in vineyards. DOSA3D has been validated against the main diseases and pests of fruit trees and vineyards: brown spot and psylla in pear orchards; alternaria blotch disease, apple scab, codling moth, oriental moth and red spider mite in apple orchards; powdery mildew, brown rot, aphids, thrips and mites in peach orchards; and, powdery mildew, yellow spider mite and leafhoppers in grapevine orchards. In addition, a methodology called Green Way is presented to provide consistent and crop safety pesticide doses when these are labeled as concentration or ground area doses., info:eu-repo/semantics/publishedVersion
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

LFuji-air dataset: annotated 3D LiDAR point clouds of Fuji apple trees for fruit detection scanned under different forced air flow conditions

  • Gené Mola, Jordi
  • Gregorio López, Eduard
  • Auat Cheein, Fernando
  • Guevara, Javier
  • Llorens Calveras, Jordi
  • Sanz Cortiella, Ricardo
  • Escolà i Agustí, Alexandre
  • Rosell Polo, Joan Ramon
This article presents the LFuji-air dataset, which contains LiDAR based point clouds of 11 Fuji apples trees and the corresponding apples location ground truth. A mobile terrestrial laser scanner (MTLS) comprised of a LiDAR sensor and a real-time kinematics global navigation satellite system was used to acquire the data. The MTLS was mounted on an air-assisted sprayer used to generate different air flow conditions. A total of 8 scans per tree were performed, including scans from different LiDAR sensor positions (multi-view approach) and under different air flow conditions. These variability of the scanning conditions allows to use the LFuji-air dataset not only for training and testing new fruit detection algorithms, but also to study the usefulness of the multi-view approach and the application of forced air flow to reduce the number of fruit occlusions. The data provided in this article is related to the research article entitled 'Fruit detection, yield prediction and canopy geometric characterization using LiDAR with forced air flow' [1]., This work was partly funded by the Secretaria d’Universitats i Recerca del Departament d'Empresa i Coneixement de la Generalitat de Catalunya (grant 2017 SGR 646), the Spanish Ministry of Economy and Competitiveness (project AGL2013-48297-C2-2-R) and the Spanish Ministry of Science, Innovation and Universities (project RTI2018-094222-B-I00). The Spanish Ministry of Education is thanked for Mr. J. Gené's pre-doctoral fellowships (FPU15/03355). The work of Jordi Llorens was supported by the Spanish Ministry of Economy, Industry and Competitiveness through a postdoctoral position named Juan de la Cierva Incorporación (JDCI-2016-29464_N18003). We would also like to thank CONICYT FONDECYT 1171431 and CONICYT FB0008.
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

Polarization lidar detection of agricultural aerosol emissions

  • Gregorio López, Eduard
  • Gené Mola, Jordi
  • Sanz Cortiella, Ricardo
  • Rocadenbosch Burillo, Francesc
  • Chueca Adell, Patricia
  • Arnó Satorra, Jaume
  • Solanelles Batlle, Francesc
  • Rosell Polo, Joan Ramon
Agricultural aerosol emissions can significantly impact human and animal health as well as the environment. Therefore, it is essential to adopt new sensing techniques for real-time monitoring these emissions in high temporal and spatial resolution. In recent years, light detection and ranging (lidar) technology has been used for measuring the particulate matter emitted from agricultural operations. However, conventional nonpolarized lidar systems cannot discriminate between different types of aerosols, which can lead to misinterpretation of the results. To overcome this limitation, this study applies the polarization lidar technique to monitor agricultural aerosols. A 355 nm polarization lidar system was used to measure the emissions generated during pesticide spraying operations. The results showed that depolarization ratios due to field dust (0.220-0.268) and to road dust (0.385) are clearly higher than those caused by pesticide spray drift (0.028-0.043) or by diesel exhaust (0.099), which can be used to differentiate each type of aerosol. These results support the development of new polarization lidar systems specifically designed to study the impact of agricultural activities on air quality., This research was partially funded by the Spanish Ministry of Economy and Competitiveness (projects AGL2007-66093-C04-03, AGL2010-22304-04-C03-03, and AGL2013-48297-C2-2-R) and EU FEDER. Secretaria d’Universitats i Recerca del Departament d’Economia i Coneixement de la Generalitat de Catalunya and the Spanish Ministry of Education are thanked for Mr. Jordi Gené’s predoctoral fellowships (2016FI_B 00669 and FPU15/03355). The authors would like to thank the Institut de Recerca i Tecnologia Agroalimentàries for allowing the use of their experimental fields. The authors also wish to thank F. Camp, A. Escolà, C. Garcerá, F. Gràcia, J. Masip, E. Moltó, I. del Moral, and R. Viana for their assistance in the field work. X. Torrent and S. Planas are also thanked for the nozzle characterization with the PDA. F. Marenco (Met Office, UK) and P. Chazette (LSCE-IPLS, France) are acknowledged for their fruitful comments about lidar calibration.
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

Mobile terrestrial laser scanner vs. UAV photogrammetry to estimate woody crop canopy parameters - Part 2: Comparison for different crops and training systems

  • Torres-Sánchez, Jorge
  • Escolà i Agustí, Alexandre
  • de Castro, Ana I.
  • López-Granados, Francisca
  • Rosell Polo, Joan Ramon
  • Sebé Feixas, Francesc
  • Jiménez-Brenes, Francisco M.
  • Sanz Cortiella, Ricardo
  • Gregorio López, Eduard
  • Peña, José M.
The measurement of geometric canopy parameters in woody crops is an important task in Precision Agriculture because of their correlation with crop condition and productivity. In recent years, several technological approaches have been developed as an alternative to manual measurements, which are time- and labour-consuming. Two of the most commonly used 3D canopy characterization technologies are mobile terrestrial laser scanning (MTLS) based on light detection and ranging (LiDAR) sensors, and digital aerial photogrammetry (DAP) using imagery from uncrewed aerial vehicles (UAVs). Although both are state-of-the-art and have been fully tested and validated, a complete comparison between their geometric canopy parameter estimations in different woody crops and training systems has not been carried out. For this reason, a set of geometric parameters (canopy height, projected area, and volume) of a vineyard, an intensive peach orchard, and an intensive pear orchard were measured using UAV-DAP and MTLS-LiDAR. A comparison between both kinds of measurements was performed, accounting for the length of the sections in which the crop hedgerows were divided to extract the geometric parameters. Measurements from the UAV and the MTLS were highly correlated (R2 from 0.82 to 0.94) when considering the data from the three crops together, and the correlations were higher when analysing longer row sections. The canopy geometric parameters estimated using the MTLS-LiDAR always had higher values than those from the UAV-DAP. The results presented in this work provide useful data for a more informed selection of technological approaches for 3D crop characterization in Precision Fruticulture and high-throughput phenotyping., This research was funded by the projects DECIMAL (PID2020-113229RB-C41), PRODIGIA (PID2020-113229RB-C44), AGVANCE (AGL2013-48297-C2-2-R), and PAgPROTECT (PID2021-126648OB-I00), from the Spanish Ministry of Science and Innovation (MCIN/AEI/10.13039/501100011033). The authors also wish to thank Codorníu SA, celler Raimat and IRTA for having allowed the use of their vineyards, pear and peach orchards to conduct the trials described in this work.
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

Spatially variable pesticide application in vineyards: Part II, field comparison of uniform and map-based variable dose treatments

  • Román, Carla
  • Llorens Calveras, Jordi
  • Uribeetxebarria Alonso de Armiño, Asier
  • Sanz Cortiella, Ricardo
  • Planas de Martí, Santiago
  • Arnó Satorra, Jaume
Reducing pesticide use is an important concern for many including the European Commission. One way to achieve this goal is to adjust the amount of pesticides in relation to canopy geometry and foliage. This objective currently poses an important challenge in vineyards with uniform vegetation but it is an added difficulty when the canopy shows spatial variability within the field. Is it possible to set a constant volume rate adjusted to this variability? Or is it more convenient to adjusting different volume rates based on a prescription map? Assuming a plant cell density (PCD) vegetation index from multispectral images to be optimal for detecting variations in vigour, two methods to adjust volume rates in spatially variable vineyards were proposed and tested: i) adjustment of a constant volume rate uniformly applied using a conventional sprayer, and ii) adjustment of two volume rates adapted to two vigour classes according to a prescription map. In both methods, PCD was previously correlated to the leaf area index (LAI), then taking the 70th percentile of LAI to determine adjusted volume rates through DOSA3D decision support system (www.dosa3d.cat/en). Leaf deposition with tracer was analysed to compare the proposed methods with the standard volume rate commonly used in the area. Statistical analysis showed no significant differences between treatments. Since pesticide savings can be achieved using the two methods, specifically 25.6% in adjusted uniform and 25.3% in adjusted map-based treatments, adjusted volume rate strategies can be recommended in vineyards with spatial variability., This study was financed by the EU Horizon 2020 project EUCLID [grant number 633999 (www.euclidipm.org)]; Spanish Ministry of Agriculture, Fisheries and Food with the project GOPHYTOVID [contract 2018002001192]; and by the Spanish Ministry of Economy, Industry and Competitiveness [project AGVANCE AGL2013-48297-C2-2-R; Jordi Llorens' contract JDCI-2016-29464 N18003]. Funding of Secretaria d’Universitats i Recerca del Departament d’Empresa i Coneixement de la Generalitat de Catalunya under Grant 2017 SGR 646 is also thanked. The authors also would like to thank Agropixel SL for the aerial images and Codorníu SA for their logistic support.
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

Stratified sampling in fruit orchards using cluster-based ancillary information maps: a comparative analysis to improve yield and quality estimates

  • Uribeetxebarria Alonso de Armiño, Asier
  • Martínez Casasnovas, José Antonio
  • Escolà i Agustí, Alexandre
  • Rosell Polo, Joan Ramon
  • Arnó Satorra, Jaume
Estimation of yield or other fruit quality parameter is of great interest to farmers to decide on management actions just before harvesting and, in any case, to anticipate and plan harvesting operations. Making accurate and reliable estimates often requires systematic sampling that, when covering the whole plot, can result in the use of a large number of samples and a significant effort in time and cost for fruit growers. Faced with this whole area sampling strategy, simple random sampling (SRS) using reduced sample sizes is currently a widely used technique despite the less precise estimates that it provides. In this work, different stratified sampling schemes have been tested to estimate yield (kg/tree), fruit firmness (kg/cm2) and the refractometric index (ºBaumé) in a peach orchard located in Gimenells (Lleida, Catalonia, Spain). In contrast to SRS, the use of ancillary information (NDVI and apparent electrical conductivity, ECa) allowed sampling units or trees to be stratified according to two or three classes (strata) within the plot. The classes or homogeneous stratification zones were delimited by cluster analysis using, either separately or in combination, a multispectral airborne image (NDVI) and a ECa survey map acquired by means of a soil resistivity sensor (Veris 3100). Sampling schemes were then compared in terms of efficiency. In general, stratified sampling showed better results than SRS. Regarding yield estimates, stratified sampling according to two strata of NDVI allowed the sample size to be reduced by 17% compared to the SRS for the same precision. On the other hand, quality parameters may require different stratification strategies concerning the number of strata to be used. While ºBaumé was better-estimated using also stratified samples based on two strata of NDVI, fruit firmness showed better results when stratifying by three classes or strata of NDVI. In any case, neither the ECa nor the combined use of NDVI + ECa have improved sampling efficiency when used as ancillary maps for stratification., This work was funded by the Spanish Ministry of Economy and Competitiveness through the project AgVANCE (AGL2013-48297-C2-2-R). The authors also thank the IRTA Experimental Station in Gimenells (Lleida, Spain) for the possibility of carrying out this sampling study on a peach orchard.
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

Assessment of spray drift potential reduction for hollow-cone nozzles: Part 1. Classification using indirect methods

  • Torrent Martí, Xavier
  • Gregorio López, Eduard
  • Douzals, Jean-Paul
  • Tinet, Cyril
  • Rosell Polo, Joan Ramon
  • Planas de Martí, Santiago
Spray drift is one of the main pollution sources identified when pesticides are sprayed on crops. In this work, in order to simplify the evaluation of hollow-cone nozzles according to their drift potential reduction, several models commonly used were tested by three indirect methods: phase Doppler particle analyser (PDPA) and two different wind tunnels. The main aim of this study is then to classify for the first time these hollow-cone nozzle models all of them used in tree crop spraying (3D crops). A comparison between these indirect methods to assess their suitability and to provide guidelines for a spray drift classification of hollow-cone nozzles was carried out. The results show that, in general terms, all methods allow hollow-cone nozzle classifications according to their drift potential reduction (DPR) with a similar trend. Among all the parameters determined with the PDPA, the V100 parameter performed best in differentiating the tested nozzles among drift reduction classes. In the wind tunnel, similar values were obtained for both sedimenting and airborne drift depositions. The V100 parameter displayed a high correlation (up to R2 = 0.948) with the drift potential tested with the wind tunnel. It is concluded that in general, the evaluated indirect methods provide equivalent classification results. Additional studies with a greater variety of nozzle types are required to achieve a proposal of harmonized methodology for testing hollow-cone nozzles., This work was partly funded by the Secretaria d'Universitats i Recerca del Departament d'Empresa i Coneixement de la Generalitat de Catalunya, the Spanish Ministry of Economy and Competitiveness and the European Regional Development Fund (ERDF) under Grants 2017 SGR 646, AGL2007-66093-C04-03, AGL2010-22304-04-C03-03, and AGL2013-48297-C2-2-R. The authors also wish to thank Mr. Antonio Checa (Randex Iberica, S.L.) for giving us free Albuz nozzles for the spray tests. Universitat de Lleida is also thanked for Mr. X. Torrent's pre-doctoral fellowship.
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

Fruit detection and 3D location using instance segmentation neural networks and structure-from-motion photogrammetry

  • Gené Mola, Jordi
  • Sanz Cortiella, Ricardo
  • Rosell Polo, Joan Ramon
  • Morros Rubió, Josep Ramon
  • Ruiz Hidalgo, Javier
  • Vilaplana Besler, Verónica
  • Gregorio López, Eduard
The development of remote fruit detection systems able to identify and 3D locate fruits provides opportunities to improve the efficiency of agriculture management. Most of the current fruit detection systems are based on 2D image analysis. Although the use of 3D sensors is emerging, precise 3D fruit location is still a pending issue. This work presents a new methodology for fruit detection and 3D location consisting of: (1) 2D fruit detection and segmentation using Mask R-CNN instance segmentation neural network; (2) 3D point cloud generation of detected apples using structure-from-motion (SfM) photogrammetry; (3) projection of 2D image detections onto 3D space; (4) false positives removal using a trained support vector machine. This methodology was tested on 11 Fuji apple trees containing a total of 1455 apples. Results showed that, by combining instance segmentation with SfM the system performance increased from an F1-score of 0.816 (2D fruit detection) to 0.881 (3D fruit detection and location) with respect to the total amount of fruits. The main advantages of this methodology are the reduced number of false positives and the higher detection rate, while the main disadvantage is the high processing time required for SfM, which makes it presently unsuitable for real-time work. From these results, it can be concluded that the combination of instance segmentation and SfM provides high performance fruit detection with high 3D data precision. The dataset has been made publicly available and an interactive visualization of fruit detection results is accessible at http://www.grap.udl.cat/documents/photogrammetry_fruit_detection.html. Dades primàries associades a l'article http://hdl.handle.net/10459.1/68505, This work was partly funded by the Secretaria d’Universitats i Recerca del Departament d’Empresa i Coneixement de la Generalitat de Catalunya (grant 2017 SGR646), the Spanish Ministry of Economy and Competitiveness (project AGL2013-48297-C2-2-R) and the Spanish Ministry of Science, Innovation and Universities (project RTI2018-094222-B-I00). Part of the work was also developed within the framework of the project TEC2016-75976-R, financed by the Spanish Ministry of Economy, Industry and Competitiveness and the European Regional Development Fund (ERDF). The Spanish Ministry of Educationis thanked for Mr. J.Gené’s pre-doctoral fellowships (FPU15/03355). We would also like to thank Nufri (especially Santiago Salamero and Oriol Morreres) and Vicens Maquinària Agrícola S.A. for their support during data acquisition, and Ernesto Membrillo and Roberto Maturino for their support in dataset labelling.
Repositori Obert UdL
Publicación Contribución de congreso (ConferenceOutput)

R software code to process and extract information from 3D Lidar point clouds

  • Llorens Calveras, Jordi
  • Cabrera Pérez, Carlos
  • Escolà i Agustí, Alexandre
  • Arnó Satorra, Jaume
Poster Proceedings of the 12th European Conference on Precision Agriculture, July 8-11, Montpellier, France. pp. 114-115. e-book publication. SupAgro Montpellier. ISBN 978-2-900792-49-0, In the process of electronic canopy characterization, it is necessary to process efficiently point clouds obtained by means of sensors or other capturing information systems. These point clouds may have different origin but they define the main structural characteristics of the scanned crop. For this reason, a fast, easy-to-configure and precise methodology is necessary to extract such information. The work presented in this poster defines the main features of a procedure carried out with R Software code., This work was partly funded by the Secretaria d’Universitats i Recerca del Departament d’Empresa i Coneixement de la Generalitat de Catalunya and the Spanish Ministry of Economy and Competitiveness under Grants 2017 SGR 646, AGL2013-48297-C2-2-R and RTI2018-094222-B-I00(PAgFRUIT). The work of Jordi Llorens was supported by Spanish Ministry of Economy, Industry and Competitiveness through a postdoctoral position named Juan de la Cierva Incorporació (JDCI-2016-29464_N18003).
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

Multi-modal deep learning for Fuji apple detection using RGB-D cameras and their radiometric capabilities

  • Gené Mola, Jordi
  • Vilaplana Besler, Verónica
  • Rosell Polo, Joan Ramon
  • Morros Rubió, Josep Ramon
  • Ruiz Hidalgo, Javier
  • Gregorio López, Eduard
Fruit detection and localization will be essential for future agronomic management of fruit crops, with applications in yield prediction, yield mapping and automated harvesting. RGB-D cameras are promising sensors for fruit detection given that they provide geometrical information with color data. Some of these sensors work on the principle of time-of-flight (ToF) and, besides color and depth, provide the backscatter signal intensity. However, this radiometric capability has not been exploited for fruit detection applications. This work presents the KFuji RGB-DS database, composed of 967 multi-modal images containing a total of 12,839 Fuji apples. Compilation of the database allowed a study of the usefulness of fusing RGB-D and radiometric information obtained with Kinect v2 for fruit detection. To do so, the signal intensity was range corrected to overcome signal attenuation, obtaining an image that was proportional to the reflectance of the scene. A registration between RGB, depth and intensity images was then carried out. The Faster R-CNN model was adapted for use with five-channel input images: color (RGB), depth (D) and range-corrected intensity signal (S). Results show an improvement of 4.46% in F1-score when adding depth and range-corrected intensity channels, obtaining an F1-score of 0.898 and an AP of 94.8% when all channels are used. From our experimental results, it can be concluded that the radiometric capabilities of ToF sensors give valuable information for fruit detection., This work was partly funded by the Secretaria d’Universitats i Recerca del Departament d’Empresa i Coneixement de la Generalitat de Catalunya, the Spanish Ministry of Economy and Competitiveness and the European Regional Development Fund (ERDF) under Grants 2017SGR 646, AGL2013-48297-C2-2-R and MALEGRA, TEC2016-75976-R. The Spanish Ministry of Education is thanked for Mr. J. Gené’s predoctoral fellowships (FPU15/03355). We would also like to thank Nufri and Vicens Maquinària Agrícola S.A. for their support during data acquisition, and Adria Carbó for his assistance in Faster R-CNN implementation.
Repositori Obert UdL
Publicación Contribución de congreso (ConferenceOutput)

Apple size estimation using photogrammetry-derived 3D point clouds

  • Gené Mola, Jordi
  • Sanz Cortiella, Ricardo
  • Rosell Polo, Joan Ramon
  • Escolà i Agustí, Alexandre
  • Gregorio López, Eduard
In-field fruit monitoring at different growth stages provides important information for farmers. Recent advances have focused on the detection and location of fruits, although the development of accurate fruit size estimation systems is still a challenge that requires further attention. The present work proposes a novel methodology for in-field measurement of spherical fruits using SfMMVS- based point clouds and considering different percentages of fruit occlusions., This work was partly funded by the Secretaria d’Universitats i Recerca de la Generalitat de Catalunya (grant 2017 SGR 646), the Spanish Ministry of Economy and Competitiveness (projects AGL2013-48297-C2-2-R and TEC2016-75976-R) and the Spanish Ministry of Science, Innovation and Universities (grant RTI2018- 094222-B-I00[PAgFRUIT project] by MCIN/AEI/10.13039/501100011033 and by “ERDF, a way of making Europe”, by the European Union).
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

Multi-tree woody structure reconstruction from mobile terrestrial laser scanner point clouds based on a dual neighbourhood connectivity graph algorithm

  • Méndez, Valeriano
  • Rosell Polo, Joan Ramon
  • Pascual Roca, Miquel
  • Escolà i Agustí, Alexandre
A process is presented for the vector reconstruction of fruit plantations based on the model developed by Verroust and Lazarus. To solve occlusion problems, the use of a dual graph of local and extended connectivity is proposed. The process allows vegetation variables such as the length and volume of the ligneous structure to be measured, enabling studies such as intensity of pruning operations. The process has been tested against simulated models and real trees with different training systems: open-vase system (peach trees) and central leader hedgerow system (pear trees). The cost of the algorithm will be given by the cost of the implementation of Dijkstra's algorithm, which in its standard version is of potential (O(n2)). Algorithm accuracy was checked against point clouds of virtual trees. The reconstruction was also applied before and after a pruning operation of real trees to enable a study of the evolution of the vegetation indices. Results showed the algorithm to be suitable for multi-tree reconstruction of both central leader and open-vase training systems., This research was partially funded by the Spanish Ministry of Economy and Competitiveness (projects SAFESPRAY: AGL2010-22304-C04-03 and AGVANCE: AGL2013-48297-C2-2-R).
Repositori Obert UdL
Publicación Contribución de congreso (ConferenceOutput)

Yield prediction using mobile terrestrial laser scanning

  • Gené Mola, Jordi
  • Gregorio López, Eduard
  • Sanz Cortiella, Ricardo
  • Escolà i Agustí, Alexandre
  • Rosell Polo, Joan Ramon
Yield prediction provides valuable information to plan the harvest campaign, fruit storage and sales. Traditionally, yield estimation has been carried out by manual counting of randomly selected samples, without addressing spatial variability within the orchard. To obtain a precise estimation it is necessary to sample a relatively large number of trees, which is unfeasible with manual counting. To solve this issue, this work proposes the use of a Mobile Terrestrial Laser Scanner (MTLS) for fruit detection and yield prediction. Experimental test were carried out in a commercial Fuji apple orchard. The row of threes was scanned from the two sides (east and west). The measurement equipment consisted of an MTLS comprised of a LiDAR sensor, and a real-time kinematics global navigation satellite system (RTK-GNSS) connected to a rugged laptop. The LiDAR sensor used was a Puck VLP-16 (Velodyne LIDAR Inc., San José, CA, USA), which provides a 3D point cloud with calibrated reflectance values of the measured scene. The fruit detection algorithm implemented in this work is divided into four steps: (1) Reflectance thresholding, which delete those points presenting a reflectance lower than 60%; (2) Connected Points Clustering using DBSCAN; (3) Fruit separation, which uses a support vector machine (SVM) to predict the number of fruits that contains each cluster; (4) False positive removal, also based on a trained SVM. From detections obtained with this algorithm, the yield was predicted using a linear model (obtained with training data) that relates the number of detections and the actual number of fruits Three different trials were evaluated: east (E) side scanning, west (W) side scanning and merging data from both scanned sides (E+W). As it was expected, fruit detection results showed lower detection rates when only scanning from one tree side, presenting detection rates of 38.3% and 48.5% for east and west sides, respectively. However, the detection rate increased up to 75.8% when using E+W data. Similarly, yield prediction results showed higher errors when using data from only one tree side, obtaining a RMSE of 15.2% and 15.3% (east and west, respectively). The prediction improved significantly when using data from both tree sides (E+W), presenting a RMSE of 5.4%. From these results it is concluded that MTLS has potential in yield prediction in fruit orchards. Although fruit detection rates are moderately successful, the system was able to predict the actual number of fruits with low estimation errors. Only using data from one tree side increases the prediction error, but it has de advantage of reducing a 50% the scanning time, which may be interesting depending on the application and the interest of the farmer. Future works will extend this study to other fruit varieties., This work was partly funded by the Secretaria d’Universitats i Recerca del Departament d’Empresa i Coneixement de la Generalitat de Catalunya and the Spanish Ministry of Economy and Competitiveness under Grants 2017 SGR 646 and AGL2013-48297-C2-2-R. The Spanish Ministry of Education is thanked for Mr. J. Gené’s pre-doctoral fellowships (FPU15/03355). The work of Jordi Llorens was supported by Spanish Ministry of Economy, Industry and Competitiveness through a postdoctoral position names Juan de la Cierva Incorporació (JDCI-2016-29464_N18003).
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

Fruit detection, yield prediction and canopy geometric characterization using LiDAR with forced air flow

  • Gené Mola, Jordi
  • Gregorio López, Eduard
  • Auat Cheein, Fernando
  • Guevara, Javier
  • Llorens Calveras, Jordi
  • Sanz Cortiella, Ricardo
  • Escolà i Agustí, Alexandre
  • Rosell Polo, Joan Ramon
Yield monitoring and geometric characterization of crops provide information about orchard variability and vigor, enabling the farmer to make faster and better decisions in tasks such as irrigation, fertilization, pruning, among others. When using LiDAR technology for fruit detection, fruit occlusions are likely to occur leading to an underestimation of the yield. This work is focused on reducing the fruit occlusions for LiDAR-based approaches, tackling the problem from two different approaches: applying forced air flow by means of an air-assisted sprayer, and using multi-view sensing. These approaches are evaluated in fruit detection, yield prediction and geometric crop characterization. Experimental tests were carried out in a commercial Fuji apple (Malus domestica Borkh. cv. Fuji) orchard. The system was able to detect and localize more than 80% of the visible fruits, predict the yield with a root mean square error lower than 6% and characterize canopy height, width, cross-section area and leaf area. The forced air flow and multi-view approaches helped to reduce the number of fruit occlusions, locating 6.7% and 6.5% more fruits, respectively. Therefore, the proposed system can potentially monitor the yield and characterize the geometry in apple trees. Additionally, combining trials with and without forced air flow and multi-view sensing presented significant advantages for fruit detection as they helped to reduce the number of fruit occlusions., This work was partly funded by the Secretaria d’Universitats i Recerca del Departament d’Empresa i Coneixement de la Generalitat de Catalunya (grant 2017 SGR 646), the Spanish Ministry of Economy and Competitiveness (project AGL2013-48297-C2-2-R) and the Spanish Ministry of Science, Innovation and Universities (project RTI2018-094222-B-I00). The Spanish Ministry of Education is thanked for Mr. J. Gené’s pre-doctoral fellowships (FPU15/03355). The work of Jordi Llorens was supported by the Spanish Ministry of Economy, Industry and Competitiveness through a postdoctoral position named Juan de la Cierva Incorporación (JDCI-2016-29464_N18003). We would also like to thank CONICYT FONDECYT 1171431 and CONICYT FB0008. Nufri (especially Santiago Salamero and Oriol Morreres) and Vicens Maquinària Agrícola S.A. are also thanked for their support during data acquisition, and Ernesto Membrillo and Roberto Maturino for their support in dataset labelling.
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

KFuji RGB-DS database: Fuji apple multi-modal images for fruit detection with color, depth and range-corrected IR data

  • Gené Mola, Jordi
  • Vilaplana Besler, Verónica
  • Rosell Polo, Joan Ramon
  • Morros Rubió, Josep Ramon
  • Ruiz Hidalgo, Javier
  • Gregorio López, Eduard
This article contains data related to the research article entitle 'Multi-modal Deep Learning for Fruit Detection Using RGB-D Cameras and their Radiometric Capabilities' [1]. The development of reliable fruit detection and localization systems is essential for future sustainable agronomic management of high-value crops. RGB-D sensors have shown potential for fruit detection and localization since they provide 3D information with color data. However, the lack of substantial datasets is a barrier for exploiting the use of these sensors. This article presents the KFuji RGBDS database which is composed by 967 multi-modal images of Fuji apples on trees captured using Microsoft Kinect v2 (Microsoft, Redmond, WA, USA). Each image contains information from 3 different modalities: color (RGB), depth (D) and range corrected IR intensity (S). Ground truth fruit locations were manually annotated, labeling a total of 12,839 apples in all the dataset. The current dataset is publicly available at http://www.grap.udl.cat/publicacions/datasets.html., This work was partly funded by the Secretaria d’Universitats i Recerca del Departament d’Empresa i Coneixement de la Generalitat de Catalunya, the Spanish Ministry of Economy and Competitiveness and the European Regional Development Fund (ERDF) under Grants 2017 SGR 646, AGL2013-48297-C2-2-R and MALEGRA, TEC2016-75976-R. The Spanish Ministry of Education is thanked for Mr. J. Gené’s pre-doctoral fellowships (FPU15/03355). We would also like to thank Nufri and Vicens Maquinària Agrícola S.A. for their support during data acquisition.
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

Fuji-SfM dataset: A collection of annotated images and point clouds for Fuji apple detection and location using structure-from-motion photogrammetry

  • Gené Mola, Jordi
  • Sanz Cortiella, Ricardo
  • Rosell Polo, Joan Ramon
  • Morros Rubió, Josep Ramon
  • Ruiz Hidalgo, Javier
  • Vilaplana Besler, Verónica
  • Gregorio López, Eduard
The present dataset contains colour images acquired in a commercial Fuji apple orchard (Malus domestica Borkh. cv. Fuji) to reconstruct the 3D model of 11 trees by using structure-from-motion (SfM) photogrammetry. The data provided in this article is related to the research article entitled “Fruit detection and 3D location using instance segmentation neural networks and structure-from-motion photogrammetry” [1]. The Fuji-SfM dataset includes: (1) a set of 288 colour images and the corresponding annotations (apples segmentation masks) for training instance segmentation neural networks such as Mask-RCNN; (2) a set of 582 images defining a motion sequence of the scene which was used to generate the 3D model of 11 Fuji apple trees containing 1455 apples by using SfM; (3) the 3D point cloud of the scanned scene with the corresponding apple positions ground truth in global coordinates. With that, this is the first dataset for fruit detection containing images acquired in a motion sequence to build the 3D model of the scanned trees with SfM and including the corresponding 2D and 3D apple location annotations. This data allows the development, training, and test of fruit detection algorithms either based on RGB images, on coloured point clouds or on the combination of both types of data. Dades primàries associades a l'article http://hdl.handle.net/10459.1/68505, This work was partly funded by the Secretaria d'Universitats i Recerca del Departament d'Empresa i Coneixement de la Generalitat de Catalunya (grant 2017 SGR 646), the Spanish Ministry of Economy and Competitiveness (project AGL2013-48297-C2-2-R) and the Spanish Ministry of Science, Innovation and Universities (project RTI2018-094222-B-I00). Part of the work was also developed within the framework of the project TEC2016-75976-R, financed by the Spanish Ministry of Economy, Industry and Competitiveness and the European Regional Development Fund (ERDF). The Spanish Ministry of Education is thanked for Mr. J. Gené’s pre-doctoral fellowships (FPU15/03355).
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

Assessment of spray drift potential reduction for hollow-cone nozzles: Part 2. LiDAR technique

  • Gregorio López, Eduard
  • Torrent Martí, Xavier
  • Planas de Martí, Santiago
  • Rosell Polo, Joan Ramon
Pesticide spray drift poses health hazards to humans and causes a significant impact on the environment. In this work the capacity of an ad hoc light detection and ranging (LiDAR) system to differentiate spray nozzles according to their potential drift risk is evaluated for the first time. A total of 23 drift potential tests using 10 hollow-cone nozzles were carried out with the sprayer kept in a static position. Drift potential reduction (DPR) values of between 88.6% and 93.6% were obtained when comparing standard and drift reduction nozzle types. It was also possible to order different standard nozzle sizes according to their DPR. The LiDAR signalwas correlated with several droplet size parametersmeasured by a phase Doppler particle analyzer (PDPA), being V100 the best indicator. In the four field tests thatwere performed, the LiDAR systemwas also able to differentiate between standard and drift reduction nozzles under real application conditions, obtaining a DPR of 56.7%. The results of this work demonstrate that the developed LiDAR system is an advantageous alternative for the assessment of drift potential reduction., This work was partly funded by the Secretaria d'Universitats i Recerca del Departament d'Empresa i Coneixement de la Generalitat de Catalunya, the Spanish Ministry of Economy and Competitiveness and the European Regional Development Fund (ERDF) under Grants 2017 SGR 646, AGL2007-66093-C04-03, AGL2010-22304-04-C03-03, and AGL2013-48297-C2-2-R. Universitat de Lleida is thanked for Mr. X. Torrent's pre-doctoral fellowship. The authors would like to thank the Unité Mixte de Recherche Information & Technologies for AgroProcess (IRSTEA, Montpellier), and particularly Jean-Paul Douzals and Cyril Tinet for the nozzle characterization using their PDPA. Our thanks are also given to the Institut de Recerca en Tecnologia Agrària (IRTA) for allowing the use of their experimental fields, and to Vicenç Maquinària Agrícola for providing the tractor. The authors also wish to thank A. Checa (Randex Iberica, S.L.) for giving us free Albuz nozzles for the spray tests. R. Lavilla, E. Ordoño and F. Solanelles are acknowledged for their assistance in the field work, and J. Arnó is thanked for his help with statistical analysis.
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

Assessing the Performance of RGB-D Sensors for 3D Fruit Crop Canopy Characterization under Different Operating and Lighting Conditions

  • Gené Mola, Jordi
  • Llorens Calveras, Jordi
  • Rosell Polo, Joan Ramon
  • Gregorio López, Eduard
  • Arnó Satorra, Jaume
  • Solanelles Batlle, Francesc
  • Martínez Casasnovas, José Antonio
  • Escolà i Agustí, Alexandre
The use of 3D sensors combined with appropriate data processing and analysis has provided tools to optimise agricultural management through the application of precision agriculture. The recent development of low-cost RGB-Depth cameras has presented an opportunity to introduce 3D sensors into the agricultural community. However, due to the sensitivity of these sensors to highly illuminated environments, it is necessary to know under which conditions RGB-D sensors are capable of operating. This work presents a methodology to evaluate the performance of RGB-D sensors under different lighting and distance conditions, considering both geometrical and spectral (colour and NIR) features. The methodology was applied to evaluate the performance of the Microsoft Kinect v2 sensor in an apple orchard. The results show that sensor resolution and precision decreased significantly under middle to high ambient illuminance (>2000 lx). However, this effect was minimised when measurements were conducted closer to the target. In contrast, illuminance levels below 50 lx affected the quality of colour data and may require the use of artificial lighting. The methodology was useful for characterizing sensor performance throughout the full range of ambient conditions in commercial orchards. Although Kinect v2 was originally developed for indoor conditions, it performed well under a range of outdoor conditions., This research was funded by the Spanish Ministry of Economy and Competitiveness and the Ministry of Science, Innovation and Universities through the program Plan Estatal I+D+i Orientada a los Retos de la Sociedad, grant numbers AGL2013-48297-C2-2-R and RTI2018-094222-B-I00, respectively.
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

Assessing ranked set sampling and ancillary data to improve fruit load estimates in peach orchards

  • Uribeetxebarria Alonso de Armiño, Asier
  • Martínez Casasnovas, José Antonio
  • Tisseyre, Bruno
  • Guillaume, Serge
  • Escolà i Agustí, Alexandre
  • Rosell Polo, Joan Ramon
  • Arnó Satorra, Jaume
Fruit load estimation at plot level before harvest is a key issue in fruit growing. To face this challenge, two sampling methods to estimate fruit load in a peach tree orchard were compared: simple random sampling (SRS) and ranked set sampling (RSS). The study was carried out in a peach orchard (Prunus persica cv. 'Platycarpa') covering a total area of 2.24 ha. Having previously sampled the plot systematically to cover the entire area (104 individual trees or sampling points), both sampling methods (SRS and RSS) were tested by taking samples from this population with varying sample sizes from N = 4 to N = 12. Since RSS requires ancillary information to obtain the samples (ranking mechanism), several proximal and remote sensors already used or recently introduced in agriculture were assessed as data sources. A total of 14 variables provided by 5 different sensors and platforms were considered as potential ancillary variables. Among them, RGB images captured by an unmanned aerial vehicle (UAV), and used to estimate the canopy projected area of individual trees, proved to be the best of the options. This was shown by the high correlation (R = 0.85) between this area and the fruit load, providing RSS with the UAV-based canopy projected area the lowest Coefficient of Error (CE) for a given tree sample size. Then, comparing relative efficiency between random sampling (SRS) and RSS, the latter enables more precise fruit load estimates for any of the considered sample sizes. Interest and opportunity of RSS can be raised from two points of view. In terms of confidence, RSS managed to reduce the variance of fruit load estimates by about half compared to SRS. Sampling errors above the 10% threshold were always produced significantly fewer times using RSS, regardless of the sample size. In terms of operation within the plot, sample size could be reduced by 50%, from N = 10 for SRS to N = 5 for RSS, and this being expected sampling errors less than 10% in practically 70% of the samplings performed in both cases. In summary, fruit growers can take advantage of the combined use of appropriate data (RGB images from UAV) and RSS to optimize sample sizes and operational sampling costs in fruit growing., The Spanish Ministry of Economy and Competitiveness through the AgVANCE Project (AGL2013-48297-C2-2-R) funded this work.
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

LIDAR and non-LIDAR-based canopy parameters to estimate the leaf area in fruit trees and vineyard

  • Sanz Cortiella, Ricardo
  • Llorens Calveras, Jordi
  • Escolà i Agustí, Alexandre
  • Arnó Satorra, Jaume
  • Planas de Martí, Santiago
  • Román, Carla
  • Rosell Polo, Joan Ramon
This paper is based on two initial hypotheses, firstly, it is proposed that the vegetation volume obtained with a LIDAR-based system or tree row LIDAR volume (TRLV) has a high correlation with the leaf area (LA). Secondly, it is proposed that the projected outer surface or projected tree row surface (PTRS), also LIDAR-based, is linearly related with the LA. The verification of these two hypotheses corresponds to the first two objectives of this work. The third objective is to propose an alternative method, without using LIDAR sensors, simpler and more economical, for in situ LA evaluation. To achieve these objectives a total of 17 blocks of pear, 14 of apple and 26 of vine, in different phenological states, were LIDAR scanned and subsequently manually defoliated. After the field and calculation work, the TRLV and LA were compared. The logarithmic regressions obtained had high correlations. For apple and pear trees the equations are practically the same with R2 of 0.85 and 0.84, respectively. The equation corresponding to vines is somewhat different and has an R2 of 0.86. The regression without species differentiation is 3.66ln(x) +9.65 with R2=0.90. Based on the TRLV, the front and top projected surface areas of each block were then obtained and, using these variables, the PTRS. The linear regressions obtained between PTRS and LA have high correlations with R2 of 0.88, 0.85 and 0.80 for apple trees, pear trees, and vineyard respectively. The three crops show very similar behavior. The straight lines are very close, with very similar slopes. With no species differentiation the linear regression model is y=1.47x - 1.18 with R2=0.93. The starting point of the third objective is to obtain the projected surfaces, frontal and top, without using a LIDAR sensor. These surfaces are not as precise as those obtained with LIDAR and for this reason they are referred to as 'estimated' projected surfaces. To calculate the estimated PTRS without a LIDAR sensor, the height and depth of the vegetation are measured with a tape measure. It is also necessary to make a visual estimation of the frontal gap-fraction. For this, a training method with known gap-fraction pictograms is proposed. The final results with this non-LIDAR method are very similar to those obtained with LIDAR. This method, although it needs human intervention, is simple, easy, economical and precise for in situ LA estimation., This research was partially funded by the Spanish Ministry of Economy and Competitiveness (projects AGL2002-04260-C04-02, AGL2007-66093-C04-03, AGL2010-22304-C04-03 and AGL2013- 48297-C2-2-R) and EU FEDER. Funding of Secretaria d’Universitats i Recerca del Departament d’Empresa i Coneixement de la Generalitat de Catalunya under Grant 2017 SGR 646 is also thanked.
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

Determination of spray drift and buffer zones in 3D crops using the ISO standard and new LiDAR methodologies

  • Torrent Martí, Xavier
  • Gregorio López, Eduard
  • Rosell Polo, Joan Ramon
  • Arnó Satorra, Jaume
  • Peris Giner, Miquel
  • van de Zande, Jan C.
  • Planas de Martí, Santiago
Spray drift generated in the application of plant protection products in tree crops (3D crops) is a major source of environmental contamination, with repercussions for human health and the environment. Spray drift contamination acquires greater relevance in the EU Southern Zone due to the crops structure and the weather conditions. Hence, there is a need to evaluate spray drift when treating the most representative 3D crops in this area. For this purpose, 4 spray drift tests, measuring airborne and sedimenting spray drift in accordance with ISO 22866:2005, were carried out for 4 different crops (peach, citrus, apple and grape) in orchards of the EU Southern Zone, using an air-blast sprayer equipped with standard (STN) and spray drift reduction (DRN) nozzle types. A further 3 tests were carried out to test a new methodology for the evaluation of spray drift in real field conditions using a LiDAR system, in which the spray drift generated by different sprayer and nozzle types was contrasted. The airborne spray drift potential reduction (DPRV) values, obtained following the ISO 22866:2005, were higher than those for sedimenting spray drift potential reduction (DPRH) (63.82%-94.42% vs. 39.75%-69.28%, respectively). For each crop and nozzle type combination, a sedimenting spray drift model was also developed and used to determine buffer zone width. The highest buffer width reduction (STN vs DRN) was obtained in peach (˃75%), while in grape, citrus and apple only 50% was reached. These results can be used as the starting point to determine buffer zone width in the countries of the EU Southern Zone depending on different environmental threshold values. Tests carried out using LiDAR system demonstrated high capacity and efficiency of this system and this newly defined methodology, allowing sprayer and nozzle types in real field conditions to be differentiated and classified., This work was partly funded by the Secretaria d'Universitats i Recerca del Departament d'Empresa i Coneixement de la Generalitat de Catalunya, the Spanish Ministry of Economy and Competitiveness and the European Regional Development Fund (ERDF) under grants 2017 SGR 646, AGL2007-66093-C04-03, AGL2010-22304-04-C03-03, and AGL2013-48297-C2-2-R. The authors also wish to thank Mr. Antonio Checa (Randex Iberica, S.L.) for giving us free Albuz nozzles for the spray tests. Universitat de Lleida is also thanked for Mr. X. Torrent's pre-doctoral fellowship.
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

Eye-safe lidar system for pesticide spray drift measurement

  • Gregorio López, Eduard
  • Rocadenbosch Burillo, Francesc
  • Sanz Cortiella, Ricardo
  • Rosell Polo, Joan Ramon
Spray drift is one of the main sources of pesticide contamination. For this reason, an accurate understanding of this phenomenon is necessary in order to limit its effects. Nowadays, spray drift is usually studied by using in situ collectors which only allow time-integrated sampling of specific points of the pesticide clouds. Previous research has demonstrated that the light detection and ranging (lidar) technique can be an alternative for spray drift monitoring. This technique enables remote measurement of pesticide clouds with high temporal and distance resolution. Despite these advantages, the fact that no lidar instrument suitable for such an application is presently available has appreciably limited its practical use. This work presents the first eye-safe lidar system specifically designed for the monitoring of pesticide clouds. Parameter design of this system is carried out via signal-to-noise ratio simulations. The instrument is based on a 3-mJ pulse-energy erbium-doped glass laser, an 80-mm diameter telescope, an APD optoelectronic receiver and optomechanically adjustable components. In first test measurements, the lidar system has been able to measure a topographic target located over 2 km away. The instrument has also been used in spray drift studies, demonstrating its capability to monitor the temporal and distance evolution of several pesticide clouds emitted by air-assisted sprayers at distances between 50 and 100 m., This research was partially funded by the Spanish Ministry of Economy and Competitiveness (projects AGL2007-66093-C04-03, AGL2010-22304-C04-03 and AGL2013-48297-C2-2-R) and EU FEDER. This work was conducted in the framework of the collaboration agreement between the Universitat Politècnica de Catalunya (UPC) and the Universitat de Lleida (UdL) ref. A-00793 for Range-Resolved Remote Sensing of the Concentration of Pesticides in Agroforestry Environments. Alexandre Escolà and Joan Masip from the UdL, and Adolfo Comerón, Alejandro Rodríguez and Jordi Tiana from the UPC, are thanked for their cooperation in preparing this work. Innovació i Recerca Industrial i Sostenible S.L. (IRIS) is thanked for his cooperation in the development of the receiving subsystem.
Repositori Obert UdL
Publicación Contribución de congreso (ConferenceOutput)

Aplicaciones de la teledetección en la caracterización de frutales y en la fertilización de cultivos extensivos

  • Martínez Casasnovas, José Antonio
  • Arnó Satorra, Jaume
  • Daniele, Elisa
  • Escolà i Agustí, Alexandre
  • Sandonís Pozo, Leire
  • Llorens Calveras, Jordi
  • Rosell Polo, Joan Ramon
  • Uribeetxebarria Alonso de Armiño, Asier
Proyecto AgVANCE (AGL2013‐48297‐C2‐2‐R), Proyecto PAgFRUIT (RTI2018‐094222‐B‐I00)
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

3D characterization of a Boston Ivy double-skin green building facade using a LiDAR system

  • Pérez Luque, Gabriel
  • Escolà i Agustí, Alexandre
  • Rosell Polo, Joan Ramon
  • Coma Arpón, Julià
  • Arasanz Riba, Roger
  • Marrero Farré, Bernat
  • Cabeza, Luisa F.
  • Gregorio López, Eduard
On the way to more sustainable and resilient urban environments, the incorporation of urban green infrastructure (UGI) systems, such as green roofs and vertical greening systems, must be encouraged. Unfortunately, given their variable nature, these nature-based systems are difficult to geometrically characterize, and therefore there is a lack of 3D objects that adequately reflect their geometry and analytical properties to be used in design processes based on Building Information Modelling (BIM) technologies. This fact can be a disadvantage, during the building's design phase, of UGIs over traditional grey solutions. Areas of knowledge such as precision agriculture, have developed technologies and methodologies that characterize the geometry of vegetation using point cloud capture. The main aim of this research was to create the 3D characterization of an experimental double-skin green facade, using LiDAR technologies. From the results it could be confirmed that the methodology used was precise and robust, enabling the 3D reconstruction of the green facade's outer envelope. Detailed results were that foliage volume differences in height were linked to plant growth, whereas differences in the horizontal distribution of greenery were related to the influence of the local microclimate and specific plant diseases on the south orientation. From this research, along with complementary previous research, it could be concluded that, generally speaking, with vegetation volumes of 0.2 m3/m2, using Boston Ivy (Parthenocissus Tricuspidata) under Mediterranean climate, reductions in external building surface temperatures of around 13 °C can be obtained and used as analytic parameter in a future 3D-BIM-object., The authors at GREiA research group would like to thank the Catalan Government for the quality accreditation given to their research group (2017 SGR 1537). GREiA is a certified agent TECNIO in the category of technology developers from the Government of Catalonia. The authors at GRAP research group would like to thank the Secretaria d’Universitats i Recerca del Departament d’Empresa i Coneixement de la Generalitat de Catalunya (grant 2017 SGR 646), the Spanish Ministry of Economy and Competitiveness (project AGL2013-48297-C2-2-R) and the Spanish Ministry of Science, Innovation and Universities (project RTI2018-094222-B-I00). This work is partially supported by ICREA under the ICREA Academia programme. The authors also wish to thank Dr. Jaume Arnó for his contribution in the statistical analysis of the results.
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

Spatially variable pesticide application in vineyards: Part I, developing a geostatistical approach

  • Del Moral Martínez, Ignacio
  • Rosell Polo, Joan Ramon
  • Uribeetxebarria Alonso de Armiño, Asier
  • Arnó Satorra, Jaume
A geostatistical methodology is presented to optimise the dosage of plant protection products (PPP) in vineyards with spatial variability. Sprayers are commonly used in viticulture to apply a constant volume rate per unit ground area (l ha−1). This can be a problem in vineyard plots with remarkable spatial variability in vine vigour, being necessary guiding winegrowers through a decision-making tool to determine an appropriate uniform volume rate. The leaf area index (LAI), measured by a terrestrial LiDAR scanner at high spatial resolution along crop rows, can be used to determine the optimum volume application rate. The proposed method is based on obtaining different probability maps of LAI by applying an indicator kriging to the original LAI data. As a result, this method allows winegrowers to i) map and locate areas within the plot that, within a given confidence level (70% or 90%), exceed or do not exceed different values (percentiles) of the original LAI, and ii) set the LAI and the corresponding volume rate seeking, for example, to balance the probability (risk) of areas with lower and higher doses than required. In more conservative protection strategies, the method also allows farmers to set the values of LAI and volume rate that greatly minimise the probability of vulnerable areas being underdosed., This work was partially funded by the Ministerio de Economía y Competitividad, Spain [research projects SAFESPRAY - AGL2010-22304-C04-03 and AGVANCE – AGL2013-48297-C2-2-R].
Repositori Obert UdL
Publicación Contribución de congreso (ConferenceOutput)

Fruit detection and 3D location using instance segmentation neural networks and SfM photogrammetry

  • Gregorio López, Eduard
  • Sanz Cortiella, Ricardo
  • Rosell Polo, Joan Ramon
  • Morros Rubió, Josep Ramon
  • Ruiz Hidalgo, Javier
  • Vilaplana Besler, Verónica
  • Gregorio López, Eduard
The development of remote fruit detection systems able to identify and 3D locate fruits provides opportunities to improve the effi-ciency of agriculture management. Most of the current fruit detec-tion systems are based on 2D image analysis. Although the use of 3D sensors is emerging, precise 3D fruit location is still a pending issue. This work presents a new methodology for fruit detection and 3D location, combining the use of instance segmentation neu-ral networks and Structure-from-Motion (SfM) photogrammetry., This work was partly funded by the Secretaria d’Universitats i Recerca de la Gener-alitat de Catalunya (grant 2017 SGR 646), the Spanish Ministry of Economy and Competitiveness (projects AGL2013-48297-C2-2-R and TEC2016-75976-R) and the Spanish Ministry of Science, Innovation and Universities (project RTI2018-094222-B-I00). The Spanish Ministry of Education is thanked for Mr. J. Gené’s pre-doctoral fellowships (FPU15/03355).
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

Mobile terrestrial laser scanner applications in precision fruticulture/ horticulture and tools to extract information from canopy point clouds

  • Escolà i Agustí, Alexandre
  • Martínez Casasnovas, José Antonio
  • Rufat i Lamarca, Josep
  • Arnó Satorra, Jaume
  • Arbonés, Amadeu
  • Sebé Feixas, Francesc
  • Pascual Roca, Miquel
  • Gregorio López, Eduard
  • Rosell Polo, Joan Ramon
LiDAR sensors are widely used in many areas and, in recent years, that includes agricultural tasks. In this work, a self-developed mobile terrestrial laser scanner based on a 2D light detection and ranging (LiDAR) sensor was used to scan an intensive olive orchard, and different algorithms were developed to estimate canopy volume. Canopy volume estimations derived from LiDAR sensor readings were compared to conventional estimations used in fruticulture/horticulture research and the results prove that they are equivalent with coefficients of correlation ranging from r = 0.56 to r = 0.82 depending on the algorithms used. Additionally, tools related to analysis of point cloud data from the LiDAR-based system are proposed to extract further geometrical and structural information from tree row crop canopies to be offered to farmers and technical advisors as digital raster maps. Having high spatial resolution information on canopy geometry (i.e., height, width and volume) and on canopy structure (i.e., light penetrability, leafiness and porosity) may result in better orchard management decisions. Easily obtainable, reliable information on canopy geometry and structure may favour the development of decision support systems either for irrigation, fertilization or canopy management, as well as for variable rate application of agricultural inputs in the framework of precision fruticulture/horticulture., This work was funded by the Spanish Ministry of Economy and Competitiveness through the projects SAFESPRAY (AGL2010-22304-C04-03) and AgVANCE (AGL2013-48297-C2-2-R) and by the project Instituto Nacional de Investigación y Tecnología Agraria y Alimentaria RTA2012-00059-C02-01.
Repositori Obert UdL
Publicación Contribución de congreso (ConferenceOutput)

Fruit detection and sizing using photonic sensors and artificial intelligence

  • Gené Mola, Jordi
  • Gregorio López, Eduard
  • Sanz Cortiella, Ricardo
  • Escolà i Agustí, Alexandre
  • Rosell Polo, Joan Ramon
The Secretaria d’Universitats i Recerca del Departament d’Economia i Coneixement de la Generalitat de Catalunya, the Spanish Ministry of Education and the Spanish Ministry of Science, Innovation and Universities are thanked the pre-doctoral fellowships 2016FI_B00669, FPU15/03355 and EST18/00487, respectively. The Spanish Ministry of Universities is thanked for the posdoctoral Margarita Salas grant given to Jordi Gené, funded by the European Union-Next Generation EU. The research work was partly funded by the Secretaria d’Universitats i Recerca del Departament d’Empresa i Coneixement de la Generalitat de Catalunya (grant 2017SGR646), the Spanish Ministry of Economy and Competitiveness (project AGL2013-48297-C2-2-R) and the Spanish Ministry of Science, Innovation and Universities (project RTI2018-094222-B-I00).
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

Apparent electrical conductivity and multivariate analysis of soil properties to assess soil constraints in orchards affected by previous parcelling

  • Uribeetxebarria Alonso de Armiño, Asier
  • Arnó Satorra, Jaume
  • Escolà i Agustí, Alexandre
  • Martínez Casasnovas, José Antonio
Fruit production is relevant to the European agricultural sector. However, orchards in semi-arid areas of southern Europe may contain soils with constraints for tree development. This is the case of soils with high CaCO⁠3 content or limiting layers at variable depth. To assess spatial and in-depth variation of these soil constraints, an apparent electrical conductivity (ECa) survey was conducted in an orchard by using a galvanic contact soil sensor (Veris 3100). Different soil properties were randomly sampled at two depths (topsoil and subsoil) in 20 different sampling points within the plot. ECa raster maps were obtained for shallow (0-30cm) and deep (0-90cm) soil profile depths. In addition, an inversion modelling software was used to obtain horizontal ECa slices corresponding to 10cm thick soil layers from 0-10cm to 80-90cm in depth. Concordance analysis of ECa slices allowed the soil profile to be segmented into four homogeneous horizons with different spatial conductivity pattern. Then, a multivariate analysis of variance (MANOVA) was key, i) to better interpret the specific soil properties that mainly contributed to the spatial variation of ECa (CaCO⁠3 and organic matter (OM) contents), and ii) to delimit the soil layer and the specific spatial pattern of ECa that allows potential management areas to be delineated by presenting the same trend in CaCO⁠3 and OM for topsoil and subsoil simultaneously. Moreover, assessing 3D variation of ECa made it possible to identify different soil areas that, linked to previous earthworks to optimize the parcelling of the farm, are the main cause of spatial variability within the orchard., This work was funded by the Spanish Ministry of Economy and Competitiveness through the project AgVANCE (AGL2013-48297-C2-2-R). We are also grateful to the University of Lleida for funding PhD scholarship for the first author.
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

Pesticide dose adjustment in fruit and grapevine orchards by DOSA3D: Fundamentals of the system and on-farm validation

  • Román, Carla
  • Peris Giner, Miquel
  • Esteve, Joan
  • Tejerina, Miguel
  • Cambray, Jordi
  • Vilardell i Coderch, Pere
  • Planas de Martí, Santiago
Agricultural productivity cannot be sustained without the application of plant protection measures. Within the framework of integrated pest management (IPM), the use of chemical pesticides should be limited to the last option among the available practices. Even though their use remains common, it carries associated environmental and human health risks. One of the most accepted practices within IPM is the reduction of spraying events and/or pesticide applied doses. DOSA3D is a decision support system that allows the dose to be adjusted to the specific treatment scenario. For this, DOSA3D calculates the optimal application volume rate by estimating the leaf area index and takes into account the overall spraying efficiency and the pest or disease to be controlled. The system adopts specific minimum volume rates for fruit trees and vineyards without compromising the crop health status. To establish the adjusted dose, the labeled or the adviser prescription concentration is kept. Resulting adjusted doses provided by DOSA3D achieved pesticide savings up to 53% in fruit trees and 60% in vineyards. DOSA3D has been validated against the main diseases and pests of fruit trees and vineyards: brown spot and psylla in pear orchards; alternaria blotch disease, apple scab, codling moth, oriental moth and red spider mite in apple orchards; powdery mildew, brown rot, aphids, thrips and mites in peach orchards; and, powdery mildew, yellow spider mite and leafhoppers in grapevine orchards. In addition, a methodology called Green Way is presented to provide consistent and crop safety pesticide doses when these are labeled as concentration or ground area doses., his study wasfinanced by the EU Horizon 2020 project EUCLID[grant number 633999], the Spanish Ministry of Economy and Compet-itiveness project AgVance [AGL2013-48297-C2-2-R] and the SpanishMinistry of Agriculture, Fisheries and Food project GOPHYTOVID [con-tract 2018002001192]. We are also grateful for funding by theSecretaria d'Universitats i Recerca del Departament d'Empresa iConeixement de la Generalitat de Catalunya under Grant 2017 SGR 646
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

Fruit detection in an apple orchard using a mobile terrestrial laser scanner

  • Gené Mola, Jordi
  • Gregorio López, Eduard
  • Guevara, Javier
  • Auat Cheein, Fernando
  • Sanz Cortiella, Ricardo
  • Escolà i Agustí, Alexandre
  • Llorens Calveras, Jordi
  • Morros Rubió, Josep Ramon
  • Ruiz Hidalgo, Javier
  • Vilaplana Besler, Verónica
  • Rosell Polo, Joan Ramon
The development of reliable fruit detection and localization systems provides an opportunity to improve the crop value and management by limiting fruit spoilage and optimised harvesting practices. Most proposed systems for fruit detection are based on RGB cameras and thus are affected by intrinsic constraints, such as variable lighting conditions. This work presents a new technique that uses a mobile terrestrial laser scanner (MTLS) to detect and localise Fuji apples. An experimental test focused on Fuji apple trees (Malus domestica Borkh. cv. Fuji) was carried out. A 3D point cloud of the scene was generated using an MTLS composed of a Velodyne VLP-16 LiDAR sensor synchronised with an RTK-GNSS satellite navigation receiver. A reflectance analysis of tree elements was performed, obtaining mean apparent reflectance values of 28.9%, 29.1%, and 44.3% for leaves, branches and trunks, and apples, respectively. These results suggest that the apparent reflectance parameter (at 905 nm wavelength) can be useful to detect apples. For that purpose, a fourstep fruit detection algorithm was developed. By applying this algorithm, a localization success of 87.5%, an identification success of 82.4%, and an F1-score of 0.858 were obtained in relation to the total amount of fruits. These detection rates are similar to those obtained by RGB-based systems, but with the additional advantages of providing direct 3D fruit location information, which is not affected by sunlight variations. From the experimental results, it can be concluded that LiDAR-based technology and, particularly, its reflectance information, has potential for remote apple detection and 3D location., This work was partly funded by the Secretaria d’Universitats i Recerca del Departament d’Empresa i Coneixement de la Generalitat de Catalunya (grant 2017 SGR 646), the Spanish Ministry of Economy and Competitiveness (projects AGL2013-48297-C2-2-Rand MALEGRA, TEC2016-75976-R) and the Spanish Ministry of Science, Innovation and Universities (project RTI2018-094222-B-I00). The Spanish Ministry of Education is thanked for Mr. J. Gené’s pre-doctoral fellowships (FPU15/03355). The work of Jordi Llorens was supported by Spanish Ministry of Economy, Industry and Competitiveness through a postdoctoral position named Juan de la Cierva Incorporación (JDCI-2016-29464_N18003). We would also like to thank CONICYT/FONDECYT for grant 1171431 and CONICYT FB0008. Nufri (especially Santiago Salamero and Oriol Morreres) and Vicens Maquinària Agrícola S.A. are also thanked for their support during the data acquisition.
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

PFuji-Size dataset: A collection of images and photogrammetry-derived 3D point clouds with ground truth annotations for Fuji apple detection and size estimation in field conditions

  • Gené Mola, Jordi
  • Sanz Cortiella, Ricardo
  • Rosell Polo, Joan Ramon
  • Escolà i Agustí, Alexandre
  • Gregorio López, Eduard
The PFuji-Size dataset is comprised of a collection of 3D point clouds of Fuji apple trees (Malus domestica Borkh. cv. Fuji) scanned at different maturity stages and annotated for fruit detection and size estimation. Structure-from-motion and multi-view stereo techniques were used to generate the 3D point clouds of 6 complete Fuji apple trees containing a total of 615 apples. The resulting point clouds were 3D segmented by identifying the 3D points corresponding to each apple (3D instance segmentation), obtaining a single point cloud for each apple. All segmented apples were labelled with ground truth diameter annotations. Since the data was acquired in field conditions and at different maturity stages, the set includes different fruit diameters -from 26.9 mm to 94.8 mm- and different fruit occlusion percentages due to foliage. In addition, 25 apples were photographed 360° in laboratory conditions, obtaining high resolution 3D point clouds of this sub-set. To the best of the authors' knowledge, this is the first publicly available dataset for apple size estimation in field conditions. This dataset was used to evaluate different fruit size estimation methods in the research article titled 'In-field apple size estimation using photogrammetry-derived 3D point clouds: comparison of 4 different methods considering fruit occlusion' (Gené-Mola et al., 2021)., This work was partly funded by the Secretaria d'Universitats i Recerca del Departament d'Empresa i Coneixement de la Generalitat de Catalunya (grant 2017 SGR 646) and the Spanish Ministry of Economy and Competitiveness (project AGL2013-48297-C2-2-R). Part of the work was founded with the Grant RTI2018-094222-B-I00 (PAgFRUIT project) by MCIN/AEI/10.13039/501100011033 and by ``ERDF, a way of making Europe'', by the European Union. The Spanish Ministry of Education is thanked for Mr. J. Gené's pre-doctoral fellowships (FPU15/03355). We would also like to thank Nufri (especially Santiago Salamero and Oriol Morreres) for their support during data acquisition.
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

Mobile terrestrial laser scanner vs. UAV photogrammetry to estimate woody crop canopy parameters - Part 1: Methodology and comparison in vineyards

  • Escolà i Agustí, Alexandre
  • Peña, José M.
  • López-Granados, Francisca
  • Rosell Polo, Joan Ramon
  • de Castro, Ana I.
  • Gregorio López, Eduard
  • Jiménez-Brenes, Francisco M.
  • Sanz Cortiella, Ricardo
  • Sebé Feixas, Francesc
  • Llorens Calveras, Jordi
  • Torres-Sánchez, Jorge
Characterizing crop canopies is especially important in the management of woody crops. In this article, two systems were compared to characterise a 50 m long vineyard row section. One of the systems was a mobile terrestrial laser scanner based on a light detection and ranging (LiDAR) sensor (MTLS-LiDAR). The other was an uncrewed aerial vehicle (UAV) based system using digital aerial photogrammetry (UAV-DAP). The resulting 3D point clouds were assessed qualitatively and quantitatively. Canopy heights, widths and volumes were obtained in 0.1 m long sections along the studied row. All the parameters derived from the two systems presented statistically significant differences. The coefficients of determination between systems were 0.619 for canopy maximum heights above ground level (agl), 0.686 for 90th percentile (P90) heights agl, and 0.283 and 0.274 for maximum and P90 vegetated heights, respectively. Coefficients of determination between averaged maximum canopy width and P90 canopy width were 0.328 and 0.317, respectively. Coefficients of determination between cross-sectional areas determined from maximum widths, P90 widths and from the occupancy grid method were 0.423, 0.409 and 0.334, respectively. Total canopy volume for the entire row obtained from the three cross section estimation methods differed between 19 m3 and 25 m3. The reasons found were that the MTLS-LiDAR-derived point cloud captured the canopy top and side variability but could be affected by occlusions, mixed pixels and tall grass-like weeds present in the surveyed area. For its part, the UAV-DAP-derived point cloud tended to miss top and side shoots and somewhat smoothed canopy variability. As neither of the systems is optimal, a balance needs to be found according to the specific requirements of the survey. For this purpose, a list of pros and cons is presented to support the selection of one of the two systems for canopy monitoring. The MTLS-LiDAR system should be chosen when high detail is required but small areas are to be scanned. Alternatively, the UAV-DAP system should be chosen when large areas are to be monitored and when canopy detail is not so important. Further results are presented in Part 2 for a larger area and including pear and peach orchards with different training systems. Future research is to be conducted on how the compared systems affect variability detection and support variable-rate prescriptions., This research was funded by the projects AGVANCE (AGL2013-48297-C2-2-R), PAgPROTECT (PID2021-126648OB-I00), DECIMAL (PID2020-113229RB-C41) and PRODIGIA (PID2020-113229RB-C44) from the Spanish Ministry of Science and Innovation MICIN/AEI/10.13039/501100011033/FEDER, UE. The authors also want to thank Codorníu SA and Celler Raimat for allowing the use of one of their vineyards to conduct the trial described in this work.
Repositori Obert UdL
Publicación Contribución de congreso (ConferenceOutput)

A new Leafiness-LiDAR index to estimate light interception in intensive olive orchards

  • Sandonís Pozo, Leire
  • Martínez Casasnovas, José Antonio
  • Escolà i Agustí, Alexandre
  • Rosell Polo, Joan Ramon
  • Rufat i Lamarca, Josep
  • Pascual Roca, Miquel
The 14th European Conference on Precision Agriculture, July 2-6, 2023, Bologna, Italy, Canopy light interception constitutes an important yield limiting factor in high density olive orchards. However, its characterisation still implies laborious measurements. A new index, the Leafiness-LiDAR index (LLI), is presented as a LAI estimator. LLI combines LiDAR-derived parameters: Cross-Section and Leafiness from 3D point clouds. To validate the results, photosynthetically active radiation (PAR) measurements, canopy volume, yield and quality parameters were collected and analysed. LLI showed significant correlations both with PAR and canopy volume (r = 0.8) and quality parameters (r = -0.6). LLI may be useful as an early decision canopy monitoring tool in the framework of Precision Fructiculture., This work was carried out with data acquired in the project IRTA2012-00059-C02-01 funded by the Instituto Nacional de Investigación y Tecnología Agraria y Alimentaria, as well as in the projects AGL2010-22304-C04-03 and AGL2013-48297-C2-2-R funded by the Spanish Ministry of Economy and Competitiveness and developed under the frame of the grants RTI2018-094222-B-I00 (PAgFRUIT project) and PID2021-126648OB-I00 (PAgPROTECT project) by MCIN/AEI/10.13039/501100011033 and by “ERDF, a way of making Europe”, by the European Union.
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

Kinect v2 sensor-based mobile terrestrial laser scanner for agricultural outdoor applications

  • Rosell Polo, Joan Ramon
  • Gregorio López, Eduard
  • Gené Mola, Jordi
  • Llorens Calveras, Jordi
  • Torrent Martí, Xavier
  • Arnó Satorra, Jaume
  • Escolà i Agustí, Alexandre
Mobile terrestrial laser scanners (MTLS), based on light detection and ranging (LiDAR) sensors, are used worldwide in agricultural applications. MTLS are applied to characterize the geometry and the structure of plants and crops for technical and scientific purposes. Although MTLS exhibit outstanding performance, their high cost is still a drawback for most agricultural applications. This paper presents a low-cost alternative to MTLS based on the combination of a Kinect v2 depth sensor and a Real Time Kinematic (RTK) global navigation satellite system (GNSS) with extended color information capability. The theoretical foundations of this system are exposed along with some experimental results illustrating their performance and limitations. This work is focused on open-field agricultural applications, although most conclusions can also be extrapolated to similar outdoor uses. The developed Kinect-based MTLS (K2-MTLS) system allows to select different acquisition frequencies and fields of view (FOV), from one to 512 vertical slices. The authors conclude that the better performance is obtained when a FOV of a single slice is used, but at the price of a very low measuring speed. With that particular configuration, plants, crops, and objects are reproduced accurately. Future efforts will be directed to increase the scanning efficiency by improving both the hardware and software components and to make it feasible using both partial and full FOV.
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

In-field apple size estimation using photogrammetry-derived 3D point clouds: Comparison of 4 different methods considering fruit occlusions

  • Gené Mola, Jordi
  • Sanz Cortiella, Ricardo
  • Rosell Polo, Joan Ramon
  • Escolà i Agustí, Alexandre
  • Gregorio López, Eduard
In-field fruit monitoring at different growth stages provides important information for farmers. Recent advances have focused on the detection and location of fruits, although the development of accurate fruit size estimation systems is still a challenge that requires further attention. This work proposes a novel methodology for automatic in-field apple size estimation which is based on four main steps: 1) fruit detection; 2) point cloud generation using structure-from-motion (SfM) and multi-view stereo (MVS); 3) fruit size estimation; and 4) fruit visibility estimation. Four techniques were evaluated in the fruit size estimation step. The first consisted of obtaining the fruit diameter by measuring the two most distant points of an apple detection (largest segment technique). The second and third techniques were based on fitting a sphere to apple points using least squares (LS) and M−estimator sample consensus (MSAC) algorithms, respectively. Finally, template matching (TM) was applied for fitting an apple 3D model to apple points. The best results were obtained with the LS, MSAC and TM techniques, which showed mean absolute errors of 4.5 mm, 3.7 mm and 4.2 mm, and coefficients of determination () of 0.88, 0.91 and 0.88, respectively. Besides fruit size, the proposed method also estimated the visibility percentage of apples detected. This step showed an of 0.92 with respect to the ground truth visibility. This allowed automatic identification and discrimination of the measurements of highly occluded apples. The main disadvantage of the method is the high processing time required (in this work 2760 s for 3D modelling of 6 trees), which limits its direct application in large agricultural areas. The code and the dataset have been made publicly available and a 3D visualization of results is accessible at http://www.grap.udl.cat/en/publications/apple_size_estimation_SfM., This work was partly funded by the Secretaria d’Universitats i Recerca del Departament d’Empresa i Coneixement de la Generalitat de Catalunya (grant 2017 SGR 646), the Spanish Ministry of Economy and Competitiveness (project AGL2013-48297-C2-2-R) and the Spanish Ministry of Science, Innovation and Universities (project RTI2018-094222-B-I00). The Spanish Ministry of Education is thanked for Mr. J. Gené’s pre-doctoral fellowships (FPU15/03355). We would also like to thank Nufri (especially Santiago Salamero and Oriol Morreres) for their support during data acquisition.
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

Lidar: towards a new methodology for field measurement of spray drift

  • Gregorio López, Eduard
  • Torrent Martí, Xavier
  • Solanelles Batlle, Francesc
  • Sanz Cortiella, Ricardo
  • Rocadenbosch Burillo, Francesc
  • Masip Vilalta, Joan
  • Ribes Dasi, Manuel
  • Planas de Martí, Santiago
  • Rosell Polo, Joan Ramon
Lidar technology is becoming a promising alternative for spray drift measurement to the labour and time-expensive methodologies based on the ISO 22866 standard. This paper presents last advancements in an eye-safe lidar system specifically designed for drift monitoring. The lidar system was tested with an air-assisted sprayer in two cases: with standard hollow cone and air induction low-drift nozzles. The remaining variables (flow rate, environmental conditions,…) were similar. Lidar measurements allowed to know the time evolution of spray drift clouds and showed a much higher droplet concentration, dwelling time and dimensions for the cloud generated by standard nozzles. Also, the ability of the lidar system to distinguish different nozzle types according to their drift potential was proved. Finally, staring (laser beam stationary through the drift cloud) and 2D scanning measurements are discussed as starting points for an alternative spray drift measurement methodology., This research was partially funded by the Spanish Ministry of Economy and Competitiveness (projects AGL2007-66093-C04-03, AGL2010-22304-04-C03-03 and AGL2013-48297-C2-2- R) and EU FEDER.
Repositori Obert UdL
Publicación Capítulo o parte de un libro (BookPart)

Sensores de conductividad eléctrica aparente para el análisis de la variabilidad del suelo en Agricultura de Precisión

  • Martínez Casasnovas, José Antonio
  • Arnó Satorra, Jaume
  • Escolà i Agustí, Alexandre
Los suelos son un recurso natural fundamental en agricultura, ya que sustentan la vida de las plantas. El conocimiento de sus propiedades y cómo varían en el espacio es fundamental para mantener su productividad y para la toma de decisiones adecuadas sobre su manejo. No obstante, y dadas las características intrínsecas de los suelos de ser entes naturales que se desarrollan en profundidad, los hace difíciles de estudiar y de determinar su variabilidad en un grado de detalle adecuado para aplicaciones en Agricultura de Precisión. No obstante, desde la expansión de las tecnologías de la información geográfica (SIG, Teledetección, GNSS), y de métodos de interpolación espacial, la percepción y la obtención de mapas del suelo o de propiedades de los suelos está cambiando. Así, dentro del ámbito de las técnicas y tecnologías de la Agricultura de Precisión, los sensores que miden la conductividad eléctrica aparente del suelo (CEa) pueden ser una alternativa a tener en cuenta para poder inferir la variabilidad de las propiedades del suelo en cada punto de una parcela agrícola. Estos sensores se utilizan cada vez más para comprender y evaluar cómo varía espacialmente el suelo y también para definir zonas de manejo diferenciado en parcelas agrícolas, tanto en cultivos extensivos como en plantaciones frutícolas. En el presente artículo se explica qué es y qué mide la conductividad eléctrica aparente del suelo y con qué propiedades del suelo se puede correlacionar. También, los dos tipos de sensores que miden la CEa en continuo y que se utilizan en aplicaciones de Agricultura de Precisión: contacto galvánico directo e inducción electromagnética. Finalmente se exponen diversas aplicaciones de esta tecnología llevadas a cabo por el Grupo de Investigación en AgróTICa y Agricultura de Precisión de la Universitat de Lleida y Agrotecnio-CERCA Center en fruticultura, viñedo y cultivos extensivos., Los autores quieren agradecer la financiación obtenida en los proyectos de investigación AgVANCE (AGL2013-48297-C2-2-R, Ministerio de Economía, Industria y Competitividad), LISA-Low Input Sustainable Agriculture (COMRDI16-1-0031, Fondo Europeo de Desarrollo Regional de la Unión Europea), PAgFRUIT (RTI2018-094222-B-I00, Ministerio de Ciencia, Innovación y Universidades), ayuda 2017 SGR 646 (Secretaria d’Universitats i Recerca del Departament d’Empresa i Coneixement de la Generalitat de Catalunya) y el contrato de investigación con la empresa Ventafarinas, S.L., que han hecho posible llevar a cabo la investigación cuyos ejemplos se han mostrado en este artículo. También a los miembros del Grupo de Investigación en AgróTICa y Agricultura de Precisión de la Universitat de Lleida/Agrotecnio-CERCA Center (www.grap.udl.cat) que han participado en estos proyectos.
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

Mapping vineyard leaf area using mobile terrestrial laser scanners: should rows be scanned on-the-go or discontinuosly sampled?

  • Moral Martínez, Ignacio del
  • Rosell Polo, Joan Ramon
  • Company Mesa, Joaquim
  • Sanz Cortiella, Ricardo
  • Escolà i Agustí, Alexandre
  • Masip Vilalta, Joan
  • Martínez Casasnovas, José Antonio
  • Arnó Satorra, Jaume
The leaf area index (LAI) is defined as the one-side leaf area per unit ground area, and is probably the most widely used index to characterize grapevine vigor. However, LAI varies spatially within vineyard plots. Mapping and quantifying this variability is very important for improving management decisions and agricultural practices. In this study, a mobile terrestrial laser scanner (MTLS) was used to map the LAI of a vineyard, and then to examine how different scanning methods (on-the-go or discontinuous systematic sampling) may affect the reliability of the resulting raster maps. The use of the MTLS allows calculating the enveloping vegetative area of the canopy, which is the sum of the leaf wall areas for both sides of the row (excluding gaps) and the projected upper area. Obtaining the enveloping areas requires scanning from both sides one meter length section along the row at each systematic sampling point. By converting the enveloping areas into LAI values, a raster map of the latter can be obtained by spatial interpolation (kriging). However, the user can opt for scanning on-the-go in a continuous way and compute 1-m LAI values along the rows, or instead, perform the scanning at discontinuous systematic sampling within the plot. An analysis of correlation between maps indicated that MTLS can be used discontinuously in specific sampling sections separated by up to 15 m along the rows. This capability significantly reduces the amount of data to be acquired at field level, the data storage capacity and the processing power of computers., This work was partially funded by the Spanish Ministry of Economy and Competitiveness (research projects SAFESPRAY—AGL2010-22304-C04-03 and AGVANCE—AGL2013-48297-C2-2-R).
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

Bases for pesticide dose expression and adjustment in 3D crops and comparison of decision support systems

  • Planas de Martí, Santiago
  • Román, Carla
  • Sanz Cortiella, Ricardo
  • Rosell Polo, Joan Ramon
Authorities around the world have committed to limiting the use of chemical pesticides by reducing doses, among other strategies. Nevertheless, different dose expression models and decision support systems (DSSs) for dose adjustment coexist for high growing crops (3D crops). Among them, leaf wall area (LWA) and tree row volume (TRV) models have recently been proposed by the European and Mediterranean Plant Protection Organization (EPPO) for pre-registration trials. In this paper, the background and technical bases of six dose adjustment DSSs in fruit crops (PACE, AGMET, DOSA3D, OMAX and PULVARBO) and four in grape orchards (AGMET, OPTIDOSE, DOSAVIÑA and DOSA3D) are described and compared. The discussion leads to the conclusion that LWA and TRV represents a substantial improvement compared to the former crop ground area-based dose expression model. However, total leaf area is the most important parameter for dose adjustment, while sprayer efficiency is also a key factor. Additionally, it is suggested that deposition on leaves (mean values and variability) should be reported in pesticide efficacy evaluations in order to establish the required doses independently from the dose expression mode. The DOSA3D system, based on leaf area index estimation, was found to be the most conservative DSS regarding the spraying volume ratio to TRV because low spraying efficiencies are considered. Instead, AGMET was found to be the most effective for dose adjustment. However, despite the differences between the recommendations, all the analysed DSSs are useful tools for rational decision making about spraying volume rate and pesticide doses at national level. Their use should be promoted by the competent authorities., This study wasfinanced by the EU Horizon 2020 project EUCLID[grant number 633999], the Spanish Ministry of Economy and Compet-itiveness project AgVance [AGL2013-48297-C2-2-R] and the SpanishMinistry of Agriculture, Fisheries and Food project GOPHYTOVID [con-tract 2018002001192]. We are also grateful for funding by theSecretaria d'Universitats i Recerca del Departament d'Empresa iConeixement de la Generalitat de Catalunya under Grant 2017 SGR 646
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

Georeferenced Scanning System to Estimate the Leaf Wall Area in Tree Crops

  • Moral Martínez, Ignacio del
  • Rosell Polo, Joan Ramon
  • Arnó Satorra, Jaume
  • Escolà i Agustí, Alexandre
  • Sanz Cortiella, Ricardo
  • Masip Vilalta, Joan
  • Company Mesa, Joaquim
This paper presents the use of a terrestrial light detection and ranging (LiDAR) system to scan the vegetation of tree crops to estimate the so-called pixelated leaf wall area (PLWA). Scanning rows laterally and considering only the half-canopy vegetation to the line of the trunks, PLWA refers to the vertical projected area without gaps detected by LiDAR. As defined, PLWA may be different depending on the side from which the LiDAR is applied. The system is completed by a real-time kinematic global positioning system (RTK-GPS) sensor and an inertial measurement unit (IMU) sensor for positioning. At the end, a total leaf wall area (LWA) is computed and assigned to the X, Y position of each vertical scan. The final value of the area depends on the distance between two consecutive scans (or horizontal resolution), as well as the number of intercepted points within each scan, since PLWA is only computed when the laser beam detects vegetation. To verify system performance, tests were conducted related to the georeferencing task and synchronization problems between GPS time and central processing unit (CPU) time. Despite this, the overall accuracy of the system is generally acceptable. The Leaf Area Index (LAI) can then be estimated using PLWA as an explanatory variable in appropriate linear regression models., This work was funded by the Spanish Ministry of Economy and Competitiveness and by the European Union through its FEDER funds; it is a part of the Optidosa (AGL2007-66093-C04-03), Safespray (AGL2010-22304-C04-03) and Agvance (AGL2013-48297-C2-2-R) research projects.
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Aerial imagery or on-ground detection? An economic analysis for vineyard crops

  • Andújar, Dionisio
  • Moreno, Hugo
  • Bengochea-Guevara, José M.
  • Castro, Ana Isabel de
  • Ribeiro Seijas, Ángela
Aerial and on-ground vegetation characterization technologies are continuously evolving. An experiment was conducted in a vineyard field in order to test the economic feasibility of applying fertilizers site specifically based on different mapping systems. The capacity of UAV missions and on-ground systems has been compared using depth cameras or LiDAR systems respectively in order to provide the necessary vineyard volume maps for specific applications like fertilization. Aerial imagery was obtained using a UAV equipped with a high-resolution RGB camera, and a digital surface model was reconstructed using photogrammetry procedures. On-ground crop reconstruction was performed using LiDAR-based measurements taken with an RTK-GNSS along the crop rows. Furthermore, a Kinect v2 sensor was also used as a low cost depth camera. All systems were tested in a commercial field, under sunlight conditions. Every technique provided a 3D dense point cloud from which volume was calculated. The results showed that volume values were always consistent and similar between the studied systems. The on-ground techniques provided the best details of the plants. However, the cost of acquisition was always higher than that of aerial imagery. Concerning the fertiliser application it should be noted that, the changes in shape and size of plants obtained within the vineyard indicate that continuous adjustment of the applied dose would be required to optimize the performed application. When using site-specific spraying based on the created maps, the dose was reduced by up to 80% of the total dosage used with a conventional application. A detailed analysis of savings indicates differences between the systems. The use of aerial imagery techniques resulted in positive net returns, whereas the on-ground technologies needed a faster time of acquisition in order of them to be profitable. Regarding efficacy, no significant differences between applications based on the constructed maps were found. This important reduction in fertilizer application could be followed by an equivalent reduction in plant protection products (e.g., fungicides). Thus, the use of some 3D characterization technologies has shown to be profitable at the current stage of development while also reducing the inputs and the environmental impact of agricultural tasks., This research was partly funded by the AGL2013-48297-C2-2-R, and AGL2017-83325-C4-3-R projects (Spanish Ministry of Economy and Competitiveness) and by the RYC-2016-20355 agreement., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Mobile terrestrial laser scanner vs. UAV photogrammetry to estimate woody crop canopy parameters – Part 2: Comparison for different crops and training systems

  • Torres-Sánchez, Jorge
  • Escolà Agustí, Alexandre
  • Castro, Ana Isabel de
  • López Granados, Francisca
  • Rosell-Polo, Joan R.
  • Sebé, Francesc
  • Jiménez-Brenes, Francisco Manuel
  • Sanz, Ricardo
  • Gregorio, Eduard
  • Peña Barragán, José Manuel
10 Pág., The measurement of geometric canopy parameters in woody crops is an important task in Precision Agriculture because of their correlation with crop condition and productivity. In recent years, several technological approaches have been developed as an alternative to manual measurements, which are time- and labour-consuming. Two of the most commonly used 3D canopy characterization technologies are mobile terrestrial laser scanning (MTLS) based on light detection and ranging (LiDAR) sensors, and digital aerial photogrammetry (DAP) using imagery from uncrewed aerial vehicles (UAVs). Although both are state-of-the-art and have been fully tested and validated, a complete comparison between their geometric canopy parameter estimations in different woody crops and training systems has not been carried out. For this reason, a set of geometric parameters (canopy height, projected area, and volume) of a vineyard, an intensive peach orchard, and an intensive pear orchard were measured using UAV-DAP and MTLS-LiDAR. A comparison between both kinds of measurements was performed, accounting for the length of the sections in which the crop hedgerows were divided to extract the geometric parameters. Measurements from the UAV and the MTLS were highly correlated (R2 from 0.82 to 0.94) when considering the data from the three crops together, and the correlations were higher when analysing longer row sections. The canopy geometric parameters estimated using the MTLS-LiDAR always had higher values than those from the UAV-DAP. The results presented in this work provide useful data for a more informed selection of technological approaches for 3D crop characterization in Precision Fruticulture and high-throughput phenotyping., This research was funded by the projects DECIMAL (PID2020-113229RB-C41), PRODIGIA (PID2020-113229RB-C44), AGVANCE (AGL2013-48297-C2-2-R), and PAgPROTECT (PID2021-126648OB-I00), from the Spanish Ministry of Science and Innovation (MCIN/AEI/10.13039/501100011033). The authors also wish to thank Codorníu SA, celler Raimat and IRTA for having allowed the use of their vineyards, pear and peach orchards to conduct the trials described in this work., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Mobile terrestrial laser scanner vs. UAV photogrammetry to estimate woody crop canopy parameters – Part 1: Methodology and comparison in vineyards

  • Escolà Agustí, Alexandre
  • Peña Barragán, José Manuel
  • López Granados, Francisca
  • Rosell-Polo, Joan R.
  • Castro, Ana Isabel de
  • Gregorio, Eduard
  • Jiménez-Brenes, Francisco Manuel
  • Sanz, Ricardo
  • Sebé, Francesc
  • Llorens, Jordi
  • Torres-Sánchez, Jorge
© 2023 The Author(s). Published by Elsevier B.V. This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/)., Characterizing crop canopies is especially important in the management of woody crops. In this article, two systems were compared to characterise a 50 m long vineyard row section. One of the systems was a mobile terrestrial laser scanner based on a light detection and ranging (LiDAR) sensor (MTLS-LiDAR). The other was an uncrewed aerial vehicle (UAV) based system using digital aerial photogrammetry (UAV-DAP). The resulting 3D point clouds were assessed qualitatively and quantitatively. Canopy heights, widths and volumes were obtained in 0.1 m long sections along the studied row. All the parameters derived from the two systems presented statistically significant differences. The coefficients of determination between systems were 0.619 for canopy maximum heights above ground level (agl), 0.686 for 90th percentile (P90) heights agl, and 0.283 and 0.274 for maximum and P90 vegetated heights, respectively. Coefficients of determination between averaged maximum canopy width and P90 canopy width were 0.328 and 0.317, respectively. Coefficients of determination between cross-sectional areas determined from maximum widths, P90 widths and from the occupancy grid method were 0.423, 0.409 and 0.334, respectively. Total canopy volume for the entire row obtained from the three cross section estimation methods differed between 19 m3 and 25 m3. The reasons found were that the MTLS-LiDAR-derived point cloud captured the canopy top and side variability but could be affected by occlusions, mixed pixels and tall grass-like weeds present in the surveyed area. For its part, the UAV-DAP-derived point cloud tended to miss top and side shoots and somewhat smoothed canopy variability. As neither of the systems is optimal, a balance needs to be found according to the specific requirements of the survey. For this purpose, a list of pros and cons is presented to support the selection of one of the two systems for canopy monitoring. The MTLS-LiDAR system should be chosen when high detail is required but small areas are to be scanned. Alternatively, the UAV-DAP system should be chosen when large areas are to be monitored and when canopy detail is not so important. Further results are presented in Part 2 for a larger area and including pear and peach orchards with different training systems. Future research is to be conducted on how the compared systems affect variability detection and support variable-rate prescriptions., This research was funded by the projects AGVANCE (AGL2013-48297-C2-2-R), PAgPROTECT (PID2021-126648OB-I00), DECIMAL (PID2020-113229RB-C41) and PRODIGIA (PID2020-113229RB-C44) from the Spanish Ministry of Science and Innovation MICIN/AEI/10.13039/501100011033/FEDER, UE., Peer reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

Polarization lidar detection of agricultural aerosol emissions

  • Gregorio, Eduard
  • Gené Mola, Jordi
  • Sanz Cortiella, Ricardo
  • Rocadenbosch Burillo, Francisco|||0000-0001-8614-4408
  • Chueca, Patricia
  • Arnó Satorra, Jaume
  • Solanelles, Francesc
  • Rosell Polo, Joan Ramon
Agricultural aerosol emissions can significantly impact human and animal health as well as the environment. Therefore, it is essential to adopt new sensing techniques for real-time monitoring these emissions in high temporal and spatial resolution. In recent years, light detection and ranging (lidar) technology has been used for measuring the particulate matter emitted from agricultural operations. However, conventional nonpolarized lidar systems cannot discriminate between different types of aerosols, which can lead to misinterpretation of the results. To overcome this limitation, this study applies the polarization lidar technique to monitor agricultural aerosols. A 355¿nm polarization lidar system was used to measure the emissions generated during pesticide spraying operations. The results showed that depolarization ratios due to field dust (0.220–0.268) and to road dust (0.385) are clearly higher than those caused by pesticide spray drift (0.028–0.043) or by diesel exhaust (0.099), which can be used to differentiate each type of aerosol. These results support the development of new polarization lidar systems specifically designed to study the impact of agricultural activities on air quality., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

Fuji-SfM dataset: a collection of annotated images and point clouds for Fuji apple detection and location using structure-from-motion photogrammetry

  • Gené Mola, Jordi
  • Sanz Cortiella, Ricardo
  • Rosell Polo, Joan Ramon
  • Morros Rubió, Josep Ramon|||0000-0002-1395-487X
  • Ruiz Hidalgo, Javier|||0000-0001-6774-685X
  • Vilaplana Besler, Verónica|||0000-0001-6924-9961
  • Gregorio, Eduard
The present dataset contains colour images acquired in a commercial Fuji apple orchard (Malus domestica Borkh. cv. Fuji) to reconstruct the 3D model of 11 trees by using structure-from-motion (SfM) photogrammetry. The data provided in this article is related to the research article entitled “Fruit detection and 3D location using instance segmentation neural networks and structure-from-motion photogrammetry” [1]. The Fuji-SfM dataset includes: (1) a set of 288 colour images and the corresponding annotations (apples segmentation masks) for training instance segmentation neural networks such as Mask-RCNN; (2) a set of 582 images defining a motion sequence of the scene which was used to generate the 3D model of 11 Fuji apple trees containing 1455 apples by using SfM; (3) the 3D point cloud of the scanned scene with the corresponding apple positions ground truth in global coordinates. With that, this is the first dataset for fruit detection containing images acquired in a motion sequence to build the 3D model of the scanned trees with SfM and including the corresponding 2D and 3D apple location annotations. This data allows the development, training, and test of fruit detection algorithms either based on RGB images, on coloured point clouds or on the combination of both types of data., This work was partly funded by the Secretaria d'Universitats i Recerca del Departament d'Empresa i Coneixement de la Generalitat de Catalunya (grant 2017 SGR 646), the Spanish Ministry of Economy and Competitiveness (project AGL2013-48297-C2-2-R) and the Spanish Ministry of Science, Innovation and Universities (project RTI2018-094222-B-I00). Part of the work was also developed within the framework of the project TEC2016-75976-R, financed by the Spanish Ministry of Economy, Industry and Competitiveness and the European Regional Development Fund (ERDF). The Spanish Ministry of Education is thanked for Mr. J. Gené’s pre-doctoral fellowships (FPU15/03355). We would also like to thank Nufri (especially Santiago Salamero and Oriol Morreres) and Vicens Maquinària Agrícola S.A. for their support during data acquisition, and Ernesto Membrillo and Roberto Maturino for their support in dataset labelling., Peer Reviewed
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Mobile terrestrial laser scanner vs. UAV photogrammetry to estimate woody crop canopy parameters - Part 1: Methodology and comparison in vineyards

  • Escolà i Agustí, Alexandre
  • Peña, José M.
  • López-Granados, Francisca
  • Rosell Polo, Joan Ramon
  • de Castro, Ana I.
  • Gregorio López, Eduard
  • Jiménez-Brenes, Francisco M.
  • Sanz Cortiella, Ricardo
  • Sebé Feixas, Francesc
  • Llorens Calveras, Jordi
  • Torres-Sánchez, Jorge
Characterizing crop canopies is especially important in the management of woody crops. In this article, two systems were compared to characterise a 50 m long vineyard row section. One of the systems was a mobile terrestrial laser scanner based on a light detection and ranging (LiDAR) sensor (MTLS-LiDAR). The other was an uncrewed aerial vehicle (UAV) based system using digital aerial photogrammetry (UAV-DAP). The resulting 3D point clouds were assessed qualitatively and quantitatively. Canopy heights, widths and volumes were obtained in 0.1 m long sections along the studied row. All the parameters derived from the two systems presented statistically significant differences. The coefficients of determination between systems were 0.619 for canopy maximum heights above ground level (agl), 0.686 for 90th percentile (P90) heights agl, and 0.283 and 0.274 for maximum and P90 vegetated heights, respectively. Coefficients of determination between averaged maximum canopy width and P90 canopy width were 0.328 and 0.317, respectively. Coefficients of determination between cross-sectional areas determined from maximum widths, P90 widths and from the occupancy grid method were 0.423, 0.409 and 0.334, respectively. Total canopy volume for the entire row obtained from the three cross section estimation methods differed between 19 m3 and 25 m3. The reasons found were that the MTLS-LiDAR-derived point cloud captured the canopy top and side variability but could be affected by occlusions, mixed pixels and tall grass-like weeds present in the surveyed area. For its part, the UAV-DAP-derived point cloud tended to miss top and side shoots and somewhat smoothed canopy variability. As neither of the systems is optimal, a balance needs to be found according to the specific requirements of the survey. For this purpose, a list of pros and cons is presented to support the selection of one of the two systems for canopy monitoring. The MTLS-LiDAR system should be chosen when high detail is required but small areas are to be scanned. Alternatively, the UAV-DAP system should be chosen when large areas are to be monitored and when canopy detail is not so important. Further results are presented in Part 2 for a larger area and including pear and peach orchards with different training systems. Future research is to be conducted on how the compared systems affect variability detection and support variable-rate prescriptions., This research was funded by the projects AGVANCE (AGL2013-48297-C2-2-R), PAgPROTECT (PID2021-126648OB-I00), DECIMAL (PID2020-113229RB-C41) and PRODIGIA (PID2020-113229RB-C44) from the Spanish Ministry of Science and Innovation MICIN/AEI/10.13039/501100011033/FEDER, UE. The authors also want to thank Codorníu SA and Celler Raimat for allowing the use of one of their vineyards to conduct the trial described in this work.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Lidar: towards a new methodology for field measurement of spray drift

  • Gregorio López, Eduard
  • Torrent Martí, Xavier
  • Solanelles Batlle, Francesc
  • Sanz Cortiella, Ricardo
  • Rocadenbosch Burillo, Francesc
  • Masip Vilalta, Joan
  • Ribes Dasi, Manuel
  • Planas de Martí, Santiago
  • Rosell Polo, Joan Ramon
Lidar technology is becoming a promising alternative for spray drift measurement to the labour and time-expensive methodologies based on the ISO 22866 standard. This paper presents last advancements in an eye-safe lidar system specifically designed for drift monitoring. The lidar system was tested with an air-assisted sprayer in two cases: with standard hollow cone and air induction low-drift nozzles. The remaining variables (flow rate, environmental conditions,…) were similar. Lidar measurements allowed to know the time evolution of spray drift clouds and showed a much higher droplet concentration, dwelling time and dimensions for the cloud generated by standard nozzles. Also, the ability of the lidar system to distinguish different nozzle types according to their drift potential was proved. Finally, staring (laser beam stationary through the drift cloud) and 2D scanning measurements are discussed as starting points for an alternative spray drift measurement methodology., This research was partially funded by the Spanish Ministry of Economy and Competitiveness (projects AGL2007-66093-C04-03, AGL2010-22304-04-C03-03 and AGL2013-48297-C2-2- R) and EU FEDER.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

LiDAR-derived indices and their relationship with productivity and oil quality attributes in high-density olive orchards

  • Sandonis-Pozo, L.
  • Rufat, Josep
  • Pascual, M.
  • Villar, J.M.
  • Arnó, J.
  • Escolà, A.
  • Rosell-Polo, J.R.
  • Martínez-Casasnovas, J.A.
Optimising the leaf area index (LAI) and light exposure are key aspects to improve yield and quality in high-density olive orchards. Traditionally, these characteristics are estimated using ceptometers, but this method is both labour intensive and dependent on light conditions, with limitations in effectiveness for precision horticulture management purposes. This study investigates the potential of four LiDAR-derived indices to: i) estimate the LAI and canopy light interception under different fertigation treatments, and ii) to assess their impact on yield and oil quality throughout a growing season in a high-density olive orchard. The treatments included two nitrogen dose rates (N0: 0 kg ha-¹ and N50: 50 kg ha-¹) combined with full irrigation (FI) and deficit irrigation (DI). The results provide strong evidence for the effectiveness of these indices in monitoring canopy response to treatments over time. The N50 and FI treatments increased the LAI and yield but led to poorer light attenuation within the canopy and lower oil quality. In contrast, N0 and DI promoted more light-permeable canopies and improved oil quality, with higher phenolic content, better oxidative stability and improved organoleptic oil attributes. These indices can improve the understanding of canopy light environments, help to optimise management practices, and ultimately improve the sustainability and profitability of intensive olive cultivation., This work was carried out with data acquired in the project IRTA2012–00059-C02–01 funded by Spain’s National Institute for Agricultural and Food Research and Technology, as well as in the projects AGL2010–22304-C04–03 and AGL2013–48297-C2–2-R funded by the Spanish Ministry of Economy and Competitiveness. The study was carried out under the framework of the grants RTI2018–094222-B-I00 (PAgFRUIT project) and PID2021–126648OB-I00 (PAgPROTECT project) through MCIN/AEI/10.13039/501100011033 and the European Union’s “ERDF, a way of making Europe”., info:eu-repo/semantics/publishedVersion
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Determination of spray drift and buffer zones in 3D crops using the ISO standard and new LiDAR methodologies

  • Torrent Martí, Xavier
  • Gregorio López, Eduard
  • Rosell Polo, Joan Ramon
  • Arnó Satorra, Jaume
  • Peris Giner, Miquel
  • van de Zande, Jan C.
  • Planas de Martí, Santiago
Spray drift generated in the application of plant protection products in tree crops (3D crops) is a major source of environmental contamination, with repercussions for human health and the environment. Spray drift contamination acquires greater relevance in the EU Southern Zone due to the crops structure and the weather conditions. Hence, there is a need to evaluate spray drift when treating the most representative 3D crops in this area. For this purpose, 4 spray drift tests, measuring airborne and sedimenting spray drift in accordance with ISO 22866:2005, were carried out for 4 different crops (peach, citrus, apple and grape) in orchards of the EU Southern Zone, using an air-blast sprayer equipped with standard (STN) and spray drift reduction (DRN) nozzle types. A further 3 tests were carried out to test a new methodology for the evaluation of spray drift in real field conditions using a LiDAR system, in which the spray drift generated by different sprayer and nozzle types was contrasted. The airborne spray drift potential reduction (DPRV) values, obtained following the ISO 22866:2005, were higher than those for sedimenting spray drift potential reduction (DPRH) (63.82%-94.42% vs. 39.75%-69.28%, respectively). For each crop and nozzle type combination, a sedimenting spray drift model was also developed and used to determine buffer zone width. The highest buffer width reduction (STN vs DRN) was obtained in peach (˃75%), while in grape, citrus and apple only 50% was reached. These results can be used as the starting point to determine buffer zone width in the countries of the EU Southern Zone depending on different environmental threshold values. Tests carried out using LiDAR system demonstrated high capacity and efficiency of this system and this newly defined methodology, allowing sprayer and nozzle types in real field conditions to be differentiated and classified., This work was partly funded by the Secretaria d'Universitats i Recerca del Departament d'Empresa i Coneixement de la Generalitat de Catalunya, the Spanish Ministry of Economy and Competitiveness and the European Regional Development Fund (ERDF) under grants 2017 SGR 646, AGL2007-66093-C04-03, AGL2010-22304-04-C03-03, and AGL2013-48297-C2-2-R. The authors also wish to thank Mr. Antonio Checa (Randex Iberica, S.L.) for giving us free Albuz nozzles for the spray tests. Universitat de Lleida is also thanked for Mr. X. Torrent's pre-doctoral fellowship.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Fruit detection and 3D location using instance segmentation neural networks and SfM photogrammetry

  • Gregorio López, Eduard
  • Sanz Cortiella, Ricardo
  • Rosell Polo, Joan Ramon
  • Morros Rubió, Josep Ramon
  • Ruiz Hidalgo, Javier
  • Vilaplana Besler, Verónica
  • Gregorio López, Eduard
The development of remote fruit detection systems able to identify and 3D locate fruits provides opportunities to improve the effi-ciency of agriculture management. Most of the current fruit detec-tion systems are based on 2D image analysis. Although the use of 3D sensors is emerging, precise 3D fruit location is still a pending issue. This work presents a new methodology for fruit detection and 3D location, combining the use of instance segmentation neu-ral networks and Structure-from-Motion (SfM) photogrammetry., This work was partly funded by the Secretaria d’Universitats i Recerca de la Gener-alitat de Catalunya (grant 2017 SGR 646), the Spanish Ministry of Economy and Competitiveness (projects AGL2013-48297-C2-2-R and TEC2016-75976-R) and the Spanish Ministry of Science, Innovation and Universities (project RTI2018-094222-B-I00). The Spanish Ministry of Education is thanked for Mr. J. Gené’s pre-doctoral fellowships (FPU15/03355).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Georeferenced Scanning System to Estimate the Leaf Wall Area in Tree Crops

  • Moral Martínez, Ignacio del
  • Rosell Polo, Joan Ramon
  • Arnó Satorra, Jaume
  • Escolà i Agustí, Alexandre
  • Sanz Cortiella, Ricardo
  • Masip Vilalta, Joan
  • Company Mesa, Joaquim
This paper presents the use of a terrestrial light detection and ranging (LiDAR) system to scan the vegetation of tree crops to estimate the so-called pixelated leaf wall area (PLWA). Scanning rows laterally and considering only the half-canopy vegetation to the line of the trunks, PLWA refers to the vertical projected area without gaps detected by LiDAR. As defined, PLWA may be different depending on the side from which the LiDAR is applied. The system is completed by a real-time kinematic global positioning system (RTK-GPS) sensor and an inertial measurement unit (IMU) sensor for positioning. At the end, a total leaf wall area (LWA) is computed and assigned to the X, Y position of each vertical scan. The final value of the area depends on the distance between two consecutive scans (or horizontal resolution), as well as the number of intercepted points within each scan, since PLWA is only computed when the laser beam detects vegetation. To verify system performance, tests were conducted related to the georeferencing task and synchronization problems between GPS time and central processing unit (CPU) time. Despite this, the overall accuracy of the system is generally acceptable. The Leaf Area Index (LAI) can then be estimated using PLWA as an explanatory variable in appropriate linear regression models., This work was funded by the Spanish Ministry of Economy and Competitiveness and by the European Union through its FEDER funds; it is a part of the Optidosa (AGL2007-66093-C04-03), Safespray (AGL2010-22304-C04-03) and Agvance (AGL2013-48297-C2-2-R) research projects.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Fruit detection in an apple orchard using a mobile terrestrial laser scanner

  • Gené Mola, Jordi
  • Gregorio López, Eduard
  • Guevara, Javier
  • Auat Cheein, Fernando
  • Sanz Cortiella, Ricardo
  • Escolà i Agustí, Alexandre
  • Llorens Calveras, Jordi
  • Morros Rubió, Josep Ramon
  • Ruiz Hidalgo, Javier
  • Vilaplana Besler, Verónica
  • Rosell Polo, Joan Ramon
The development of reliable fruit detection and localization systems provides an opportunity to improve the crop value and management by limiting fruit spoilage and optimised harvesting practices. Most proposed systems for fruit detection are based on RGB cameras and thus are affected by intrinsic constraints, such as variable lighting conditions. This work presents a new technique that uses a mobile terrestrial laser scanner (MTLS) to detect and localise Fuji apples. An experimental test focused on Fuji apple trees (Malus domestica Borkh. cv. Fuji) was carried out. A 3D point cloud of the scene was generated using an MTLS composed of a Velodyne VLP-16 LiDAR sensor synchronised with an RTK-GNSS satellite navigation receiver. A reflectance analysis of tree elements was performed, obtaining mean apparent reflectance values of 28.9%, 29.1%, and 44.3% for leaves, branches and trunks, and apples, respectively. These results suggest that the apparent reflectance parameter (at 905 nm wavelength) can be useful to detect apples. For that purpose, a fourstep fruit detection algorithm was developed. By applying this algorithm, a localization success of 87.5%, an identification success of 82.4%, and an F1-score of 0.858 were obtained in relation to the total amount of fruits. These detection rates are similar to those obtained by RGB-based systems, but with the additional advantages of providing direct 3D fruit location information, which is not affected by sunlight variations. From the experimental results, it can be concluded that LiDAR-based technology and, particularly, its reflectance information, has potential for remote apple detection and 3D location., This work was partly funded by the Secretaria d’Universitats i Recerca del Departament d’Empresa i Coneixement de la Generalitat de Catalunya (grant 2017 SGR 646), the Spanish Ministry of Economy and Competitiveness (projects AGL2013-48297-C2-2-Rand MALEGRA, TEC2016-75976-R) and the Spanish Ministry of Science, Innovation and Universities (project RTI2018-094222-B-I00). The Spanish Ministry of Education is thanked for Mr. J. Gené’s pre-doctoral fellowships (FPU15/03355). The work of Jordi Llorens was supported by Spanish Ministry of Economy, Industry and Competitiveness through a postdoctoral position named Juan de la Cierva Incorporación (JDCI-2016-29464_N18003). We would also like to thank CONICYT/FONDECYT for grant 1171431 and CONICYT FB0008. Nufri (especially Santiago Salamero and Oriol Morreres) and Vicens Maquinària Agrícola S.A. are also thanked for their support during the data acquisition.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Assessing the Performance of RGB-D Sensors for 3D Fruit Crop Canopy Characterization under Different Operating and Lighting Conditions

  • Gené Mola, Jordi
  • Llorens Calveras, Jordi
  • Rosell Polo, Joan Ramon
  • Gregorio López, Eduard
  • Arnó Satorra, Jaume
  • Solanelles Batlle, Francesc
  • Martínez Casasnovas, José Antonio
  • Escolà i Agustí, Alexandre
The use of 3D sensors combined with appropriate data processing and analysis has provided tools to optimise agricultural management through the application of precision agriculture. The recent development of low-cost RGB-Depth cameras has presented an opportunity to introduce 3D sensors into the agricultural community. However, due to the sensitivity of these sensors to highly illuminated environments, it is necessary to know under which conditions RGB-D sensors are capable of operating. This work presents a methodology to evaluate the performance of RGB-D sensors under different lighting and distance conditions, considering both geometrical and spectral (colour and NIR) features. The methodology was applied to evaluate the performance of the Microsoft Kinect v2 sensor in an apple orchard. The results show that sensor resolution and precision decreased significantly under middle to high ambient illuminance (>2000 lx). However, this effect was minimised when measurements were conducted closer to the target. In contrast, illuminance levels below 50 lx affected the quality of colour data and may require the use of artificial lighting. The methodology was useful for characterizing sensor performance throughout the full range of ambient conditions in commercial orchards. Although Kinect v2 was originally developed for indoor conditions, it performed well under a range of outdoor conditions., This research was funded by the Spanish Ministry of Economy and Competitiveness and the Ministry of Science, Innovation and Universities through the program Plan Estatal I+D+i Orientada a los Retos de la Sociedad, grant numbers AGL2013-48297-C2-2-R and RTI2018-094222-B-I00, respectively.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Yield prediction using mobile terrestrial laser scanning

  • Gené Mola, Jordi
  • Gregorio López, Eduard
  • Sanz Cortiella, Ricardo
  • Escolà i Agustí, Alexandre
  • Rosell Polo, Joan Ramon
Yield prediction provides valuable information to plan the harvest campaign, fruit storage and sales. Traditionally, yield estimation has been carried out by manual counting of randomly selected samples, without addressing spatial variability within the orchard. To obtain a precise estimation it is necessary to sample a relatively large number of trees, which is unfeasible with manual counting. To solve this issue, this work proposes the use of a Mobile Terrestrial Laser Scanner (MTLS) for fruit detection and yield prediction. Experimental test were carried out in a commercial Fuji apple orchard. The row of threes was scanned from the two sides (east and west). The measurement equipment consisted of an MTLS comprised of a LiDAR sensor, and a real-time kinematics global navigation satellite system (RTK-GNSS) connected to a rugged laptop. The LiDAR sensor used was a Puck VLP-16 (Velodyne LIDAR Inc., San José, CA, USA), which provides a 3D point cloud with calibrated reflectance values of the measured scene. The fruit detection algorithm implemented in this work is divided into four steps: (1) Reflectance thresholding, which delete those points presenting a reflectance lower than 60%; (2) Connected Points Clustering using DBSCAN; (3) Fruit separation, which uses a support vector machine (SVM) to predict the number of fruits that contains each cluster; (4) False positive removal, also based on a trained SVM. From detections obtained with this algorithm, the yield was predicted using a linear model (obtained with training data) that relates the number of detections and the actual number of fruits Three different trials were evaluated: east (E) side scanning, west (W) side scanning and merging data from both scanned sides (E+W). As it was expected, fruit detection results showed lower detection rates when only scanning from one tree side, presenting detection rates of 38.3% and 48.5% for east and west sides, respectively. However, the detection rate increased up to 75.8% when using E+W data. Similarly, yield prediction results showed higher errors when using data from only one tree side, obtaining a RMSE of 15.2% and 15.3% (east and west, respectively). The prediction improved significantly when using data from both tree sides (E+W), presenting a RMSE of 5.4%. From these results it is concluded that MTLS has potential in yield prediction in fruit orchards. Although fruit detection rates are moderately successful, the system was able to predict the actual number of fruits with low estimation errors. Only using data from one tree side increases the prediction error, but it has de advantage of reducing a 50% the scanning time, which may be interesting depending on the application and the interest of the farmer. Future works will extend this study to other fruit varieties., This work was partly funded by the Secretaria d’Universitats i Recerca del Departament d’Empresa i Coneixement de la Generalitat de Catalunya and the Spanish Ministry of Economy and Competitiveness under Grants 2017 SGR 646 and AGL2013-48297-C2-2-R. The Spanish Ministry of Education is thanked for Mr. J. Gené’s pre-doctoral fellowships (FPU15/03355). The work of Jordi Llorens was supported by Spanish Ministry of Economy, Industry and Competitiveness through a postdoctoral position names Juan de la Cierva Incorporació (JDCI-2016-29464_N18003).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

R software code to process and extract information from 3D Lidar point clouds

  • Llorens Calveras, Jordi
  • Cabrera Pérez, Carlos
  • Escolà i Agustí, Alexandre
  • Arnó Satorra, Jaume
Poster Proceedings of the 12th European Conference on Precision Agriculture, July 8-11, Montpellier, France. pp. 114-115. e-book publication. SupAgro Montpellier. ISBN 978-2-900792-49-0, In the process of electronic canopy characterization, it is necessary to process efficiently point clouds obtained by means of sensors or other capturing information systems. These point clouds may have different origin but they define the main structural characteristics of the scanned crop. For this reason, a fast, easy-to-configure and precise methodology is necessary to extract such information. The work presented in this poster defines the main features of a procedure carried out with R Software code., This work was partly funded by the Secretaria d’Universitats i Recerca del Departament d’Empresa i Coneixement de la Generalitat de Catalunya and the Spanish Ministry of Economy and Competitiveness under Grants 2017 SGR 646, AGL2013-48297-C2-2-R and RTI2018-094222-B-I00(PAgFRUIT). The work of Jordi Llorens was supported by Spanish Ministry of Economy, Industry and Competitiveness through a postdoctoral position named Juan de la Cierva Incorporació (JDCI-2016-29464_N18003).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Polarization lidar detection of agricultural aerosol emissions

  • Gregorio López, Eduard
  • Gené Mola, Jordi
  • Sanz Cortiella, Ricardo
  • Rocadenbosch Burillo, Francesc
  • Chueca Adell, Patricia
  • Arnó Satorra, Jaume
  • Solanelles Batlle, Francesc
  • Rosell Polo, Joan Ramon
Agricultural aerosol emissions can significantly impact human and animal health as well as the environment. Therefore, it is essential to adopt new sensing techniques for real-time monitoring these emissions in high temporal and spatial resolution. In recent years, light detection and ranging (lidar) technology has been used for measuring the particulate matter emitted from agricultural operations. However, conventional nonpolarized lidar systems cannot discriminate between different types of aerosols, which can lead to misinterpretation of the results. To overcome this limitation, this study applies the polarization lidar technique to monitor agricultural aerosols. A 355 nm polarization lidar system was used to measure the emissions generated during pesticide spraying operations. The results showed that depolarization ratios due to field dust (0.220-0.268) and to road dust (0.385) are clearly higher than those caused by pesticide spray drift (0.028-0.043) or by diesel exhaust (0.099), which can be used to differentiate each type of aerosol. These results support the development of new polarization lidar systems specifically designed to study the impact of agricultural activities on air quality., This research was partially funded by the Spanish Ministry of Economy and Competitiveness (projects AGL2007-66093-C04-03, AGL2010-22304-04-C03-03, and AGL2013-48297-C2-2-R) and EU FEDER. Secretaria d’Universitats i Recerca del Departament d’Economia i Coneixement de la Generalitat de Catalunya and the Spanish Ministry of Education are thanked for Mr. Jordi Gené’s predoctoral fellowships (2016FI_B 00669 and FPU15/03355). The authors would like to thank the Institut de Recerca i Tecnologia Agroalimentàries for allowing the use of their experimental fields. The authors also wish to thank F. Camp, A. Escolà, C. Garcerá, F. Gràcia, J. Masip, E. Moltó, I. del Moral, and R. Viana for their assistance in the field work. X. Torrent and S. Planas are also thanked for the nozzle characterization with the PDA. F. Marenco (Met Office, UK) and P. Chazette (LSCE-IPLS, France) are acknowledged for their fruitful comments about lidar calibration.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Fruit detection and sizing using photonic sensors and artificial intelligence

  • Gené Mola, Jordi
  • Gregorio López, Eduard
  • Sanz Cortiella, Ricardo
  • Escolà i Agustí, Alexandre
  • Rosell Polo, Joan Ramon
The Secretaria d’Universitats i Recerca del Departament d’Economia i Coneixement de la Generalitat de Catalunya, the Spanish Ministry of Education and the Spanish Ministry of Science, Innovation and Universities are thanked the pre-doctoral fellowships 2016FI_B00669, FPU15/03355 and EST18/00487, respectively. The Spanish Ministry of Universities is thanked for the posdoctoral Margarita Salas grant given to Jordi Gené, funded by the European Union-Next Generation EU. The research work was partly funded by the Secretaria d’Universitats i Recerca del Departament d’Empresa i Coneixement de la Generalitat de Catalunya (grant 2017SGR646), the Spanish Ministry of Economy and Competitiveness (project AGL2013-48297-C2-2-R) and the Spanish Ministry of Science, Innovation and Universities (project RTI2018-094222-B-I00).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Stratified sampling in fruit orchards using cluster-based ancillary information maps: a comparative analysis to improve yield and quality estimates

  • Uribeetxebarria Alonso de Armiño, Asier
  • Martínez Casasnovas, José Antonio
  • Escolà i Agustí, Alexandre
  • Rosell Polo, Joan Ramon
  • Arnó Satorra, Jaume
Estimation of yield or other fruit quality parameter is of great interest to farmers to decide on management actions just before harvesting and, in any case, to anticipate and plan harvesting operations. Making accurate and reliable estimates often requires systematic sampling that, when covering the whole plot, can result in the use of a large number of samples and a significant effort in time and cost for fruit growers. Faced with this whole area sampling strategy, simple random sampling (SRS) using reduced sample sizes is currently a widely used technique despite the less precise estimates that it provides. In this work, different stratified sampling schemes have been tested to estimate yield (kg/tree), fruit firmness (kg/cm2) and the refractometric index (ºBaumé) in a peach orchard located in Gimenells (Lleida, Catalonia, Spain). In contrast to SRS, the use of ancillary information (NDVI and apparent electrical conductivity, ECa) allowed sampling units or trees to be stratified according to two or three classes (strata) within the plot. The classes or homogeneous stratification zones were delimited by cluster analysis using, either separately or in combination, a multispectral airborne image (NDVI) and a ECa survey map acquired by means of a soil resistivity sensor (Veris 3100). Sampling schemes were then compared in terms of efficiency. In general, stratified sampling showed better results than SRS. Regarding yield estimates, stratified sampling according to two strata of NDVI allowed the sample size to be reduced by 17% compared to the SRS for the same precision. On the other hand, quality parameters may require different stratification strategies concerning the number of strata to be used. While ºBaumé was better-estimated using also stratified samples based on two strata of NDVI, fruit firmness showed better results when stratifying by three classes or strata of NDVI. In any case, neither the ECa nor the combined use of NDVI + ECa have improved sampling efficiency when used as ancillary maps for stratification., This work was funded by the Spanish Ministry of Economy and Competitiveness through the project AgVANCE (AGL2013-48297-C2-2-R). The authors also thank the IRTA Experimental Station in Gimenells (Lleida, Spain) for the possibility of carrying out this sampling study on a peach orchard.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

LiDAR-derived indices and their relationship with productivity and oil quality attributes in high-density olive orchards

  • Sandonís Pozo, Leire
  • Rufat i Lamarca, Josep
  • Pascual Roca, Miquel
  • Villar Mir, Josep Ma.
  • Arnó Satorra, Jaume
  • Escolà i Agustí, Alexandre
  • Rosell Polo, Joan Ramon
  • Martínez Casasnovas, José Antonio
Optimising the leaf area index (LAI) and light exposure are key aspects to improve yield and quality in highdensity olive orchards. Traditionally, these characteristics are estimated using ceptometers, but this method is both labour intensive and dependent on light conditions, with limitations in effectiveness for precision horticulture management purposes. This study investigates the potential of four LiDAR-derived indices to: i) estimate the LAI and canopy light interception under different fertigation treatments, and ii) to assess their impact on yield and oil quality throughout a growing season in a high-density olive orchard. The treatments included two nitrogen dose rates (N0: 0 kg ha-¹ and N50: 50 kg ha-¹) combined with full irrigation (FI) and deficit irrigation (DI). The results provide strong evidence for the effectiveness of these indices in monitoring canopy response to treatments over time. The N50 and FI treatments increased the LAI and yield but led to poorer light attenuation within the canopy and lower oil quality. In contrast, N0 and DI promoted more light-permeable canopies and improved oil quality, with higher phenolic content, better oxidative stability and improved organoleptic oil attributes. These indices can improve the understanding of canopy light environments, help to optimise management practices, and ultimately improve the sustainability and profitability of intensive olive cultivation., This work was carried out with data acquired in the project IRTA2012–00059-C02–01 funded by Spain’s National Institute for Agricultural and Food Research and Technology, as well as in the projects AGL2010–22304-C04–03 and AGL2013–48297-C2–2-R funded by the Spanish Ministry of Economy and Competitiveness. The study was carried out under the framework of the grants RTI2018–094222-B-I00 (PAgFRUIT project) and PID2021–126648OB-I00 (PAgPROTECT project) through MCIN/AEI/10.13039/501100011033 and the European Union’s “ERDF, a way of making Europe”.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

LFuji-air dataset: annotated 3D LiDAR point clouds of Fuji apple trees for fruit detection scanned under different forced air flow conditions

  • Gené Mola, Jordi
  • Gregorio López, Eduard
  • Auat Cheein, Fernando
  • Guevara, Javier
  • Llorens Calveras, Jordi
  • Sanz Cortiella, Ricardo
  • Escolà i Agustí, Alexandre
  • Rosell Polo, Joan Ramon
This article presents the LFuji-air dataset, which contains LiDAR based point clouds of 11 Fuji apples trees and the corresponding apples location ground truth. A mobile terrestrial laser scanner (MTLS) comprised of a LiDAR sensor and a real-time kinematics global navigation satellite system was used to acquire the data. The MTLS was mounted on an air-assisted sprayer used to generate different air flow conditions. A total of 8 scans per tree were performed, including scans from different LiDAR sensor positions (multi-view approach) and under different air flow conditions. These variability of the scanning conditions allows to use the LFuji-air dataset not only for training and testing new fruit detection algorithms, but also to study the usefulness of the multi-view approach and the application of forced air flow to reduce the number of fruit occlusions. The data provided in this article is related to the research article entitled 'Fruit detection, yield prediction and canopy geometric characterization using LiDAR with forced air flow' [1]., This work was partly funded by the Secretaria d’Universitats i Recerca del Departament d'Empresa i Coneixement de la Generalitat de Catalunya (grant 2017 SGR 646), the Spanish Ministry of Economy and Competitiveness (project AGL2013-48297-C2-2-R) and the Spanish Ministry of Science, Innovation and Universities (project RTI2018-094222-B-I00). The Spanish Ministry of Education is thanked for Mr. J. Gené's pre-doctoral fellowships (FPU15/03355). The work of Jordi Llorens was supported by the Spanish Ministry of Economy, Industry and Competitiveness through a postdoctoral position named Juan de la Cierva Incorporación (JDCI-2016-29464_N18003). We would also like to thank CONICYT FONDECYT 1171431 and CONICYT FB0008.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Assessing ranked set sampling and ancillary data to improve fruit load estimates in peach orchards

  • Uribeetxebarria Alonso de Armiño, Asier
  • Martínez Casasnovas, José Antonio
  • Tisseyre, Bruno
  • Guillaume, Serge
  • Escolà i Agustí, Alexandre
  • Rosell Polo, Joan Ramon
  • Arnó Satorra, Jaume
Fruit load estimation at plot level before harvest is a key issue in fruit growing. To face this challenge, two sampling methods to estimate fruit load in a peach tree orchard were compared: simple random sampling (SRS) and ranked set sampling (RSS). The study was carried out in a peach orchard (Prunus persica cv. 'Platycarpa') covering a total area of 2.24 ha. Having previously sampled the plot systematically to cover the entire area (104 individual trees or sampling points), both sampling methods (SRS and RSS) were tested by taking samples from this population with varying sample sizes from N = 4 to N = 12. Since RSS requires ancillary information to obtain the samples (ranking mechanism), several proximal and remote sensors already used or recently introduced in agriculture were assessed as data sources. A total of 14 variables provided by 5 different sensors and platforms were considered as potential ancillary variables. Among them, RGB images captured by an unmanned aerial vehicle (UAV), and used to estimate the canopy projected area of individual trees, proved to be the best of the options. This was shown by the high correlation (R = 0.85) between this area and the fruit load, providing RSS with the UAV-based canopy projected area the lowest Coefficient of Error (CE) for a given tree sample size. Then, comparing relative efficiency between random sampling (SRS) and RSS, the latter enables more precise fruit load estimates for any of the considered sample sizes. Interest and opportunity of RSS can be raised from two points of view. In terms of confidence, RSS managed to reduce the variance of fruit load estimates by about half compared to SRS. Sampling errors above the 10% threshold were always produced significantly fewer times using RSS, regardless of the sample size. In terms of operation within the plot, sample size could be reduced by 50%, from N = 10 for SRS to N = 5 for RSS, and this being expected sampling errors less than 10% in practically 70% of the samplings performed in both cases. In summary, fruit growers can take advantage of the combined use of appropriate data (RGB images from UAV) and RSS to optimize sample sizes and operational sampling costs in fruit growing., The Spanish Ministry of Economy and Competitiveness through the AgVANCE Project (AGL2013-48297-C2-2-R) funded this work.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

A new Leafiness-LiDAR index to estimate light interception in intensive olive orchards

  • Sandonís Pozo, Leire
  • Martínez Casasnovas, José Antonio
  • Escolà i Agustí, Alexandre
  • Rosell Polo, Joan Ramon
  • Rufat i Lamarca, Josep
  • Pascual Roca, Miquel
The 14th European Conference on Precision Agriculture, July 2-6, 2023, Bologna, Italy, Canopy light interception constitutes an important yield limiting factor in high density olive orchards. However, its characterisation still implies laborious measurements. A new index, the Leafiness-LiDAR index (LLI), is presented as a LAI estimator. LLI combines LiDAR-derived parameters: Cross-Section and Leafiness from 3D point clouds. To validate the results, photosynthetically active radiation (PAR) measurements, canopy volume, yield and quality parameters were collected and analysed. LLI showed significant correlations both with PAR and canopy volume (r = 0.8) and quality parameters (r = -0.6). LLI may be useful as an early decision canopy monitoring tool in the framework of Precision Fructiculture., This work was carried out with data acquired in the project IRTA2012-00059-C02-01 funded by the Instituto Nacional de Investigación y Tecnología Agraria y Alimentaria, as well as in the projects AGL2010-22304-C04-03 and AGL2013-48297-C2-2-R funded by the Spanish Ministry of Economy and Competitiveness and developed under the frame of the grants RTI2018-094222-B-I00 (PAgFRUIT project) and PID2021-126648OB-I00 (PAgPROTECT project) by MCIN/AEI/10.13039/501100011033 and by “ERDF, a way of making Europe”, by the European Union.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Eye-safe lidar system for pesticide spray drift measurement

  • Gregorio López, Eduard
  • Rocadenbosch Burillo, Francesc
  • Sanz Cortiella, Ricardo
  • Rosell Polo, Joan Ramon
Spray drift is one of the main sources of pesticide contamination. For this reason, an accurate understanding of this phenomenon is necessary in order to limit its effects. Nowadays, spray drift is usually studied by using in situ collectors which only allow time-integrated sampling of specific points of the pesticide clouds. Previous research has demonstrated that the light detection and ranging (lidar) technique can be an alternative for spray drift monitoring. This technique enables remote measurement of pesticide clouds with high temporal and distance resolution. Despite these advantages, the fact that no lidar instrument suitable for such an application is presently available has appreciably limited its practical use. This work presents the first eye-safe lidar system specifically designed for the monitoring of pesticide clouds. Parameter design of this system is carried out via signal-to-noise ratio simulations. The instrument is based on a 3-mJ pulse-energy erbium-doped glass laser, an 80-mm diameter telescope, an APD optoelectronic receiver and optomechanically adjustable components. In first test measurements, the lidar system has been able to measure a topographic target located over 2 km away. The instrument has also been used in spray drift studies, demonstrating its capability to monitor the temporal and distance evolution of several pesticide clouds emitted by air-assisted sprayers at distances between 50 and 100 m., This research was partially funded by the Spanish Ministry of Economy and Competitiveness (projects AGL2007-66093-C04-03, AGL2010-22304-C04-03 and AGL2013-48297-C2-2-R) and EU FEDER. This work was conducted in the framework of the collaboration agreement between the Universitat Politècnica de Catalunya (UPC) and the Universitat de Lleida (UdL) ref. A-00793 for Range-Resolved Remote Sensing of the Concentration of Pesticides in Agroforestry Environments. Alexandre Escolà and Joan Masip from the UdL, and Adolfo Comerón, Alejandro Rodríguez and Jordi Tiana from the UPC, are thanked for their cooperation in preparing this work. Innovació i Recerca Industrial i Sostenible S.L. (IRIS) is thanked for his cooperation in the development of the receiving subsystem.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Bases for pesticide dose expression and adjustment in 3D crops and comparison of decision support systems

  • Planas de Martí, Santiago
  • Román, Carla
  • Sanz Cortiella, Ricardo
  • Rosell Polo, Joan Ramon
Authorities around the world have committed to limiting the use of chemical pesticides by reducing doses, among other strategies. Nevertheless, different dose expression models and decision support systems (DSSs) for dose adjustment coexist for high growing crops (3D crops). Among them, leaf wall area (LWA) and tree row volume (TRV) models have recently been proposed by the European and Mediterranean Plant Protection Organization (EPPO) for pre-registration trials. In this paper, the background and technical bases of six dose adjustment DSSs in fruit crops (PACE, AGMET, DOSA3D, OMAX and PULVARBO) and four in grape orchards (AGMET, OPTIDOSE, DOSAVIÑA and DOSA3D) are described and compared. The discussion leads to the conclusion that LWA and TRV represents a substantial improvement compared to the former crop ground area-based dose expression model. However, total leaf area is the most important parameter for dose adjustment, while sprayer efficiency is also a key factor. Additionally, it is suggested that deposition on leaves (mean values and variability) should be reported in pesticide efficacy evaluations in order to establish the required doses independently from the dose expression mode. The DOSA3D system, based on leaf area index estimation, was found to be the most conservative DSS regarding the spraying volume ratio to TRV because low spraying efficiencies are considered. Instead, AGMET was found to be the most effective for dose adjustment. However, despite the differences between the recommendations, all the analysed DSSs are useful tools for rational decision making about spraying volume rate and pesticide doses at national level. Their use should be promoted by the competent authorities., This study wasfinanced by the EU Horizon 2020 project EUCLID[grant number 633999], the Spanish Ministry of Economy and Compet-itiveness project AgVance [AGL2013-48297-C2-2-R] and the SpanishMinistry of Agriculture, Fisheries and Food project GOPHYTOVID [con-tract 2018002001192]. We are also grateful for funding by theSecretaria d'Universitats i Recerca del Departament d'Empresa iConeixement de la Generalitat de Catalunya under Grant 2017 SGR 646
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Fuji-SfM dataset: a collection of annotated images and point clouds for Fuji apple detection and location using structure-from-motion photogrammetry

  • Gené Mola, Jordi
  • Sanz Cortiella, Ricardo
  • Rosell Polo, Joan Ramon
  • Morros Rubió, Josep Ramon
  • Ruiz Hidalgo, Javier
  • Vilaplana Besler, Verónica
  • Gregorio, Eduard
The present dataset contains colour images acquired in a commercial Fuji apple orchard (Malus domestica Borkh. cv. Fuji) to reconstruct the 3D model of 11 trees by using structure-from-motion (SfM) photogrammetry. The data provided in this article is related to the research article entitled “Fruit detection and 3D location using instance segmentation neural networks and structure-from-motion photogrammetry” [1]. The Fuji-SfM dataset includes: (1) a set of 288 colour images and the corresponding annotations (apples segmentation masks) for training instance segmentation neural networks such as Mask-RCNN; (2) a set of 582 images defining a motion sequence of the scene which was used to generate the 3D model of 11 Fuji apple trees containing 1455 apples by using SfM; (3) the 3D point cloud of the scanned scene with the corresponding apple positions ground truth in global coordinates. With that, this is the first dataset for fruit detection containing images acquired in a motion sequence to build the 3D model of the scanned trees with SfM and including the corresponding 2D and 3D apple location annotations. This data allows the development, training, and test of fruit detection algorithms either based on RGB images, on coloured point clouds or on the combination of both types of data., This work was partly funded by the Secretaria d'Universitats i Recerca del Departament d'Empresa i Coneixement de la Generalitat de Catalunya (grant 2017 SGR 646), the Spanish Ministry of Economy and Competitiveness (project AGL2013-48297-C2-2-R) and the Spanish Ministry of Science, Innovation and Universities (project RTI2018-094222-B-I00). Part of the work was also developed within the framework of the project TEC2016-75976-R, financed by the Spanish Ministry of Economy, Industry and Competitiveness and the European Regional Development Fund (ERDF). The Spanish Ministry of Education is thanked for Mr. J. Gené’s pre-doctoral fellowships (FPU15/03355). We would also like to thank Nufri (especially Santiago Salamero and Oriol Morreres) and Vicens Maquinària Agrícola S.A. for their support during data acquisition, and Ernesto Membrillo and Roberto Maturino for their support in dataset labelling., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

LIDAR and non-LIDAR-based canopy parameters to estimate the leaf area in fruit trees and vineyard

  • Sanz Cortiella, Ricardo
  • Llorens Calveras, Jordi
  • Escolà i Agustí, Alexandre
  • Arnó Satorra, Jaume
  • Planas de Martí, Santiago
  • Román, Carla
  • Rosell Polo, Joan Ramon
This paper is based on two initial hypotheses, firstly, it is proposed that the vegetation volume obtained with a LIDAR-based system or tree row LIDAR volume (TRLV) has a high correlation with the leaf area (LA). Secondly, it is proposed that the projected outer surface or projected tree row surface (PTRS), also LIDAR-based, is linearly related with the LA. The verification of these two hypotheses corresponds to the first two objectives of this work. The third objective is to propose an alternative method, without using LIDAR sensors, simpler and more economical, for in situ LA evaluation. To achieve these objectives a total of 17 blocks of pear, 14 of apple and 26 of vine, in different phenological states, were LIDAR scanned and subsequently manually defoliated. After the field and calculation work, the TRLV and LA were compared. The logarithmic regressions obtained had high correlations. For apple and pear trees the equations are practically the same with R2 of 0.85 and 0.84, respectively. The equation corresponding to vines is somewhat different and has an R2 of 0.86. The regression without species differentiation is 3.66ln(x) +9.65 with R2=0.90. Based on the TRLV, the front and top projected surface areas of each block were then obtained and, using these variables, the PTRS. The linear regressions obtained between PTRS and LA have high correlations with R2 of 0.88, 0.85 and 0.80 for apple trees, pear trees, and vineyard respectively. The three crops show very similar behavior. The straight lines are very close, with very similar slopes. With no species differentiation the linear regression model is y=1.47x - 1.18 with R2=0.93. The starting point of the third objective is to obtain the projected surfaces, frontal and top, without using a LIDAR sensor. These surfaces are not as precise as those obtained with LIDAR and for this reason they are referred to as 'estimated' projected surfaces. To calculate the estimated PTRS without a LIDAR sensor, the height and depth of the vegetation are measured with a tape measure. It is also necessary to make a visual estimation of the frontal gap-fraction. For this, a training method with known gap-fraction pictograms is proposed. The final results with this non-LIDAR method are very similar to those obtained with LIDAR. This method, although it needs human intervention, is simple, easy, economical and precise for in situ LA estimation., This research was partially funded by the Spanish Ministry of Economy and Competitiveness (projects AGL2002-04260-C04-02, AGL2007-66093-C04-03, AGL2010-22304-C04-03 and AGL2013- 48297-C2-2-R) and EU FEDER. Funding of Secretaria d’Universitats i Recerca del Departament d’Empresa i Coneixement de la Generalitat de Catalunya under Grant 2017 SGR 646 is also thanked.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

3D characterization of a Boston Ivy double-skin green building facade using a LiDAR system

  • Pérez Luque, Gabriel
  • Escolà i Agustí, Alexandre
  • Rosell Polo, Joan Ramon
  • Coma Arpón, Julià
  • Arasanz Riba, Roger
  • Marrero Farré, Bernat
  • Cabeza, Luisa F.
  • Gregorio López, Eduard
On the way to more sustainable and resilient urban environments, the incorporation of urban green infrastructure (UGI) systems, such as green roofs and vertical greening systems, must be encouraged. Unfortunately, given their variable nature, these nature-based systems are difficult to geometrically characterize, and therefore there is a lack of 3D objects that adequately reflect their geometry and analytical properties to be used in design processes based on Building Information Modelling (BIM) technologies. This fact can be a disadvantage, during the building's design phase, of UGIs over traditional grey solutions. Areas of knowledge such as precision agriculture, have developed technologies and methodologies that characterize the geometry of vegetation using point cloud capture. The main aim of this research was to create the 3D characterization of an experimental double-skin green facade, using LiDAR technologies. From the results it could be confirmed that the methodology used was precise and robust, enabling the 3D reconstruction of the green facade's outer envelope. Detailed results were that foliage volume differences in height were linked to plant growth, whereas differences in the horizontal distribution of greenery were related to the influence of the local microclimate and specific plant diseases on the south orientation. From this research, along with complementary previous research, it could be concluded that, generally speaking, with vegetation volumes of 0.2 m3/m2, using Boston Ivy (Parthenocissus Tricuspidata) under Mediterranean climate, reductions in external building surface temperatures of around 13 °C can be obtained and used as analytic parameter in a future 3D-BIM-object., The authors at GREiA research group would like to thank the Catalan Government for the quality accreditation given to their research group (2017 SGR 1537). GREiA is a certified agent TECNIO in the category of technology developers from the Government of Catalonia. The authors at GRAP research group would like to thank the Secretaria d’Universitats i Recerca del Departament d’Empresa i Coneixement de la Generalitat de Catalunya (grant 2017 SGR 646), the Spanish Ministry of Economy and Competitiveness (project AGL2013-48297-C2-2-R) and the Spanish Ministry of Science, Innovation and Universities (project RTI2018-094222-B-I00). This work is partially supported by ICREA under the ICREA Academia programme. The authors also wish to thank Dr. Jaume Arnó for his contribution in the statistical analysis of the results.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Fruit detection, yield prediction and canopy geometric characterization using LiDAR with forced air flow

  • Gené Mola, Jordi
  • Gregorio López, Eduard
  • Auat Cheein, Fernando
  • Guevara, Javier
  • Llorens Calveras, Jordi
  • Sanz Cortiella, Ricardo
  • Escolà i Agustí, Alexandre
  • Rosell Polo, Joan Ramon
Yield monitoring and geometric characterization of crops provide information about orchard variability and vigor, enabling the farmer to make faster and better decisions in tasks such as irrigation, fertilization, pruning, among others. When using LiDAR technology for fruit detection, fruit occlusions are likely to occur leading to an underestimation of the yield. This work is focused on reducing the fruit occlusions for LiDAR-based approaches, tackling the problem from two different approaches: applying forced air flow by means of an air-assisted sprayer, and using multi-view sensing. These approaches are evaluated in fruit detection, yield prediction and geometric crop characterization. Experimental tests were carried out in a commercial Fuji apple (Malus domestica Borkh. cv. Fuji) orchard. The system was able to detect and localize more than 80% of the visible fruits, predict the yield with a root mean square error lower than 6% and characterize canopy height, width, cross-section area and leaf area. The forced air flow and multi-view approaches helped to reduce the number of fruit occlusions, locating 6.7% and 6.5% more fruits, respectively. Therefore, the proposed system can potentially monitor the yield and characterize the geometry in apple trees. Additionally, combining trials with and without forced air flow and multi-view sensing presented significant advantages for fruit detection as they helped to reduce the number of fruit occlusions., This work was partly funded by the Secretaria d’Universitats i Recerca del Departament d’Empresa i Coneixement de la Generalitat de Catalunya (grant 2017 SGR 646), the Spanish Ministry of Economy and Competitiveness (project AGL2013-48297-C2-2-R) and the Spanish Ministry of Science, Innovation and Universities (project RTI2018-094222-B-I00). The Spanish Ministry of Education is thanked for Mr. J. Gené’s pre-doctoral fellowships (FPU15/03355). The work of Jordi Llorens was supported by the Spanish Ministry of Economy, Industry and Competitiveness through a postdoctoral position named Juan de la Cierva Incorporación (JDCI-2016-29464_N18003). We would also like to thank CONICYT FONDECYT 1171431 and CONICYT FB0008. Nufri (especially Santiago Salamero and Oriol Morreres) and Vicens Maquinària Agrícola S.A. are also thanked for their support during data acquisition, and Ernesto Membrillo and Roberto Maturino for their support in dataset labelling.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Apparent electrical conductivity and multivariate analysis of soil properties to assess soil constraints in orchards affected by previous parcelling

  • Uribeetxebarria Alonso de Armiño, Asier
  • Arnó Satorra, Jaume
  • Escolà i Agustí, Alexandre
  • Martínez Casasnovas, José Antonio
Fruit production is relevant to the European agricultural sector. However, orchards in semi-arid areas of southern Europe may contain soils with constraints for tree development. This is the case of soils with high CaCO⁠3 content or limiting layers at variable depth. To assess spatial and in-depth variation of these soil constraints, an apparent electrical conductivity (ECa) survey was conducted in an orchard by using a galvanic contact soil sensor (Veris 3100). Different soil properties were randomly sampled at two depths (topsoil and subsoil) in 20 different sampling points within the plot. ECa raster maps were obtained for shallow (0-30cm) and deep (0-90cm) soil profile depths. In addition, an inversion modelling software was used to obtain horizontal ECa slices corresponding to 10cm thick soil layers from 0-10cm to 80-90cm in depth. Concordance analysis of ECa slices allowed the soil profile to be segmented into four homogeneous horizons with different spatial conductivity pattern. Then, a multivariate analysis of variance (MANOVA) was key, i) to better interpret the specific soil properties that mainly contributed to the spatial variation of ECa (CaCO⁠3 and organic matter (OM) contents), and ii) to delimit the soil layer and the specific spatial pattern of ECa that allows potential management areas to be delineated by presenting the same trend in CaCO⁠3 and OM for topsoil and subsoil simultaneously. Moreover, assessing 3D variation of ECa made it possible to identify different soil areas that, linked to previous earthworks to optimize the parcelling of the farm, are the main cause of spatial variability within the orchard., This work was funded by the Spanish Ministry of Economy and Competitiveness through the project AgVANCE (AGL2013-48297-C2-2-R). We are also grateful to the University of Lleida for funding PhD scholarship for the first author.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Spatially variable pesticide application in vineyards: Part II, field comparison of uniform and map-based variable dose treatments

  • Román, Carla
  • Llorens Calveras, Jordi
  • Uribeetxebarria Alonso de Armiño, Asier
  • Sanz Cortiella, Ricardo
  • Planas de Martí, Santiago
  • Arnó Satorra, Jaume
Reducing pesticide use is an important concern for many including the European Commission. One way to achieve this goal is to adjust the amount of pesticides in relation to canopy geometry and foliage. This objective currently poses an important challenge in vineyards with uniform vegetation but it is an added difficulty when the canopy shows spatial variability within the field. Is it possible to set a constant volume rate adjusted to this variability? Or is it more convenient to adjusting different volume rates based on a prescription map? Assuming a plant cell density (PCD) vegetation index from multispectral images to be optimal for detecting variations in vigour, two methods to adjust volume rates in spatially variable vineyards were proposed and tested: i) adjustment of a constant volume rate uniformly applied using a conventional sprayer, and ii) adjustment of two volume rates adapted to two vigour classes according to a prescription map. In both methods, PCD was previously correlated to the leaf area index (LAI), then taking the 70th percentile of LAI to determine adjusted volume rates through DOSA3D decision support system (www.dosa3d.cat/en). Leaf deposition with tracer was analysed to compare the proposed methods with the standard volume rate commonly used in the area. Statistical analysis showed no significant differences between treatments. Since pesticide savings can be achieved using the two methods, specifically 25.6% in adjusted uniform and 25.3% in adjusted map-based treatments, adjusted volume rate strategies can be recommended in vineyards with spatial variability., This study was financed by the EU Horizon 2020 project EUCLID [grant number 633999 (www.euclidipm.org)]; Spanish Ministry of Agriculture, Fisheries and Food with the project GOPHYTOVID [contract 2018002001192]; and by the Spanish Ministry of Economy, Industry and Competitiveness [project AGVANCE AGL2013-48297-C2-2-R; Jordi Llorens' contract JDCI-2016-29464 N18003]. Funding of Secretaria d’Universitats i Recerca del Departament d’Empresa i Coneixement de la Generalitat de Catalunya under Grant 2017 SGR 646 is also thanked. The authors also would like to thank Agropixel SL for the aerial images and Codorníu SA for their logistic support.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Fuji-SfM dataset: A collection of annotated images and point clouds for Fuji apple detection and location using structure-from-motion photogrammetry

  • Gené Mola, Jordi
  • Sanz Cortiella, Ricardo
  • Rosell Polo, Joan Ramon
  • Morros Rubió, Josep Ramon
  • Ruiz Hidalgo, Javier
  • Vilaplana Besler, Verónica
  • Gregorio López, Eduard
The present dataset contains colour images acquired in a commercial Fuji apple orchard (Malus domestica Borkh. cv. Fuji) to reconstruct the 3D model of 11 trees by using structure-from-motion (SfM) photogrammetry. The data provided in this article is related to the research article entitled “Fruit detection and 3D location using instance segmentation neural networks and structure-from-motion photogrammetry” [1]. The Fuji-SfM dataset includes: (1) a set of 288 colour images and the corresponding annotations (apples segmentation masks) for training instance segmentation neural networks such as Mask-RCNN; (2) a set of 582 images defining a motion sequence of the scene which was used to generate the 3D model of 11 Fuji apple trees containing 1455 apples by using SfM; (3) the 3D point cloud of the scanned scene with the corresponding apple positions ground truth in global coordinates. With that, this is the first dataset for fruit detection containing images acquired in a motion sequence to build the 3D model of the scanned trees with SfM and including the corresponding 2D and 3D apple location annotations. This data allows the development, training, and test of fruit detection algorithms either based on RGB images, on coloured point clouds or on the combination of both types of data. Dades primàries associades a l'article http://hdl.handle.net/10459.1/68505, This work was partly funded by the Secretaria d'Universitats i Recerca del Departament d'Empresa i Coneixement de la Generalitat de Catalunya (grant 2017 SGR 646), the Spanish Ministry of Economy and Competitiveness (project AGL2013-48297-C2-2-R) and the Spanish Ministry of Science, Innovation and Universities (project RTI2018-094222-B-I00). Part of the work was also developed within the framework of the project TEC2016-75976-R, financed by the Spanish Ministry of Economy, Industry and Competitiveness and the European Regional Development Fund (ERDF). The Spanish Ministry of Education is thanked for Mr. J. Gené’s pre-doctoral fellowships (FPU15/03355).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

PFuji-Size dataset: A collection of images and photogrammetry-derived 3D point clouds with ground truth annotations for Fuji apple detection and size estimation in field conditions

  • Gené Mola, Jordi
  • Sanz Cortiella, Ricardo
  • Rosell Polo, Joan Ramon
  • Escolà i Agustí, Alexandre
  • Gregorio López, Eduard
The PFuji-Size dataset is comprised of a collection of 3D point clouds of Fuji apple trees (Malus domestica Borkh. cv. Fuji) scanned at different maturity stages and annotated for fruit detection and size estimation. Structure-from-motion and multi-view stereo techniques were used to generate the 3D point clouds of 6 complete Fuji apple trees containing a total of 615 apples. The resulting point clouds were 3D segmented by identifying the 3D points corresponding to each apple (3D instance segmentation), obtaining a single point cloud for each apple. All segmented apples were labelled with ground truth diameter annotations. Since the data was acquired in field conditions and at different maturity stages, the set includes different fruit diameters -from 26.9 mm to 94.8 mm- and different fruit occlusion percentages due to foliage. In addition, 25 apples were photographed 360° in laboratory conditions, obtaining high resolution 3D point clouds of this sub-set. To the best of the authors' knowledge, this is the first publicly available dataset for apple size estimation in field conditions. This dataset was used to evaluate different fruit size estimation methods in the research article titled 'In-field apple size estimation using photogrammetry-derived 3D point clouds: comparison of 4 different methods considering fruit occlusion' (Gené-Mola et al., 2021)., This work was partly funded by the Secretaria d'Universitats i Recerca del Departament d'Empresa i Coneixement de la Generalitat de Catalunya (grant 2017 SGR 646) and the Spanish Ministry of Economy and Competitiveness (project AGL2013-48297-C2-2-R). Part of the work was founded with the Grant RTI2018-094222-B-I00 (PAgFRUIT project) by MCIN/AEI/10.13039/501100011033 and by ``ERDF, a way of making Europe'', by the European Union. The Spanish Ministry of Education is thanked for Mr. J. Gené's pre-doctoral fellowships (FPU15/03355). We would also like to thank Nufri (especially Santiago Salamero and Oriol Morreres) for their support during data acquisition.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Assessment of spray drift potential reduction for hollow-cone nozzles: Part 2. LiDAR technique

  • Gregorio López, Eduard
  • Torrent Martí, Xavier
  • Planas de Martí, Santiago
  • Rosell Polo, Joan Ramon
Pesticide spray drift poses health hazards to humans and causes a significant impact on the environment. In this work the capacity of an ad hoc light detection and ranging (LiDAR) system to differentiate spray nozzles according to their potential drift risk is evaluated for the first time. A total of 23 drift potential tests using 10 hollow-cone nozzles were carried out with the sprayer kept in a static position. Drift potential reduction (DPR) values of between 88.6% and 93.6% were obtained when comparing standard and drift reduction nozzle types. It was also possible to order different standard nozzle sizes according to their DPR. The LiDAR signalwas correlated with several droplet size parametersmeasured by a phase Doppler particle analyzer (PDPA), being V100 the best indicator. In the four field tests thatwere performed, the LiDAR systemwas also able to differentiate between standard and drift reduction nozzles under real application conditions, obtaining a DPR of 56.7%. The results of this work demonstrate that the developed LiDAR system is an advantageous alternative for the assessment of drift potential reduction., This work was partly funded by the Secretaria d'Universitats i Recerca del Departament d'Empresa i Coneixement de la Generalitat de Catalunya, the Spanish Ministry of Economy and Competitiveness and the European Regional Development Fund (ERDF) under Grants 2017 SGR 646, AGL2007-66093-C04-03, AGL2010-22304-04-C03-03, and AGL2013-48297-C2-2-R. Universitat de Lleida is thanked for Mr. X. Torrent's pre-doctoral fellowship. The authors would like to thank the Unité Mixte de Recherche Information & Technologies for AgroProcess (IRSTEA, Montpellier), and particularly Jean-Paul Douzals and Cyril Tinet for the nozzle characterization using their PDPA. Our thanks are also given to the Institut de Recerca en Tecnologia Agrària (IRTA) for allowing the use of their experimental fields, and to Vicenç Maquinària Agrícola for providing the tractor. The authors also wish to thank A. Checa (Randex Iberica, S.L.) for giving us free Albuz nozzles for the spray tests. R. Lavilla, E. Ordoño and F. Solanelles are acknowledged for their assistance in the field work, and J. Arnó is thanked for his help with statistical analysis.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Multi-modal deep learning for Fuji apple detection using RGB-D cameras and their radiometric capabilities

  • Gené Mola, Jordi
  • Vilaplana Besler, Verónica
  • Rosell Polo, Joan Ramon
  • Morros Rubió, Josep Ramon
  • Ruiz Hidalgo, Javier
  • Gregorio López, Eduard
Fruit detection and localization will be essential for future agronomic management of fruit crops, with applications in yield prediction, yield mapping and automated harvesting. RGB-D cameras are promising sensors for fruit detection given that they provide geometrical information with color data. Some of these sensors work on the principle of time-of-flight (ToF) and, besides color and depth, provide the backscatter signal intensity. However, this radiometric capability has not been exploited for fruit detection applications. This work presents the KFuji RGB-DS database, composed of 967 multi-modal images containing a total of 12,839 Fuji apples. Compilation of the database allowed a study of the usefulness of fusing RGB-D and radiometric information obtained with Kinect v2 for fruit detection. To do so, the signal intensity was range corrected to overcome signal attenuation, obtaining an image that was proportional to the reflectance of the scene. A registration between RGB, depth and intensity images was then carried out. The Faster R-CNN model was adapted for use with five-channel input images: color (RGB), depth (D) and range-corrected intensity signal (S). Results show an improvement of 4.46% in F1-score when adding depth and range-corrected intensity channels, obtaining an F1-score of 0.898 and an AP of 94.8% when all channels are used. From our experimental results, it can be concluded that the radiometric capabilities of ToF sensors give valuable information for fruit detection., This work was partly funded by the Secretaria d’Universitats i Recerca del Departament d’Empresa i Coneixement de la Generalitat de Catalunya, the Spanish Ministry of Economy and Competitiveness and the European Regional Development Fund (ERDF) under Grants 2017SGR 646, AGL2013-48297-C2-2-R and MALEGRA, TEC2016-75976-R. The Spanish Ministry of Education is thanked for Mr. J. Gené’s predoctoral fellowships (FPU15/03355). We would also like to thank Nufri and Vicens Maquinària Agrícola S.A. for their support during data acquisition, and Adria Carbó for his assistance in Faster R-CNN implementation.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Kinect v2 sensor-based mobile terrestrial laser scanner for agricultural outdoor applications

  • Rosell Polo, Joan Ramon
  • Gregorio López, Eduard
  • Gené Mola, Jordi
  • Llorens Calveras, Jordi
  • Torrent Martí, Xavier
  • Arnó Satorra, Jaume
  • Escolà i Agustí, Alexandre
Mobile terrestrial laser scanners (MTLS), based on light detection and ranging (LiDAR) sensors, are used worldwide in agricultural applications. MTLS are applied to characterize the geometry and the structure of plants and crops for technical and scientific purposes. Although MTLS exhibit outstanding performance, their high cost is still a drawback for most agricultural applications. This paper presents a low-cost alternative to MTLS based on the combination of a Kinect v2 depth sensor and a Real Time Kinematic (RTK) global navigation satellite system (GNSS) with extended color information capability. The theoretical foundations of this system are exposed along with some experimental results illustrating their performance and limitations. This work is focused on open-field agricultural applications, although most conclusions can also be extrapolated to similar outdoor uses. The developed Kinect-based MTLS (K2-MTLS) system allows to select different acquisition frequencies and fields of view (FOV), from one to 512 vertical slices. The authors conclude that the better performance is obtained when a FOV of a single slice is used, but at the price of a very low measuring speed. With that particular configuration, plants, crops, and objects are reproduced accurately. Future efforts will be directed to increase the scanning efficiency by improving both the hardware and software components and to make it feasible using both partial and full FOV.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Multi-tree woody structure reconstruction from mobile terrestrial laser scanner point clouds based on a dual neighbourhood connectivity graph algorithm

  • Méndez, Valeriano
  • Rosell Polo, Joan Ramon
  • Pascual Roca, Miquel
  • Escolà i Agustí, Alexandre
A process is presented for the vector reconstruction of fruit plantations based on the model developed by Verroust and Lazarus. To solve occlusion problems, the use of a dual graph of local and extended connectivity is proposed. The process allows vegetation variables such as the length and volume of the ligneous structure to be measured, enabling studies such as intensity of pruning operations. The process has been tested against simulated models and real trees with different training systems: open-vase system (peach trees) and central leader hedgerow system (pear trees). The cost of the algorithm will be given by the cost of the implementation of Dijkstra's algorithm, which in its standard version is of potential (O(n2)). Algorithm accuracy was checked against point clouds of virtual trees. The reconstruction was also applied before and after a pruning operation of real trees to enable a study of the evolution of the vegetation indices. Results showed the algorithm to be suitable for multi-tree reconstruction of both central leader and open-vase training systems., This research was partially funded by the Spanish Ministry of Economy and Competitiveness (projects SAFESPRAY: AGL2010-22304-C04-03 and AGVANCE: AGL2013-48297-C2-2-R).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

In-field apple size estimation using photogrammetry-derived 3D point clouds: Comparison of 4 different methods considering fruit occlusions

  • Gené Mola, Jordi
  • Sanz Cortiella, Ricardo
  • Rosell Polo, Joan Ramon
  • Escolà i Agustí, Alexandre
  • Gregorio López, Eduard
In-field fruit monitoring at different growth stages provides important information for farmers. Recent advances have focused on the detection and location of fruits, although the development of accurate fruit size estimation systems is still a challenge that requires further attention. This work proposes a novel methodology for automatic in-field apple size estimation which is based on four main steps: 1) fruit detection; 2) point cloud generation using structure-from-motion (SfM) and multi-view stereo (MVS); 3) fruit size estimation; and 4) fruit visibility estimation. Four techniques were evaluated in the fruit size estimation step. The first consisted of obtaining the fruit diameter by measuring the two most distant points of an apple detection (largest segment technique). The second and third techniques were based on fitting a sphere to apple points using least squares (LS) and M−estimator sample consensus (MSAC) algorithms, respectively. Finally, template matching (TM) was applied for fitting an apple 3D model to apple points. The best results were obtained with the LS, MSAC and TM techniques, which showed mean absolute errors of 4.5 mm, 3.7 mm and 4.2 mm, and coefficients of determination () of 0.88, 0.91 and 0.88, respectively. Besides fruit size, the proposed method also estimated the visibility percentage of apples detected. This step showed an of 0.92 with respect to the ground truth visibility. This allowed automatic identification and discrimination of the measurements of highly occluded apples. The main disadvantage of the method is the high processing time required (in this work 2760 s for 3D modelling of 6 trees), which limits its direct application in large agricultural areas. The code and the dataset have been made publicly available and a 3D visualization of results is accessible at http://www.grap.udl.cat/en/publications/apple_size_estimation_SfM., This work was partly funded by the Secretaria d’Universitats i Recerca del Departament d’Empresa i Coneixement de la Generalitat de Catalunya (grant 2017 SGR 646), the Spanish Ministry of Economy and Competitiveness (project AGL2013-48297-C2-2-R) and the Spanish Ministry of Science, Innovation and Universities (project RTI2018-094222-B-I00). The Spanish Ministry of Education is thanked for Mr. J. Gené’s pre-doctoral fellowships (FPU15/03355). We would also like to thank Nufri (especially Santiago Salamero and Oriol Morreres) for their support during data acquisition.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Mobile terrestrial laser scanner applications in precision fruticulture/ horticulture and tools to extract information from canopy point clouds

  • Escolà i Agustí, Alexandre
  • Martínez Casasnovas, José Antonio
  • Rufat i Lamarca, Josep
  • Arnó Satorra, Jaume
  • Arbonés, Amadeu
  • Sebé Feixas, Francesc
  • Pascual Roca, Miquel
  • Gregorio López, Eduard
  • Rosell Polo, Joan Ramon
LiDAR sensors are widely used in many areas and, in recent years, that includes agricultural tasks. In this work, a self-developed mobile terrestrial laser scanner based on a 2D light detection and ranging (LiDAR) sensor was used to scan an intensive olive orchard, and different algorithms were developed to estimate canopy volume. Canopy volume estimations derived from LiDAR sensor readings were compared to conventional estimations used in fruticulture/horticulture research and the results prove that they are equivalent with coefficients of correlation ranging from r = 0.56 to r = 0.82 depending on the algorithms used. Additionally, tools related to analysis of point cloud data from the LiDAR-based system are proposed to extract further geometrical and structural information from tree row crop canopies to be offered to farmers and technical advisors as digital raster maps. Having high spatial resolution information on canopy geometry (i.e., height, width and volume) and on canopy structure (i.e., light penetrability, leafiness and porosity) may result in better orchard management decisions. Easily obtainable, reliable information on canopy geometry and structure may favour the development of decision support systems either for irrigation, fertilization or canopy management, as well as for variable rate application of agricultural inputs in the framework of precision fruticulture/horticulture., This work was funded by the Spanish Ministry of Economy and Competitiveness through the projects SAFESPRAY (AGL2010-22304-C04-03) and AgVANCE (AGL2013-48297-C2-2-R) and by the project Instituto Nacional de Investigación y Tecnología Agraria y Alimentaria RTA2012-00059-C02-01.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Assessment of spray drift potential reduction for hollow-cone nozzles: Part 1. Classification using indirect methods

  • Torrent Martí, Xavier
  • Gregorio López, Eduard
  • Douzals, Jean-Paul
  • Tinet, Cyril
  • Rosell Polo, Joan Ramon
  • Planas de Martí, Santiago
Spray drift is one of the main pollution sources identified when pesticides are sprayed on crops. In this work, in order to simplify the evaluation of hollow-cone nozzles according to their drift potential reduction, several models commonly used were tested by three indirect methods: phase Doppler particle analyser (PDPA) and two different wind tunnels. The main aim of this study is then to classify for the first time these hollow-cone nozzle models all of them used in tree crop spraying (3D crops). A comparison between these indirect methods to assess their suitability and to provide guidelines for a spray drift classification of hollow-cone nozzles was carried out. The results show that, in general terms, all methods allow hollow-cone nozzle classifications according to their drift potential reduction (DPR) with a similar trend. Among all the parameters determined with the PDPA, the V100 parameter performed best in differentiating the tested nozzles among drift reduction classes. In the wind tunnel, similar values were obtained for both sedimenting and airborne drift depositions. The V100 parameter displayed a high correlation (up to R2 = 0.948) with the drift potential tested with the wind tunnel. It is concluded that in general, the evaluated indirect methods provide equivalent classification results. Additional studies with a greater variety of nozzle types are required to achieve a proposal of harmonized methodology for testing hollow-cone nozzles., This work was partly funded by the Secretaria d'Universitats i Recerca del Departament d'Empresa i Coneixement de la Generalitat de Catalunya, the Spanish Ministry of Economy and Competitiveness and the European Regional Development Fund (ERDF) under Grants 2017 SGR 646, AGL2007-66093-C04-03, AGL2010-22304-04-C03-03, and AGL2013-48297-C2-2-R. The authors also wish to thank Mr. Antonio Checa (Randex Iberica, S.L.) for giving us free Albuz nozzles for the spray tests. Universitat de Lleida is also thanked for Mr. X. Torrent's pre-doctoral fellowship.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Fruit detection and 3D location using instance segmentation neural networks and structure-from-motion photogrammetry

  • Gené Mola, Jordi
  • Sanz Cortiella, Ricardo
  • Rosell Polo, Joan Ramon
  • Morros Rubió, Josep Ramon
  • Ruiz Hidalgo, Javier
  • Vilaplana Besler, Verónica
  • Gregorio López, Eduard
The development of remote fruit detection systems able to identify and 3D locate fruits provides opportunities to improve the efficiency of agriculture management. Most of the current fruit detection systems are based on 2D image analysis. Although the use of 3D sensors is emerging, precise 3D fruit location is still a pending issue. This work presents a new methodology for fruit detection and 3D location consisting of: (1) 2D fruit detection and segmentation using Mask R-CNN instance segmentation neural network; (2) 3D point cloud generation of detected apples using structure-from-motion (SfM) photogrammetry; (3) projection of 2D image detections onto 3D space; (4) false positives removal using a trained support vector machine. This methodology was tested on 11 Fuji apple trees containing a total of 1455 apples. Results showed that, by combining instance segmentation with SfM the system performance increased from an F1-score of 0.816 (2D fruit detection) to 0.881 (3D fruit detection and location) with respect to the total amount of fruits. The main advantages of this methodology are the reduced number of false positives and the higher detection rate, while the main disadvantage is the high processing time required for SfM, which makes it presently unsuitable for real-time work. From these results, it can be concluded that the combination of instance segmentation and SfM provides high performance fruit detection with high 3D data precision. The dataset has been made publicly available and an interactive visualization of fruit detection results is accessible at http://www.grap.udl.cat/documents/photogrammetry_fruit_detection.html. Dades primàries associades a l'article http://hdl.handle.net/10459.1/68505, This work was partly funded by the Secretaria d’Universitats i Recerca del Departament d’Empresa i Coneixement de la Generalitat de Catalunya (grant 2017 SGR646), the Spanish Ministry of Economy and Competitiveness (project AGL2013-48297-C2-2-R) and the Spanish Ministry of Science, Innovation and Universities (project RTI2018-094222-B-I00). Part of the work was also developed within the framework of the project TEC2016-75976-R, financed by the Spanish Ministry of Economy, Industry and Competitiveness and the European Regional Development Fund (ERDF). The Spanish Ministry of Educationis thanked for Mr. J.Gené’s pre-doctoral fellowships (FPU15/03355). We would also like to thank Nufri (especially Santiago Salamero and Oriol Morreres) and Vicens Maquinària Agrícola S.A. for their support during data acquisition, and Ernesto Membrillo and Roberto Maturino for their support in dataset labelling.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Apple size estimation using photogrammetry-derived 3D point clouds

  • Gené Mola, Jordi
  • Sanz Cortiella, Ricardo
  • Rosell Polo, Joan Ramon
  • Escolà i Agustí, Alexandre
  • Gregorio López, Eduard
In-field fruit monitoring at different growth stages provides important information for farmers. Recent advances have focused on the detection and location of fruits, although the development of accurate fruit size estimation systems is still a challenge that requires further attention. The present work proposes a novel methodology for in-field measurement of spherical fruits using SfMMVS- based point clouds and considering different percentages of fruit occlusions., This work was partly funded by the Secretaria d’Universitats i Recerca de la Generalitat de Catalunya (grant 2017 SGR 646), the Spanish Ministry of Economy and Competitiveness (projects AGL2013-48297-C2-2-R and TEC2016-75976-R) and the Spanish Ministry of Science, Innovation and Universities (grant RTI2018- 094222-B-I00[PAgFRUIT project] by MCIN/AEI/10.13039/501100011033 and by “ERDF, a way of making Europe”, by the European Union).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Determination of spray drift and buffer zones in 3D crops using the ISO standard and new LiDAR methodologies

  • Torrent, Xavier
  • Gregorio, Eduard
  • Rosell-Polo, Joan R.
  • Arnó, Jaume
  • Peris, Miquel
  • van de Zande, Jan C.
  • Planas, Santiago
Spray drift generated in the application of plant protection products in tree crops (3D crops) is a major source of environmental contamination, with repercussions for human health and the environment. Spray drift contamination acquires greater relevance in the EU Southern Zone due to the crops structure and the weather conditions. Hence, there is a need to evaluate spray drift when treating the most representative 3D crops in this area. For this purpose, 4 spray drift tests, measuring airborne and sedimenting spray drift in accordance with ISO 22866:2005, were carried out for 4 different crops (peach, citrus, apple and grape) in orchards of the EU Southern Zone, using an air-blast sprayer equipped with standard (STN) and spray drift reduction (DRN) nozzle types. A further 3 tests were carried out to test a new methodology for the evaluation of spray drift in real field conditions using a LiDAR system, in which the spray drift generated by different sprayer and nozzle types was contrasted. The airborne spray drift potential reduction (DPRV) values, obtained following the ISO 22866:2005, were higher than those for sedimenting spray drift potential reduction (DPRH) (63.82%–94.42% vs. 39.75%–69.28%, respectively). For each crop and nozzle type combination, a sedimenting spray drift model was also developed and used to determine buffer zone width. The highest buffer width reduction (STN vs DRN) was obtained in peach (˃75%), while in grape, citrus and apple only 50% was reached. These results can be used as the starting point to determine buffer zone width in the countries of the EU Southern Zone depending on different environmental threshold values. Tests carried out using LiDAR system demonstrated high capacity and efficiency of this system and this newly defined methodology, allowing sprayer and nozzle types in real field conditions to be differentiated and classified., info:eu-repo/semantics/acceptedVersion
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Pesticide dose adjustment in fruit and grapevine orchards by DOSA3D: Fundamentals of the system and on-farm validation

  • Román, Carla
  • Peris Giner, Miquel
  • Esteve, Joan
  • Tejerina, Miguel
  • Cambray, Jordi
  • Vilardell i Coderch, Pere
  • Planas de Martí, Santiago
Agricultural productivity cannot be sustained without the application of plant protection measures. Within the framework of integrated pest management (IPM), the use of chemical pesticides should be limited to the last option among the available practices. Even though their use remains common, it carries associated environmental and human health risks. One of the most accepted practices within IPM is the reduction of spraying events and/or pesticide applied doses. DOSA3D is a decision support system that allows the dose to be adjusted to the specific treatment scenario. For this, DOSA3D calculates the optimal application volume rate by estimating the leaf area index and takes into account the overall spraying efficiency and the pest or disease to be controlled. The system adopts specific minimum volume rates for fruit trees and vineyards without compromising the crop health status. To establish the adjusted dose, the labeled or the adviser prescription concentration is kept. Resulting adjusted doses provided by DOSA3D achieved pesticide savings up to 53% in fruit trees and 60% in vineyards. DOSA3D has been validated against the main diseases and pests of fruit trees and vineyards: brown spot and psylla in pear orchards; alternaria blotch disease, apple scab, codling moth, oriental moth and red spider mite in apple orchards; powdery mildew, brown rot, aphids, thrips and mites in peach orchards; and, powdery mildew, yellow spider mite and leafhoppers in grapevine orchards. In addition, a methodology called Green Way is presented to provide consistent and crop safety pesticide doses when these are labeled as concentration or ground area doses., his study wasfinanced by the EU Horizon 2020 project EUCLID[grant number 633999], the Spanish Ministry of Economy and Compet-itiveness project AgVance [AGL2013-48297-C2-2-R] and the SpanishMinistry of Agriculture, Fisheries and Food project GOPHYTOVID [con-tract 2018002001192]. We are also grateful for funding by theSecretaria d'Universitats i Recerca del Departament d'Empresa iConeixement de la Generalitat de Catalunya under Grant 2017 SGR 646
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Aplicaciones de la teledetección en la caracterización de frutales y en la fertilización de cultivos extensivos

  • Martínez Casasnovas, José Antonio
  • Arnó Satorra, Jaume
  • Daniele, Elisa
  • Escolà i Agustí, Alexandre
  • Sandonís Pozo, Leire
  • Llorens Calveras, Jordi
  • Rosell Polo, Joan Ramon
  • Uribeetxebarria Alonso de Armiño, Asier
Proyecto AgVANCE (AGL2013‐48297‐C2‐2‐R), Proyecto PAgFRUIT (RTI2018‐094222‐B‐I00)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Capítulo o parte de un libro (BookPart)

Sensores de conductividad eléctrica aparente para el análisis de la variabilidad del suelo en Agricultura de Precisión

  • Martínez Casasnovas, José Antonio
  • Arnó Satorra, Jaume
  • Escolà i Agustí, Alexandre
Los suelos son un recurso natural fundamental en agricultura, ya que sustentan la vida de las plantas. El conocimiento de sus propiedades y cómo varían en el espacio es fundamental para mantener su productividad y para la toma de decisiones adecuadas sobre su manejo. No obstante, y dadas las características intrínsecas de los suelos de ser entes naturales que se desarrollan en profundidad, los hace difíciles de estudiar y de determinar su variabilidad en un grado de detalle adecuado para aplicaciones en Agricultura de Precisión. No obstante, desde la expansión de las tecnologías de la información geográfica (SIG, Teledetección, GNSS), y de métodos de interpolación espacial, la percepción y la obtención de mapas del suelo o de propiedades de los suelos está cambiando. Así, dentro del ámbito de las técnicas y tecnologías de la Agricultura de Precisión, los sensores que miden la conductividad eléctrica aparente del suelo (CEa) pueden ser una alternativa a tener en cuenta para poder inferir la variabilidad de las propiedades del suelo en cada punto de una parcela agrícola. Estos sensores se utilizan cada vez más para comprender y evaluar cómo varía espacialmente el suelo y también para definir zonas de manejo diferenciado en parcelas agrícolas, tanto en cultivos extensivos como en plantaciones frutícolas. En el presente artículo se explica qué es y qué mide la conductividad eléctrica aparente del suelo y con qué propiedades del suelo se puede correlacionar. También, los dos tipos de sensores que miden la CEa en continuo y que se utilizan en aplicaciones de Agricultura de Precisión: contacto galvánico directo e inducción electromagnética. Finalmente se exponen diversas aplicaciones de esta tecnología llevadas a cabo por el Grupo de Investigación en AgróTICa y Agricultura de Precisión de la Universitat de Lleida y Agrotecnio-CERCA Center en fruticultura, viñedo y cultivos extensivos., Los autores quieren agradecer la financiación obtenida en los proyectos de investigación AgVANCE (AGL2013-48297-C2-2-R, Ministerio de Economía, Industria y Competitividad), LISA-Low Input Sustainable Agriculture (COMRDI16-1-0031, Fondo Europeo de Desarrollo Regional de la Unión Europea), PAgFRUIT (RTI2018-094222-B-I00, Ministerio de Ciencia, Innovación y Universidades), ayuda 2017 SGR 646 (Secretaria d’Universitats i Recerca del Departament d’Empresa i Coneixement de la Generalitat de Catalunya) y el contrato de investigación con la empresa Ventafarinas, S.L., que han hecho posible llevar a cabo la investigación cuyos ejemplos se han mostrado en este artículo. También a los miembros del Grupo de Investigación en AgróTICa y Agricultura de Precisión de la Universitat de Lleida/Agrotecnio-CERCA Center (www.grap.udl.cat) que han participado en estos proyectos.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Pesticide dose adjustment in fruit and grapevine orchards by DOSA3D: Fundamentals of the system and on-farm validation

  • Román, Carla
  • Peris, Miquel
  • Esteve, Joan
  • Tejerina, Miguel
  • Cambray, Jordi
  • Vilardell, Pere
  • Planas, Santiago
Agricultural productivity cannot be sustained without the application of plant protection measures. Within the framework of integrated pest management (IPM), the use of chemical pesticides should be limited to the last option among the available practices. Even though their use remains common, it carries associated environmental and human health risks. One of the most accepted practices within IPM is the reduction of spraying events and/or pesticide applied doses. DOSA3D is a decision support system that allows the dose to be adjusted to the specific treatment scenario. For this, DOSA3D calculates the optimal application volume rate by estimating the leaf area index and takes into account the overall spraying efficiency and the pest or disease to be controlled. The system adopts specific minimum volume rates for fruit trees and vineyards without compromising the crop health status. To establish the adjusted dose, the labeled or the adviser prescription concentration is kept. Resulting adjusted doses provided by DOSA3D achieved pesticide savings up to 53% in fruit trees and 60% in vineyards. DOSA3D has been validated against the main diseases and pests of fruit trees and vineyards: brown spot and psylla in pear orchards; alternaria blotch disease, apple scab, codling moth, oriental moth and red spider mite in apple orchards; powdery mildew, brown rot, aphids, thrips and mites in peach orchards; and, powdery mildew, yellow spider mite and leafhoppers in grapevine orchards. In addition, a methodology called Green Way is presented to provide consistent and crop safety pesticide doses when these are labeled as concentration or ground area doses., info:eu-repo/semantics/publishedVersion
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Polarization lidar detection of agricultural aerosol emissions

  • Gregorio, Eduard
  • Gené Mola, Jordi
  • Sanz Cortiella, Ricardo
  • Rocadenbosch Burillo, Francisco
  • Chueca, Patricia
  • Arnó Satorra, Jaume
  • Solanelles, Francesc
  • Rosell Polo, Joan Ramon
Agricultural aerosol emissions can significantly impact human and animal health as well as the environment. Therefore, it is essential to adopt new sensing techniques for real-time monitoring these emissions in high temporal and spatial resolution. In recent years, light detection and ranging (lidar) technology has been used for measuring the particulate matter emitted from agricultural operations. However, conventional nonpolarized lidar systems cannot discriminate between different types of aerosols, which can lead to misinterpretation of the results. To overcome this limitation, this study applies the polarization lidar technique to monitor agricultural aerosols. A 355¿nm polarization lidar system was used to measure the emissions generated during pesticide spraying operations. The results showed that depolarization ratios due to field dust (0.220–0.268) and to road dust (0.385) are clearly higher than those caused by pesticide spray drift (0.028–0.043) or by diesel exhaust (0.099), which can be used to differentiate each type of aerosol. These results support the development of new polarization lidar systems specifically designed to study the impact of agricultural activities on air quality., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

KFuji RGB-DS database: Fuji apple multi-modal images for fruit detection with color, depth and range-corrected IR data

  • Gené Mola, Jordi
  • Vilaplana Besler, Verónica
  • Rosell Polo, Joan Ramon
  • Morros Rubió, Josep Ramon
  • Ruiz Hidalgo, Javier
  • Gregorio López, Eduard
This article contains data related to the research article entitle 'Multi-modal Deep Learning for Fruit Detection Using RGB-D Cameras and their Radiometric Capabilities' [1]. The development of reliable fruit detection and localization systems is essential for future sustainable agronomic management of high-value crops. RGB-D sensors have shown potential for fruit detection and localization since they provide 3D information with color data. However, the lack of substantial datasets is a barrier for exploiting the use of these sensors. This article presents the KFuji RGBDS database which is composed by 967 multi-modal images of Fuji apples on trees captured using Microsoft Kinect v2 (Microsoft, Redmond, WA, USA). Each image contains information from 3 different modalities: color (RGB), depth (D) and range corrected IR intensity (S). Ground truth fruit locations were manually annotated, labeling a total of 12,839 apples in all the dataset. The current dataset is publicly available at http://www.grap.udl.cat/publicacions/datasets.html., This work was partly funded by the Secretaria d’Universitats i Recerca del Departament d’Empresa i Coneixement de la Generalitat de Catalunya, the Spanish Ministry of Economy and Competitiveness and the European Regional Development Fund (ERDF) under Grants 2017 SGR 646, AGL2013-48297-C2-2-R and MALEGRA, TEC2016-75976-R. The Spanish Ministry of Education is thanked for Mr. J. Gené’s pre-doctoral fellowships (FPU15/03355). We would also like to thank Nufri and Vicens Maquinària Agrícola S.A. for their support during data acquisition.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Spatially variable pesticide application in vineyards: Part I, developing a geostatistical approach

  • Del Moral Martínez, Ignacio
  • Rosell Polo, Joan Ramon
  • Uribeetxebarria Alonso de Armiño, Asier
  • Arnó Satorra, Jaume
A geostatistical methodology is presented to optimise the dosage of plant protection products (PPP) in vineyards with spatial variability. Sprayers are commonly used in viticulture to apply a constant volume rate per unit ground area (l ha−1). This can be a problem in vineyard plots with remarkable spatial variability in vine vigour, being necessary guiding winegrowers through a decision-making tool to determine an appropriate uniform volume rate. The leaf area index (LAI), measured by a terrestrial LiDAR scanner at high spatial resolution along crop rows, can be used to determine the optimum volume application rate. The proposed method is based on obtaining different probability maps of LAI by applying an indicator kriging to the original LAI data. As a result, this method allows winegrowers to i) map and locate areas within the plot that, within a given confidence level (70% or 90%), exceed or do not exceed different values (percentiles) of the original LAI, and ii) set the LAI and the corresponding volume rate seeking, for example, to balance the probability (risk) of areas with lower and higher doses than required. In more conservative protection strategies, the method also allows farmers to set the values of LAI and volume rate that greatly minimise the probability of vulnerable areas being underdosed., This work was partially funded by the Ministerio de Economía y Competitividad, Spain [research projects SAFESPRAY - AGL2010-22304-C04-03 and AGVANCE – AGL2013-48297-C2-2-R].
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Mapping vineyard leaf area using mobile terrestrial laser scanners: should rows be scanned on-the-go or discontinuosly sampled?

  • Moral Martínez, Ignacio del
  • Rosell Polo, Joan Ramon
  • Company Mesa, Joaquim
  • Sanz Cortiella, Ricardo
  • Escolà i Agustí, Alexandre
  • Masip Vilalta, Joan
  • Martínez Casasnovas, José Antonio
  • Arnó Satorra, Jaume
The leaf area index (LAI) is defined as the one-side leaf area per unit ground area, and is probably the most widely used index to characterize grapevine vigor. However, LAI varies spatially within vineyard plots. Mapping and quantifying this variability is very important for improving management decisions and agricultural practices. In this study, a mobile terrestrial laser scanner (MTLS) was used to map the LAI of a vineyard, and then to examine how different scanning methods (on-the-go or discontinuous systematic sampling) may affect the reliability of the resulting raster maps. The use of the MTLS allows calculating the enveloping vegetative area of the canopy, which is the sum of the leaf wall areas for both sides of the row (excluding gaps) and the projected upper area. Obtaining the enveloping areas requires scanning from both sides one meter length section along the row at each systematic sampling point. By converting the enveloping areas into LAI values, a raster map of the latter can be obtained by spatial interpolation (kriging). However, the user can opt for scanning on-the-go in a continuous way and compute 1-m LAI values along the rows, or instead, perform the scanning at discontinuous systematic sampling within the plot. An analysis of correlation between maps indicated that MTLS can be used discontinuously in specific sampling sections separated by up to 15 m along the rows. This capability significantly reduces the amount of data to be acquired at field level, the data storage capacity and the processing power of computers., This work was partially funded by the Spanish Ministry of Economy and Competitiveness (research projects SAFESPRAY—AGL2010-22304-C04-03 and AGVANCE—AGL2013-48297-C2-2-R).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Mobile terrestrial laser scanner vs. UAV photogrammetry to estimate woody crop canopy parameters - Part 2: Comparison for different crops and training systems

  • Torres-Sánchez, Jorge
  • Escolà i Agustí, Alexandre
  • de Castro, Ana I.
  • López-Granados, Francisca
  • Rosell Polo, Joan Ramon
  • Sebé Feixas, Francesc
  • Jiménez-Brenes, Francisco M.
  • Sanz Cortiella, Ricardo
  • Gregorio López, Eduard
  • Peña, José M.
The measurement of geometric canopy parameters in woody crops is an important task in Precision Agriculture because of their correlation with crop condition and productivity. In recent years, several technological approaches have been developed as an alternative to manual measurements, which are time- and labour-consuming. Two of the most commonly used 3D canopy characterization technologies are mobile terrestrial laser scanning (MTLS) based on light detection and ranging (LiDAR) sensors, and digital aerial photogrammetry (DAP) using imagery from uncrewed aerial vehicles (UAVs). Although both are state-of-the-art and have been fully tested and validated, a complete comparison between their geometric canopy parameter estimations in different woody crops and training systems has not been carried out. For this reason, a set of geometric parameters (canopy height, projected area, and volume) of a vineyard, an intensive peach orchard, and an intensive pear orchard were measured using UAV-DAP and MTLS-LiDAR. A comparison between both kinds of measurements was performed, accounting for the length of the sections in which the crop hedgerows were divided to extract the geometric parameters. Measurements from the UAV and the MTLS were highly correlated (R2 from 0.82 to 0.94) when considering the data from the three crops together, and the correlations were higher when analysing longer row sections. The canopy geometric parameters estimated using the MTLS-LiDAR always had higher values than those from the UAV-DAP. The results presented in this work provide useful data for a more informed selection of technological approaches for 3D crop characterization in Precision Fruticulture and high-throughput phenotyping., This research was funded by the projects DECIMAL (PID2020-113229RB-C41), PRODIGIA (PID2020-113229RB-C44), AGVANCE (AGL2013-48297-C2-2-R), and PAgPROTECT (PID2021-126648OB-I00), from the Spanish Ministry of Science and Innovation (MCIN/AEI/10.13039/501100011033). The authors also wish to thank Codorníu SA, celler Raimat and IRTA for having allowed the use of their vineyards, pear and peach orchards to conduct the trials described in this work.