Pasar al contenido principal

TECNOLOGIAS DE AGRICULTURA DE PRECISION PARA OPTIMIZAR EL MANEJO DEL DOSEL FOLIAR Y LA PROTECCION FITOSANITARIA SOSTENIBLE EN PLANTACIONES FRUTALES

RTI2018-094222-B-I00

•
Nombre agencia financiadora Agencia Estatal de Investigación
Acrónimo agencia financiadora AEI
Programa Programa Estatal de I+D+i Orientado a los Retos de la Sociedad
Convocatoria Proyectos I+D+i Retos de Investigación
Año convocatoria 2018
Plan Estatal 2017-2020 Plan Estatal de Investigación Científica y Técnica y de Innovación
Centro beneficiario UNIVERSIDAD DE LLEIDA

Resultados relacionados

Resultados totales (Incluyendo duplicados): 89
Encontrada(s) 1 página(s)

Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

LFuji-air dataset: annotated 3D LiDAR point clouds of Fuji apple trees for fruit detection scanned under different forced air flow conditions

  • Gené Mola, Jordi
  • Gregorio López, Eduard
  • Auat Cheein, Fernando
  • Guevara, Javier
  • Llorens Calveras, Jordi
  • Sanz Cortiella, Ricardo
  • Escolà i Agustí, Alexandre
  • Rosell Polo, Joan Ramon
This article presents the LFuji-air dataset, which contains LiDAR based point clouds of 11 Fuji apples trees and the corresponding apples location ground truth. A mobile terrestrial laser scanner (MTLS) comprised of a LiDAR sensor and a real-time kinematics global navigation satellite system was used to acquire the data. The MTLS was mounted on an air-assisted sprayer used to generate different air flow conditions. A total of 8 scans per tree were performed, including scans from different LiDAR sensor positions (multi-view approach) and under different air flow conditions. These variability of the scanning conditions allows to use the LFuji-air dataset not only for training and testing new fruit detection algorithms, but also to study the usefulness of the multi-view approach and the application of forced air flow to reduce the number of fruit occlusions. The data provided in this article is related to the research article entitled 'Fruit detection, yield prediction and canopy geometric characterization using LiDAR with forced air flow' [1]., This work was partly funded by the Secretaria d’Universitats i Recerca del Departament d'Empresa i Coneixement de la Generalitat de Catalunya (grant 2017 SGR 646), the Spanish Ministry of Economy and Competitiveness (project AGL2013-48297-C2-2-R) and the Spanish Ministry of Science, Innovation and Universities (project RTI2018-094222-B-I00). The Spanish Ministry of Education is thanked for Mr. J. Gené's pre-doctoral fellowships (FPU15/03355). The work of Jordi Llorens was supported by the Spanish Ministry of Economy, Industry and Competitiveness through a postdoctoral position named Juan de la Cierva Incorporación (JDCI-2016-29464_N18003). We would also like to thank CONICYT FONDECYT 1171431 and CONICYT FB0008.
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

AmodalAppleSize_RGB-D dataset: RGB-D images of apple trees annotated with modal and amodal segmentation masks for fruit detection, visibility and size estimation

  • Gené Mola, Jordi
  • Ferrer Ferrer, Mar
  • Hemming, Jochen
  • Dalfsen, Pieter van
  • Hoog, Dirk de
  • Sanz Cortiella, Ricardo
  • Rosell Polo, Joan Ramon
  • Vilaplana Besler, Verónica
  • Ruiz Hidalgo, Javier
  • Gregorio López, Eduard
The present dataset comprises a collection of RGB-D apple tree images that can be used to train and test computer vision-based fruit detection and sizing methods. This dataset encompasses two distinct sets of data obtained from a Fuji and an Elstar apple orchards. The Fuji apple orchard sub-set consists of 3925 RGB-D images containing a total of 15,335 apples annotated with both modal and amodal apple segmentation masks. Modal masks denote the visible portions of the apples, whereas amodal masks encompass both visible and occluded apple regions. Notably, this dataset is the first public resource to incorporate on-tree fruit amodal masks. This pioneering inclusion addresses a critical gap in existing datasets, enabling the development of robust automatic fruit sizing methods and accurate fruit visibility estimation, particularly in the presence of partial occlusions. Besides the fruit segmentation masks, the dataset also includes the fruit size (calliper) ground truth for each annotated apple. The second sub-set comprises 2731 RGB-D images capturing five Elstar apple trees at four distinct growth stages. This sub-set includes mean diameter information for each tree at every growth stage and serves as a valuable resource for evaluating fruit sizing methods trained with the first sub-set. The present data was employed in the research paper titled “Looking behind occlusions: a study on amodal segmentation for robust on-tree apple fruit size estimation”., This work was partly funded by the Departament de Recerca i Universitats de la Generalitat de Catalunya (grant 2021 LLAV 00088 ), the Spanish Ministry of Science, Innovation and Universities (grants RTI2018-094222-B-I00 [PAgFRUIT project], PID2021-126648OB-I00 [PAgPROTECT project] and PID2020-117142GB-I00 [DeeLight project] by MCIN/AEI/10.13039/501100011033 and by “ERDF, a way of making Europe”, by the European Union). Data presented in this paper is also part of a Public Private Partnership project Precisie Tuinbouw, WP Fruit 4.0 (PPS KV 1604-025) and financed by Topsector Tuinbouw & Uitgangsmateriaal and various private companies. The work of Jordi Gené Mola was supported by the Spanish Ministry of Universities through a Margarita Salas postdoctoral grant funded by the European Union - NextGenerationEU. We would also like to thank Nufri (especially Santiago Salamero and Oriol Morreres) for their support during data acquisition.
Repositori Obert UdL
Publicación Contribución de congreso (ConferenceOutput)

NDVI from satellite images to estimate LiDAR-derived geometric and structural parameters in super-intensive almond orchards

  • Martínez Casasnovas, José Antonio
  • Llorens Calveras, Jordi
  • Sandonís Pozo, Leire
  • Escolà i Agustí, Alexandre
  • Arnó Satorra, Jaume
The present work tries to bridge a gap about the estimation of geometric and structural orchard parameters (LiDAR-derived) from vegetation indices from satellites. The maximum height and width, the cross-sectional area and the porosity were measured along the rows in a super-intensive almond (Prunus dulcis) orchard every 0.5 m by means of a Velodyne VLP16 LiDAR sensor. These parameters were interpolated to the pixel centroids of PlanetScope and Sentinel-2 and correlated with the normalized difference vegetation index (NDVI) from both platforms. The highest correlations were obtained between the NDVI of PlanetScope images and the cross-sectional area of the almond trees (R=0.72) and with the maximum width of the cross-sections (R=0.71). The results can be useful to estimate important canopy geometric parameters for site-specific management of orchards., This work was funded by the Spanish Ministry of Science, Innovation and Universities through the project PAgFRUIT (RTI2018-094222-B-I00). The authors thank the Copernicus program for the use of Sentinel-2 images and Planet Labs Inc. for the use of PlanetScope images under the Educational and Research License agreement with the Universitat de Lleida.
Repositori Obert UdL
Publicación Contribución de congreso (ConferenceOutput)

Estimation of geometric and structural parameters in a super-intensive almond (Prunus dulcis) orchard from multispectral vegetation indices derived from UAV-based imagery

  • Llorens Calveras, Jordi
  • Escolà i Agustí, Alexandre
  • Casañas, E.
  • Rosell Polo, Joan Ramon
  • Arnó Satorra, Jaume
  • Martínez Casasnovas, José Antonio
Canopy geometric and structural parameters in a super-intensive almond (Prunus dulcis) orchard were estimated from multispectral vegetation indices from very high-resolution UAV images (0.07 m/pixel). As ground truth data, the canopy geometric and structural parameters were extracted from a 3D LiDAR point cloud. These data were summarized every 0.5 m along the tree rows. The vegetation indices CCCI, NDRE, NDVI, GNDVI and WDRVI were calculated and summarized at the same points as the LiDAR data. The highest correlations (R>0.70) were obtained between the NDVI and the maximum width and the cross-sectional area. The porosity was negatively correlated (R=-0.59) with the NDVI. This research opens the opportunity of using remotely sensed vegetation indices to estimate canopy geometric and structural parameters in addition to vigour for precise canopy management., This work was funded by the Spanish Ministry of Science, Innovation and Universities through the project PAgFRUIT (RTI2018-094222-B-I00).
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

AKFruitYield: Modular benchmarking and video analysis software for Azure Kinect cameras for fruit size and fruit yield estimation in apple orchards

  • Miranda, Juan Carlos
  • Arnó Satorra, Jaume
  • Gené Mola, Jordi
  • Fountas, Spyros
  • Gregorio López, Eduard
AKFruitYield is a modular software that allows orchard data from RGB-D Azure Kinect cameras to be processed for fruit size and fruit yield estimation. Specifically, two modules have been developed: i) AK_SW_BENCHMARKER that makes it possible to apply different sizing algorithms and allometric yield prediction models to manually labelled color and depth tree images; and ii) AK_VIDEO_ANALYSER that analyses videos on which to automatically detect apples, estimate their size and predict yield at the plot or per hectare scale using the appropriate algorithms. Both modules have easy-to-use graphical interfaces and provide reports that can subsequently be used by other analysis tools., This work was partly funded by the Department of Research and Universities of the Generalitat de Catalunya (grants 2017 SGR 646) and by the Spanish Ministry of Science and Innovation/AEI/10.13039/501100011033/ERDF (grant RTI2018–094222-B-I00 [PAgFRUIT project] and PID2021–126648OB-I00 [PAgPROTECT project]). The Secretariat of Universities and Research of the Department of Business and Knowledge of the Generalitat de Catalunya and European Social Fund (ESF) are also thanked for financing Juan Carlos Miranda's pre-doctoral fellowship (2020 FI_B 00586). The work of Jordi Gené-Mola was supported by the Spanish Ministry of Universities through a Margarita Salas postdoctoral grant funded by the European Union - NextGenerationEU. The authors would also like to thank the Institut de Recerca i Tecnologia Agroalimentàries (IRTA) for allowing the use of their experimental fields, and in particular Dr. Luís Asín and Dr. Jaume Lordán who have contributed to the success of this work.
Repositori Obert UdL
Publicación Contribución de congreso (ConferenceOutput)

PlanetScope Vegetation Indices to Estimate UAV and LiDAR-derived Canopy Parameters in a Super-Intensive Almond Orchard

  • Sandonís Pozo, Leire
  • Plata Moreno, José Manuel
  • Llorens Calveras, Jordi
  • Escolà i Agustí, Alexandre
  • Pascual Roca, Miquel
  • Martínez Casasnovas, José Antonio
The continuous monitoring of geometric and structural parameters is a key aspect in sustainable and accurate orchard management. Although LiDAR and UAV photogrammetry are widely used to measure canopy architecture, there is still a gap to bridge in the development of software to process this information. The present work tries to estimate the maximum height and width in a hedgerow fruit tree orchard from PlanetScope vegetation indices (NDVI and GNDVI). To analyze the correspondence between geometric parameters and the vegetation indices, LiDAR and UAV point clouds were acquired on two 2021 dates in a super-intensive almond orchard: after mechanical pruning (June) and before harvesting (September). The 3D point clouds were summarized every 0.5 m and the maximum width and height along the rows were calculated and interpolated by means of block kriging to the pixel centroids of the PlanetScope image. These maps were later classified using a k means algorithm in two classes. Results indicate that the NDVI was the best performing index in estimation of maximum height and width on the two analyzed dates. GNDVI obtained its best results in September, when vegetation was fully developed. In conclusion, these vegetation indices could be useful for monitoring canopy geometry in this type of orchard, in particular to decide about pruning intensity., This work is a result of the RTI2018-094222-B-I00 project (PAgFRUIT), granted by MCIN/AEI/10.13039/501100011033 and by “ERDF, a way of making Europe”, by the European Union. The authors also thank Planet Labs Inc. for the use of PlanetScope images under an Educational and Research License agreement; Alrasa Agraria S.L. (Raimat, Spain), the Centre for Technological and Industrial Development (Ministry of Science and Innovation, Spanish Government) and EuroChem Iberia S.A., for providing experimental facilities and/or funds.
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

Delineation of management zones in hedgerow almond orchards based on vegetation indices from UAV images validated by LiDAR-derived canopy parameters

  • Martínez Casasnovas, José Antonio
  • Sandonís Pozo, Leire
  • Escolà i Agustí, Alexandre
  • Arnó Satorra, Jaume
  • Llorens Calveras, Jordi
One of the challenges in orchard management, in particular of hedgerow tree plantations, is the delineation of management zones on the bases of high-precision data. Along this line, the present study analyses the applicability of vegetation indices derived from UAV images to estimate the key structural and geometric canopy parameters of an almond orchard. In addition, the classes created on the basis of the vegetation indices were assessed to delineate potential management zones. The structural and geometric orchard parameters (width, height, cross-sectional area and porosity) were characterized by means of a LiDAR sensor, and the vegetation indices were derived from a UAV-acquired multispectral image. Both datasets summarized every 0.5 m along the almond tree rows and were used to interpolate continuous representations of the variables by means of geostatistical analysis. Linear and canonical correlation analyses were carried out to select the best performing vegetation index to estimate the structural and geometric orchard parameters in each cross-section of the tree rows. The results showed that NDVI averaged in each cross-section and normalized by its projected area achieved the highest correlations and served to define potential management zones. These findings expand the possibilities of using multispectral images in orchard management, particularly in hedgerow plantations., Grant RTI2018-094222-B-I00 (PAgFRUIT project) by MCIN/AEI/10.13039/501100011033 and by “ERDF, a way of making Europe”, by the European Union
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

Fruit detection and 3D location using instance segmentation neural networks and structure-from-motion photogrammetry

  • Gené Mola, Jordi
  • Sanz Cortiella, Ricardo
  • Rosell Polo, Joan Ramon
  • Morros Rubió, Josep Ramon
  • Ruiz Hidalgo, Javier
  • Vilaplana Besler, Verónica
  • Gregorio López, Eduard
The development of remote fruit detection systems able to identify and 3D locate fruits provides opportunities to improve the efficiency of agriculture management. Most of the current fruit detection systems are based on 2D image analysis. Although the use of 3D sensors is emerging, precise 3D fruit location is still a pending issue. This work presents a new methodology for fruit detection and 3D location consisting of: (1) 2D fruit detection and segmentation using Mask R-CNN instance segmentation neural network; (2) 3D point cloud generation of detected apples using structure-from-motion (SfM) photogrammetry; (3) projection of 2D image detections onto 3D space; (4) false positives removal using a trained support vector machine. This methodology was tested on 11 Fuji apple trees containing a total of 1455 apples. Results showed that, by combining instance segmentation with SfM the system performance increased from an F1-score of 0.816 (2D fruit detection) to 0.881 (3D fruit detection and location) with respect to the total amount of fruits. The main advantages of this methodology are the reduced number of false positives and the higher detection rate, while the main disadvantage is the high processing time required for SfM, which makes it presently unsuitable for real-time work. From these results, it can be concluded that the combination of instance segmentation and SfM provides high performance fruit detection with high 3D data precision. The dataset has been made publicly available and an interactive visualization of fruit detection results is accessible at http://www.grap.udl.cat/documents/photogrammetry_fruit_detection.html. Dades primàries associades a l'article http://hdl.handle.net/10459.1/68505, This work was partly funded by the Secretaria d’Universitats i Recerca del Departament d’Empresa i Coneixement de la Generalitat de Catalunya (grant 2017 SGR646), the Spanish Ministry of Economy and Competitiveness (project AGL2013-48297-C2-2-R) and the Spanish Ministry of Science, Innovation and Universities (project RTI2018-094222-B-I00). Part of the work was also developed within the framework of the project TEC2016-75976-R, financed by the Spanish Ministry of Economy, Industry and Competitiveness and the European Regional Development Fund (ERDF). The Spanish Ministry of Educationis thanked for Mr. J.Gené’s pre-doctoral fellowships (FPU15/03355). We would also like to thank Nufri (especially Santiago Salamero and Oriol Morreres) and Vicens Maquinària Agrícola S.A. for their support during data acquisition, and Ernesto Membrillo and Roberto Maturino for their support in dataset labelling.
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

Analyzing and overcoming the effects of GNSS error on LiDAR based orchard parameters estimation

  • Guevara, Javier
  • Auat Cheein, Fernando
  • Gené Mola, Jordi
  • Rosell Polo, Joan Ramon
  • Gregorio López, Eduard
Currently, 3D point clouds are obtained via LiDAR (Light Detection and Ranging) sensors to compute vegetation parameters to enhance agricultural operations. However, such a point cloud is intrinsically dependent on the GNSS (global navigation satellite system) antenna used to have absolute positioning of the sensor within the grove. Therefore, the error associated with the GNSS receiver is propagated to the LiDAR readings and, thus, to the crown or orchard parameters. In this work, we first describe the error propagation of GNSS over the laser scan measurements. Second, we present our proposal to overcome this effect based only on the LiDAR readings. Such a proposal uses a scan matching approach to reduce the error associated with the GNSS receiver. To accomplish such purpose, we fuse the information from the scan matching estimations with the GNSS measurements. In the experiments, we statistically analyze the dependence of the grove parameters extracted from the 3D point cloud -specifically crown surface area, crown volume, and crown porosity- to the localization error. We carried out 150 trials with positioning errors ranging from 0.01 meters (ground truth) to 2 meters. When using only GNSS as a localization system, the results showed that errors associated with the estimation of vegetation parameters increased more than 100 when positioning error was equal or bigger than 1 meter. On the other hand, when our proposal was used as a localization system, the results showed that for the same case of 1 meter, the estimation of orchard parameters improved in 20 overall. However, in lower positioning errors of the GNSS, the estimation of orchard parameters were improved up to 50% overall. These results suggest that our work could lead to better decisions in agricultural operations, which are based on foliar parameter measurements, without the use of external hardware., This work was partly funded by CONICYT FB0008, CONICYT FONDECYT 1171431, PIIC 030/2018 DGIIP-UTFSM Chile, the Secretaria d’Universitats i Recerca del Departament d’Empresa i Coneixement de la Generalitat de Catalunya (grant 2017 SGR 646), the Spanish Ministry of Science, Innovation and Universities (project RTI2018- 094222-B-I00). The Spanish Ministry of Education is thanked for Mr. J. Gené’s pre-doctoral fellowship (FPU15/03355).
Repositori Obert UdL
Publicación Proyecto fin de carrera (BachelorThesis)

Prestacions d'una càmera monofocal per a la caracterització d'arbres fruiters des de plataformes aèries i terrestres: mesura de l’NDVI i comparació amb sensors de reflectància

  • Rotés Biosca, Albert
Cada vegada és més comú utilitzar tecnologies per tenir informació rellevant de les parcel·les agrícoles. La tecnologia avança a un ritme frenètic: el què fins fa pocs anys es feia amb costosos satèl·lits ara es pot dur a terme amb un simple dron i una càmera de pocs centenars d’euros. Estem parlant de mesurar i mapar el vigor de cultius extensius i fruiters amb l’índex NDVI, clau des de fa dècades en l’agricultura de precisió. Aquest proporciona informa-ció de l’estat dels vegetals en una escala del 0 a l’1. La tecnologia avança molt, sí, però s’ha de saber utilitzar. En aquest estudi es pretén conèixer en quines condicions ha de funcionar una càmera monofocal NDVI recent sortida al mercat que en principi ha estat dissenyada per funcionar en plataformes aèries(drons). Es desenvolupa un assaig en què s’utilitza aquesta càmera i un sensor de reflectància molt utilitzat, del qual se n’ha demostrat en molts estudis la seva eficàcia, per obtenir diferents tipus de mesures de l’NDVI en una fila d’arbres perer si saber, a partir d’anàlisis estadístics: i) si la càmera funciona correctament, ii) en quines condicions la cà-mera ha de treballar per donar bones lectures de NDVI, iii)comprovar la viabilitat d’obtenir un mapa depunts 3D de NDVI, iv) quines lectures són més interessants conèixer d’una filera d’arbresperers, v) elaborar un estudi d’interès de la utilització d’aquesta tecnologia en Fructicultura de Precisió.
Repositori Obert UdL
Publicación Contribución de congreso (ConferenceOutput)

R software code to process and extract information from 3D Lidar point clouds

  • Llorens Calveras, Jordi
  • Cabrera Pérez, Carlos
  • Escolà i Agustí, Alexandre
  • Arnó Satorra, Jaume
Poster Proceedings of the 12th European Conference on Precision Agriculture, July 8-11, Montpellier, France. pp. 114-115. e-book publication. SupAgro Montpellier. ISBN 978-2-900792-49-0, In the process of electronic canopy characterization, it is necessary to process efficiently point clouds obtained by means of sensors or other capturing information systems. These point clouds may have different origin but they define the main structural characteristics of the scanned crop. For this reason, a fast, easy-to-configure and precise methodology is necessary to extract such information. The work presented in this poster defines the main features of a procedure carried out with R Software code., This work was partly funded by the Secretaria d’Universitats i Recerca del Departament d’Empresa i Coneixement de la Generalitat de Catalunya and the Spanish Ministry of Economy and Competitiveness under Grants 2017 SGR 646, AGL2013-48297-C2-2-R and RTI2018-094222-B-I00(PAgFRUIT). The work of Jordi Llorens was supported by Spanish Ministry of Economy, Industry and Competitiveness through a postdoctoral position named Juan de la Cierva Incorporació (JDCI-2016-29464_N18003).
Repositori Obert UdL
Publicación Contribución de congreso (ConferenceOutput)

Apple size estimation using photogrammetry-derived 3D point clouds

  • Gené Mola, Jordi
  • Sanz Cortiella, Ricardo
  • Rosell Polo, Joan Ramon
  • Escolà i Agustí, Alexandre
  • Gregorio López, Eduard
In-field fruit monitoring at different growth stages provides important information for farmers. Recent advances have focused on the detection and location of fruits, although the development of accurate fruit size estimation systems is still a challenge that requires further attention. The present work proposes a novel methodology for in-field measurement of spherical fruits using SfMMVS- based point clouds and considering different percentages of fruit occlusions., This work was partly funded by the Secretaria d’Universitats i Recerca de la Generalitat de Catalunya (grant 2017 SGR 646), the Spanish Ministry of Economy and Competitiveness (projects AGL2013-48297-C2-2-R and TEC2016-75976-R) and the Spanish Ministry of Science, Innovation and Universities (grant RTI2018- 094222-B-I00[PAgFRUIT project] by MCIN/AEI/10.13039/501100011033 and by “ERDF, a way of making Europe”, by the European Union).
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

A photogrammetry-based methodology to obtain accurate digital ground-truth of leafless fruit trees

  • Lavaquiol Colell, Bernat
  • Sanz Cortiella, Ricardo
  • Llorens Calveras, Jordi
  • Arnó Satorra, Jaume
  • Escolà i Agustí, Alexandre
In recent decades, a considerable number of sensors have been developed to obtain 3D point clouds that have great potential in optimizing management in agriculture through the application of precision agriculture techniques. In order to use the data provided by these sensors, it is essential to know their measurement error. In this paper, a methodology is presented for obtaining a 3D point cloud of a central axis training system defoliated fruit tree (Malus domestica Bork.) obtained from stereophotogrammetry techniques based on structure-from-motion (SfM) and multi-view stereo-photogrammetry (MVS). The point cloud was made from a set of 288 photographs of the scene including the ground truth tree which was used to generate the digital 3D model. The resulting point cloud was validated and proven to faithfully represent reality. The bias of the resulting model is −0.15 mm and 0.05 mm, for diameters and lengths, respectively. In addition, the presented methodology allows small changes in the ground truth actual tree to be detected as a consequence of the wood dehydration process. Having an actual and a digital ground-truth is the basis for validating other sensing systems for 3D vegetation characterization which can be used to obtain data to make more informed management decisions., This research was funded by the Spanish Ministry of Economy and Competitiveness and the Ministry of Science, Innovation and Universities through the program Plan Estatal I+D+i Orientada a los Retos de la Sociedad, Project PAgFRUIT RTI2018-094222-B-I00. In addition, this work was also supported by the Secretaria d’Universitats i Recerca del Departament d’Empresa i Coneixement de la Generalitat de Catalunya under Grant 2017-SGR-646 and under the research grant program BFC2020S - Programa Santander Predocs UdL 2020. We would also like to thank Jaume Badia from Nufri for providing the tree used in this article as ground truth.
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

Fruit detection, yield prediction and canopy geometric characterization using LiDAR with forced air flow

  • Gené Mola, Jordi
  • Gregorio López, Eduard
  • Auat Cheein, Fernando
  • Guevara, Javier
  • Llorens Calveras, Jordi
  • Sanz Cortiella, Ricardo
  • Escolà i Agustí, Alexandre
  • Rosell Polo, Joan Ramon
Yield monitoring and geometric characterization of crops provide information about orchard variability and vigor, enabling the farmer to make faster and better decisions in tasks such as irrigation, fertilization, pruning, among others. When using LiDAR technology for fruit detection, fruit occlusions are likely to occur leading to an underestimation of the yield. This work is focused on reducing the fruit occlusions for LiDAR-based approaches, tackling the problem from two different approaches: applying forced air flow by means of an air-assisted sprayer, and using multi-view sensing. These approaches are evaluated in fruit detection, yield prediction and geometric crop characterization. Experimental tests were carried out in a commercial Fuji apple (Malus domestica Borkh. cv. Fuji) orchard. The system was able to detect and localize more than 80% of the visible fruits, predict the yield with a root mean square error lower than 6% and characterize canopy height, width, cross-section area and leaf area. The forced air flow and multi-view approaches helped to reduce the number of fruit occlusions, locating 6.7% and 6.5% more fruits, respectively. Therefore, the proposed system can potentially monitor the yield and characterize the geometry in apple trees. Additionally, combining trials with and without forced air flow and multi-view sensing presented significant advantages for fruit detection as they helped to reduce the number of fruit occlusions., This work was partly funded by the Secretaria d’Universitats i Recerca del Departament d’Empresa i Coneixement de la Generalitat de Catalunya (grant 2017 SGR 646), the Spanish Ministry of Economy and Competitiveness (project AGL2013-48297-C2-2-R) and the Spanish Ministry of Science, Innovation and Universities (project RTI2018-094222-B-I00). The Spanish Ministry of Education is thanked for Mr. J. Gené’s pre-doctoral fellowships (FPU15/03355). The work of Jordi Llorens was supported by the Spanish Ministry of Economy, Industry and Competitiveness through a postdoctoral position named Juan de la Cierva Incorporación (JDCI-2016-29464_N18003). We would also like to thank CONICYT FONDECYT 1171431 and CONICYT FB0008. Nufri (especially Santiago Salamero and Oriol Morreres) and Vicens Maquinària Agrícola S.A. are also thanked for their support during data acquisition, and Ernesto Membrillo and Roberto Maturino for their support in dataset labelling.
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

LiDAR-derived indices and their relationship with productivity and oil quality attributes in high-density olive orchards

  • Sandonís Pozo, Leire
  • Rufat i Lamarca, Josep
  • Pascual Roca, Miquel
  • Villar Mir, Josep Ma.
  • Arnó Satorra, Jaume
  • Escolà i Agustí, Alexandre
  • Rosell Polo, Joan Ramon
  • Martínez Casasnovas, José Antonio
Optimising the leaf area index (LAI) and light exposure are key aspects to improve yield and quality in highdensity olive orchards. Traditionally, these characteristics are estimated using ceptometers, but this method is both labour intensive and dependent on light conditions, with limitations in effectiveness for precision horticulture management purposes. This study investigates the potential of four LiDAR-derived indices to: i) estimate the LAI and canopy light interception under different fertigation treatments, and ii) to assess their impact on yield and oil quality throughout a growing season in a high-density olive orchard. The treatments included two nitrogen dose rates (N0: 0 kg ha-¹ and N50: 50 kg ha-¹) combined with full irrigation (FI) and deficit irrigation (DI). The results provide strong evidence for the effectiveness of these indices in monitoring canopy response to treatments over time. The N50 and FI treatments increased the LAI and yield but led to poorer light attenuation within the canopy and lower oil quality. In contrast, N0 and DI promoted more light-permeable canopies and improved oil quality, with higher phenolic content, better oxidative stability and improved organoleptic oil attributes. These indices can improve the understanding of canopy light environments, help to optimise management practices, and ultimately improve the sustainability and profitability of intensive olive cultivation., This work was carried out with data acquired in the project IRTA2012–00059-C02–01 funded by Spain’s National Institute for Agricultural and Food Research and Technology, as well as in the projects AGL2010–22304-C04–03 and AGL2013–48297-C2–2-R funded by the Spanish Ministry of Economy and Competitiveness. The study was carried out under the framework of the grants RTI2018–094222-B-I00 (PAgFRUIT project) and PID2021–126648OB-I00 (PAgPROTECT project) through MCIN/AEI/10.13039/501100011033 and the European Union’s “ERDF, a way of making Europe”.
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

Fuji-SfM dataset: A collection of annotated images and point clouds for Fuji apple detection and location using structure-from-motion photogrammetry

  • Gené Mola, Jordi
  • Sanz Cortiella, Ricardo
  • Rosell Polo, Joan Ramon
  • Morros Rubió, Josep Ramon
  • Ruiz Hidalgo, Javier
  • Vilaplana Besler, Verónica
  • Gregorio López, Eduard
The present dataset contains colour images acquired in a commercial Fuji apple orchard (Malus domestica Borkh. cv. Fuji) to reconstruct the 3D model of 11 trees by using structure-from-motion (SfM) photogrammetry. The data provided in this article is related to the research article entitled “Fruit detection and 3D location using instance segmentation neural networks and structure-from-motion photogrammetry” [1]. The Fuji-SfM dataset includes: (1) a set of 288 colour images and the corresponding annotations (apples segmentation masks) for training instance segmentation neural networks such as Mask-RCNN; (2) a set of 582 images defining a motion sequence of the scene which was used to generate the 3D model of 11 Fuji apple trees containing 1455 apples by using SfM; (3) the 3D point cloud of the scanned scene with the corresponding apple positions ground truth in global coordinates. With that, this is the first dataset for fruit detection containing images acquired in a motion sequence to build the 3D model of the scanned trees with SfM and including the corresponding 2D and 3D apple location annotations. This data allows the development, training, and test of fruit detection algorithms either based on RGB images, on coloured point clouds or on the combination of both types of data. Dades primàries associades a l'article http://hdl.handle.net/10459.1/68505, This work was partly funded by the Secretaria d'Universitats i Recerca del Departament d'Empresa i Coneixement de la Generalitat de Catalunya (grant 2017 SGR 646), the Spanish Ministry of Economy and Competitiveness (project AGL2013-48297-C2-2-R) and the Spanish Ministry of Science, Innovation and Universities (project RTI2018-094222-B-I00). Part of the work was also developed within the framework of the project TEC2016-75976-R, financed by the Spanish Ministry of Economy, Industry and Competitiveness and the European Regional Development Fund (ERDF). The Spanish Ministry of Education is thanked for Mr. J. Gené’s pre-doctoral fellowships (FPU15/03355).
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

Relationship between yield and tree growth in almond as influenced by nitrogen nutrition

  • Sandonís Pozo, Leire
  • Martínez Casasnovas, José Antonio
  • Llorens Calveras, Jordi
  • Escolà i Agustí, Alexandre
  • Arnó Satorra, Jaume
  • Pascual Roca, Miquel
Understanding the relationship between nitrogen (N), tree growth and yield, can maximize productivity and sustainability. This study analyzed the effect of N on canopy development and its relation with yield in a super-intensive almond orchard in Spain over two seasons. The treatments included 50 kg N ha−1, 100 kg N ha−1, 150 kg N ha−1, and 100 kg N ha−1 applied between 3.1 and 7.7 Growth Stages, and their combinations with a nitrification inhibitor, DMPSA. The canopy was measured using LiDAR technology after pruning in spring and before harvest. Differences were found in canopy parameters comparing early N (Nstop) against N applied along the season. The treatments N50, N100 and N150 resulted in higher cross sections and widths, less porosity and higher yield, fruit set and hull weights. In contrast, Nstop gave higher porosity and higher flower density. DMPSA produced more homogeneous canopies and improved N use efficiency, combined with N100 or N150. These findings provide evidence to support the management of N in super-intensive orchards., This research was funded by Grant RTI2018–094,222-B-I00 (PAgFRUIT project) by MCIN/AEI/10.13039/501,100,011,033 and by the EU’s “ERDF, a way of making Europe”.
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

Fruit sizing using AI: A review of methods and challenges

  • Miranda, Juan Carlos
  • Gené Mola, Jordi
  • Zude-Sasse, Manuela
  • Tsoulias, Nikos
  • Escolà i Agustí, Alexandre
  • Arnó Satorra, Jaume
  • Rosell Polo, Joan Ramon
  • Sanz Cortiella, Ricardo
  • Martínez Casasnovas, José Antonio
  • Gregorio López, Eduard
Fruit size at harvest is an economically important variable for high-quality table fruit production in orchards and vineyards. In addition, knowing the number and size of the fruit on the tree is essential in the framework of precise production, harvest, and postharvest management. A prerequisite for analysis of fruit in a real-world environment is the detection and segmentation from background signal. In the last five years, deep learning convolutional neural network have become the standard method for automatic fruit detection, achieving F1-scores higher than 90 %, as well as real-time processing speeds. At the same time, different methods have been developed for, mainly, fruit size and, more rarely, fruit maturity estimation from 2D images and 3D point clouds. These sizing methods are focused on a few species like grape, apple, citrus, and mango, resulting in mean absolute error values of less than 4 mm in apple fruit. This review provides an overview of the most recent methodologies developed for in-field fruit detection/counting and sizing as well as few upcoming examples of maturity estimation. Challenges, such as sensor fusion, highly varying lighting conditions, occlusions in the canopy, shortage of public fruit datasets, and opportunities for research transfer, are discussed., his work was partly funded by the Department of Research and Universities of the Generalitat de Catalunya (grants 2017 SGR 646 and 2021 LLAV 00088) and by the Spanish Ministry of Science and Innovation / AEI/10.13039/501100011033 / FEDER (grants RTI2018-094222-B-I00 [PAgFRUIT project] and PID2021-126648OB-I00 [PAgPROTECT project]). The Secretariat of Universities and Research of the Department of Business and Knowledge of the Generalitat de Catalunya and European Social Fund (ESF) are also thanked for financing Juan Carlos Miranda’s pre-doctoral fellowship (2020 FI_B 00586). The work of Jordi Gené-Mola was supported by the Spanish Ministry of Universities through a Margarita Salas postdoctoral grant funded by the European Union - NextGenerationEU.
Repositori Obert UdL
Publicación Contribución de congreso (ConferenceOutput)

Multi-beam LiDAR-derived data analysis for optimal canopy 3D monitoring in super-intensive almond (Prunus dulcis) orchards

  • Llorens Calveras, Jordi
  • Alsina Tehàs, Albert
  • Arnó Satorra, Jaume
  • Martínez Casasnovas, José Antonio
  • Escolà i Agustí, Alexandre
An analysis of data obtained by a LiDAR sensor was carried out. The sensor uses 16 laser beams and was moved along super-intensive almond orchard alleyways to obtain a 3D point cloud. Different beam combinations were used to obtain three geometrical crop parameters: canopy height, width and cross-sectional area. The parameters were computed using a single central beam, a combination of the two outer beams and all 16 beams. The results showed statistically significant differences in width and cross-sectional area when using one, two or sixteen beams. The more the laser beams considered, the larger the canopy width and cross-sectional area. 28-33% larger width was obtained in comparison to the central beam whereas the cross-sectional area was doubled when all beams were considered., This work was funded by the Spanish Ministry of Science, Innovation and Universities through the project PAgFRUIT (RTI2018-094222-B-I00). Also this work was supported by Secretaria d’Universitats i Recerca del Departament d’Empresa i Coneixement de la Generalitat de Catalunya under Grant 2017-SGR-646.
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

Assessing the Performance of RGB-D Sensors for 3D Fruit Crop Canopy Characterization under Different Operating and Lighting Conditions

  • Gené Mola, Jordi
  • Llorens Calveras, Jordi
  • Rosell Polo, Joan Ramon
  • Gregorio López, Eduard
  • Arnó Satorra, Jaume
  • Solanelles Batlle, Francesc
  • Martínez Casasnovas, José Antonio
  • Escolà i Agustí, Alexandre
The use of 3D sensors combined with appropriate data processing and analysis has provided tools to optimise agricultural management through the application of precision agriculture. The recent development of low-cost RGB-Depth cameras has presented an opportunity to introduce 3D sensors into the agricultural community. However, due to the sensitivity of these sensors to highly illuminated environments, it is necessary to know under which conditions RGB-D sensors are capable of operating. This work presents a methodology to evaluate the performance of RGB-D sensors under different lighting and distance conditions, considering both geometrical and spectral (colour and NIR) features. The methodology was applied to evaluate the performance of the Microsoft Kinect v2 sensor in an apple orchard. The results show that sensor resolution and precision decreased significantly under middle to high ambient illuminance (>2000 lx). However, this effect was minimised when measurements were conducted closer to the target. In contrast, illuminance levels below 50 lx affected the quality of colour data and may require the use of artificial lighting. The methodology was useful for characterizing sensor performance throughout the full range of ambient conditions in commercial orchards. Although Kinect v2 was originally developed for indoor conditions, it performed well under a range of outdoor conditions., This research was funded by the Spanish Ministry of Economy and Competitiveness and the Ministry of Science, Innovation and Universities through the program Plan Estatal I+D+i Orientada a los Retos de la Sociedad, grant numbers AGL2013-48297-C2-2-R and RTI2018-094222-B-I00, respectively.
Repositori Obert UdL
Publicación Contribución de congreso (ConferenceOutput)

Assessment of different N treatments in Hedgerow Almond Orchards by means of LiDAR point clouds

  • Sandonís Pozo, Leire
  • Llorens Calveras, Jordi
  • Escolà i Agustí, Alexandre
  • Arnó Satorra, Jaume
  • Pascual Roca, Miquel
  • Martínez Casasnovas, José Antonio
Monitoring of canopy status in fruit tree orchards allows better decisions in the canopy management, such as pruning or fertirrigation. LiDAR is an effective tool to acquire accurate 3D geometric and structural data, such as height, width, volume or canopy porosity, among others. In the present work, a super-intensive almond orchard (Prunus Dulcis) with 8 different N treatments (N50, N100, N150, NStop: N100 only in Fase I and with and without DMPSA nitrification inhibitor in 24 rows and 3 blocks, was scanned during three years (2019-21) in two different vegetative stages (after spring pruning and before harvesting) by means of a terrestrial LiDAR scanner. Canopy parameters such maximum height and width, cross section and porosity were summarized from the LiDAR 3D point cloud every 0.5 m along the almond tree hedgerows. A repeated measure mixed statistical model was applied to each parameter in order to assess the effect of the N treatments. The adjusted R2 ranged from 0.73 of the canopy width to 0.83 of the porosity. Canopy parameters and their main interactions with the different treatments were significantly differentiated. The N100+DMPSA treatment was the one favoring higher canopy development (higher cross sections and widths, and less porosity), while the NStop+DMPSA treatment was related to lower canopy development and higher porosity., This work was funded by the Spanish Ministry of Science, Innovation and Universities through the project PAgFRUIT (RTI2018-094222 -B-I00). Also this work was supported by Secretaria d’Universitats i Recercadel del Departament d’Empresa i Coneixement de la Generalitat Generalitat de Catalunya under Grant 2017-SGR-646.
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

AKFruitData: A dual software application for Azure Kinect cameras to acquire and extract informative data in yield tests performed in fruit orchard environments

  • Miranda, Juan Carlos
  • Gené Mola, Jordi
  • Arnó Satorra, Jaume
  • Gregorio López, Eduard
The emergence of low-cost 3D sensors, and particularly RGB-D cameras, together with recent advances in artificial intelligence, is currently driving the development of in-field methods for fruit detection, size measurement and yield estimation. However, as the performance of these methods depends on the availability of quality fruit datasets, the development of ad-hoc software to use RGB-D cameras in agricultural environments is essential. The AKFruitData software introduced in this work aims to facilitate use of the Azure Kinect RGB-D camera for testing in field trials. This software presents a dual structure that addresses both the data acquisition and the data creation stages. The acquisition software (AK_ACQS) allows different sensors to be activated simultaneously in addition to the Azure Kinect. Then, the extraction software (AK_FRAEX) allows videos generated with the Azure Kinect camera to be processed to create the datasets, making available colour, depth, IR and point cloud metadata. AKFruitData has been used by the authors to acquire and extract data from apple fruit trees for subsequent fruit yield estimation. Moreover, this software can also be applied to many other areas in the framework of precision agriculture, thus making it a very useful tool for all researchers working in fruit growing., This work is a result of the RTI2018-094222-B-I00 project (PAgFRUIT) granted by MCIN/AEI and by the European Regional Development Fund (ERDF). This work was also supported by the Secretaria d’Universitats i Recerca del Departament d’Empresa i Coneixement de la Generalitat de Catalunya under Grant 2017-SGR-646. The Secretariat of Universities and Research of the Department of Business and Knowledge of the Generalitat de Catalunya and Fons Social Europeu (FSE) are also thanked for financing Juan Carlos Miranda’s pre-doctoral fellowship (2020 FI_B 00586). The work of Jordi Gené-Mola was supported by the Spanish Ministry of Universities through a Margarita Salas postdoctoral grant funded by the European Union - NextGenerationEU. The authors would also like to thank the Institut de Recerca i Tecnologia Agroalimentàries (IRTA) for allowing the use of their experimental fields, and in particular Dr. Luís Asín and Dr. Jaume Lordán who have contributed to the success of this work. 
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

A systematic analysis of scan matching techniques for localization in dense orchards

  • Guevara, Javier
  • Gené Mola, Jordi
  • Gregorio López, Eduard
  • Auat Cheein, Fernando
In recent years, different methods have been studied to determine machinery position within a grove, as an alternative for complementing GNSS (global navigation satellite system) information in cases where GNSS signal is occluded. Such a situation can be observed when agricultural machinery travels under dense foliage or on the slopes of mountains. Scan matching techniques arise as a possible solution for localizing the machinery, complementing the absence of the GNSS signal when necessary. However, since key points are difficult to obtain in heterogeneous, unstructured and non-rigid environments (such as orchard plants), the performance of scan matching techniques often decreases in agricultural environments. This paper suggests dividing the point clouds into horizontal and vertical segments to improve the performance of scan-matching methods in orchards. It also examines the best way for registered frames to overlap. We validate the analysis with extensive experimentation in a Fuji apple orchard. The results show that the cumulative localization error in scan matching techniques can be notoriously decreased with selective parts of the orchard, by up to 60%. The experimentation performed herein suggests that the proposed methodology can complement the GNSS navigation in a middle-long path., This work was partly funded by ANID FB0008, PIIC 030/2018 DGIIP-UTFSM Chile, the Secretaria d'Universitats i Recerca del Departament d'Empresa i Coneixement de la Generalitat de Catalunya (grant 2017 SGR 646), the Spanish Ministry of Science, Innovation and Universities (project RTI2018-094222-B-I00). This work is also part of the DIGIFRUIT project (grant TED2021-131871B-I00) funded by MICIU/AEI/10.13039/501100011033 and by the European Union NextGenerationEU/PRTR. The Spanish Ministry of Education is thanked for Mr. J. Gené's pre-doctoral fellowships (FPU15/03355).
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

Video-based fruit detection and tracking: effects of scanning conditions on fruit load estimation

  • Felip-Pomés, , Marc
  • Gené Mola, Jordi
  • Arnó Satorra, Jaume
  • Lordan Sanahuja, Jaume
  • Ruiz Hidalgo, Javier
  • Morros Rubió, Josep Ramon
  • Arasanz-Malo,Miguel
  • Net Barnés, Francesc
  • Gregorio López, Eduard
Automated fruit counting and yield estimation systems are necessary for efficient orchard management. This study presents a computer vision system based on video multi-object-tracking for fruit load estimation in apple orchards and provides a comprehensive analysis of the system performance under diverse scanning conditions. The system integrates fruit detection, tracking, localization within orchard, and fruit load map generation. Experiments were carried out in an experimental apple orchard containing 420 apple trees. Data was collected with two different RGB-D sensors (Azure Kinect DK and ZED 2) at three different scanning distances (125 cm, 175 cm, and 225 cm) on two different dates prior to the harvest. Comparing the two evaluated sensors, Azure Kinect provided more consistent performance across different dates. Results also show that the longer scanning distance improves accuracy due to seeing the full tree view gives better fruit counts than close partial views. Between the two dates, best results were achieved near harvest due to fruit color at this stage, achieving a Mean Absolute Percentage Error (MAPE) of 6.91 % and a determination coefficient (R2) of 0.733 (using ZED2 sensor at 225 cm distance). Finally, a test comparing scanning from one or both sides of the tree row showed that bilateral scanning improved fruit load estimation at the stretch level by incorporating information from both sides of the canopy. The results of this work demonstrate the effectiveness of the video fruit tracking systems as a useful tool for automating fruit load estimation., This work was partly funded by the Department of Research and Universities of the Generalitat de Catalunya (grants 2017, SGR 646 and 2021 LLAV 00088), by the Spanish Ministry of Science and Innovation /AEI/10.13039/501100011033 / ERDF (grants RTI2018-094222-B-I00 [PAgFRUIT project], PID2021-126648OB-I00 [PAgPROTECT project], PID2024-161868OB-I00 [C3DRUM project], and PID2024-156495OR-C31 [YIELD4CAST]), by the Spanish Ministry of Science and Innovation / AEI/10.13039/501100011033 / European Union NextGeneration / PRTR (grant TED2021-131871B-I00 [DIGIFRUIT project]), and by the Agrotecnio-IRTA Joint Projects Call 2025 (PhotonFruit project). The work of Jordi Gené-Mola was partially supported by the Spanish Ministry of Universities through a Margarita Salas postdoctoral grant funded by the European Union - NextGenerationEU.
Repositori Obert UdL
Publicación Contribución de congreso (ConferenceOutput)

Análisis del dosel foliar de setos olivo mediante LiDAR y su relación con la productividad y atributos de calidad del aceite

  • Sandonís Pozo, Leire
  • Arnó Satorra, Jaume
  • Rufat i Lamarca, Josep
  • Villar Mir, Josep Ma.
  • Martínez Casasnovas, José Antonio
  • Pascual Roca, Miquel
La gestión del cultivo del olivo, particularmente en condiciones superintensivas, es clave para alcanzar la productividad y la calidad del aceite necesarias para mantener las expectativas económicas de las explotaciones. En este sentido, los sensores LiDAR (Light Detection And Ranging) pueden aportar la información necesaria para cuantificar las características geométricas y estructurales del dosel foliar de las plantaciones. El presente trabajo se ha realizado en una plantación comercial superintensiva de olivo, variedad “Arbequina”, en la que se diseñó un experimento con diferentes dosis de nitrógeno y de riego (desde condiciones deficitarias en diferentes períodos hasta riego completo), cruzado con dosis de N subóptimas y suficientes. Los resultados obtenidos del análisis LiDAR permiten estimar adecuadamente el volumen de los árboles y la porosidad del dosel, pudiendo relacionar estos indicadores con diversos e importantes atributos cuantitativos (producción, crecimiento vegetativo y frondosidad del seto), y cualitativos del aceite obtenido (MUFA, PUFA, estabilidad, polifenoles y esteroles)., Este trabajo ha sido financiado por el Ministerio de Ciencia, Innovación y Universidades a través del Proyecto PAgFRUIT (RTI 2018 -094222 -B-I00).
Repositori Obert UdL
Publicación Contribución de congreso (ConferenceOutput)

Metodología para el análisis de los errores y validación de nubes de puntos 3D obtenidas en campo para la caracterización de la arquitectura de árboles frutales

  • Lavaquiol Colell, Bernat
  • Llorens Calveras, Jordi
  • Sanz Cortiella, Ricardo
  • Gené Mola, Jordi
  • Arnó Satorra, Jaume
  • Gregorio López, Eduard
  • Escolà i Agustí, Alexandre
El estudio de la estructura de la planta (índice de área foliar, porosidad del dosel, densidad foliar, arquitectura leñosa y sistema de entrenamiento) y de su geometría (tamaño, forma y volumen) es básico para realizar un manejo óptimo del cultivo. Antes de la introducción de los sensores 3D, la caracterización precisa de cultivos en 3D era una tarea muy laboriosa que resultaba inviable en grandes cultivos comerciales. Sin embargo, la introducción de nuevos sensores 3D ha supuesto una oportunidad para realizar esta tarea de una forma relativamente sencilla y rápida. Antes de utilizar un sistema de escaneo 3D para caracterizar el dosel, es fundamental conocer su error de medición o precisión. En esta investigación proponemos una metodología para evaluar la precisión de los sensores LiDAR comparando las nubes de puntos 3D basadas en LiDAR con un modelo digital de Ground-Truth (DGT) generado mediante la aplicación de técnicas de fotogrametría. La nube de puntos 3D de la DGT se obtuvo a partir de 288 fotografías de la escena que incluye el árbol Ground-Truth (Malus domestica Bork). La nube de puntos resultante tiene un sesgo de - 0,15 mm de diámetro y 0,05 mm de longitud, por lo que se puede considerar que la DGT representa fielmente la realidad. Este DGT es utilizado posteriormente para validar la nube de puntos generada por un sistema mobile terrestrial laser scanner (MTLS) compuesto por un sensor VLP-16 Velodyne LiDAR sincronizado con un sistema de posicionamiento GNSS-RTK. El MTLS se condujo a velocidades de 0,14 m/s y 0,55 m/s. Se obtuvo un error promedio de 4,3 cm y 4,4 cm, respectivamente. El número de puntos obtenidos a 0,14 m/s fue de 50 051 puntos y a 0,55 m/s de 12 503 puntos. A pesar de tener un error de medición bajo cuando se escanea a ambas velocidades, se obtiene una densidad de puntos óptima cuando se escanea a 0,14 m/s y pobre cuando se escanea a 0,55 m/s. De estos resultados se concluye que el error obtenido con el sensor Velodyne VLP-16 se considera aceptable en aplicaciones agronómicas., This research was funded by the Spanish Ministry of Economy and Competitiveness and the Ministry of Science, Innovation and Universities through the program Plan Estatal I+D+i Orientada a los Retos de la Sociedad, Project PAgFRUIT RTI2018-094222-B-I00.
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

Assessing automatic data processing algorithms for RGB-D cameras to predict fruit size and weight in apples

  • Miranda, Juan Carlos
  • Arnó Satorra, Jaume
  • Gené Mola, Jordi
  • Lordan Sanahuja, Jaume
  • Asin Jones, Luis
  • Gregorio López, Eduard
Data acquired using an RGB-D Azure Kinect DK camera were used to assess different automatic algorithms to estimate the size, and predict the weight of non-occluded and occluded apples. The programming of the algorithms included: (i) the extraction of images of regions of interest (ROI) using manual delimitation of bounding boxes or binary masks; (ii) estimating the lengths of the major and minor geometric axes for the purpose of apple sizing; and (iii) predicting the final weight by allometric modelling. In addition to the use of bounding boxes, the algorithms also allowed other post-mask settings (circles, ellipses and rotated rectangles) to be implemented, and different depth options (distance between the RGB-D camera and the fruits detected) for subsequent sizing through the application of the thin lens theory. Both linear and nonlinear allometric models demonstrated the ability to predict apple weight with a high degree of accuracy (R2 greater than 0.942 and RMSE < 16 g). With respect to non-occluded apples, the best weight predictions were achieved using a linear allometric model including both the major and minor axes of the apples as predictors. The mean absolute percentage error (MAPE) ranged from 5.1% to 5.7% with respective RMSE of 11.09 g and 13.02 g, depending to whether circles, ellipses, or bounding boxes were used to adjust fruit shape. The results were therefore promising and open up the possibility of implementing reliable in-field apple measurements in real time. Importantly, final weight prediction error and intermediate size estimation errors (from sizing algorithms) interact but in a way that is not easily quantifiable when weight allometric models with implicit prediction error are used. In addition, allometric models should be reviewed when applied to other apple cultivars, fruit development stages or even for different fruit growth conditions depending on canopy management., This work was partly funded by the Department of Research and Universities of the Generalitat de Catalunya (grants 2017, SGR 646 and 2021 LLAV 00088), by the Spanish Ministry of Science and Innovation / AEI/10.13039/501100011033 / ERDF (grants RTI2018-094222-B-I00 [PAgFRUIT project], PID2021-126648OB-I00 [PAgPROTECT project]) and by the Spanish Ministry of Science and Innovation / AEI/10.13039/ 501100011033 / European Union NextGeneration / PRTR (grantTED2021-131871B-I00 [DIGIFRUIT project]). We would also like to thank the Secretariat of Universities and Research of the Department of Business and Knowledge of the Generalitat de Catalunya and the European Social Fund (ESF) for financing Juan Carlos Miranda’s pre-doctoral fellowship (2020 FI_B 00586). The work of Jordi Gen´e-Mola was supported by the Spanish Ministry of Universities through a Margarita Salas postdoctoral grant funded by the European Union - NextGenerationEU.
Repositori Obert UdL
Publicación Contribución de congreso (ConferenceOutput)

Aplicaciones de la teledetección en la caracterización de frutales y en la fertilización de cultivos extensivos

  • Martínez Casasnovas, José Antonio
  • Arnó Satorra, Jaume
  • Daniele, Elisa
  • Escolà i Agustí, Alexandre
  • Sandonís Pozo, Leire
  • Llorens Calveras, Jordi
  • Rosell Polo, Joan Ramon
  • Uribeetxebarria Alonso de Armiño, Asier
Proyecto AgVANCE (AGL2013‐48297‐C2‐2‐R), Proyecto PAgFRUIT (RTI2018‐094222‐B‐I00)
Repositori Obert UdL
Publicación Contribución de congreso (ConferenceOutput)

Fruit detection and 3D location using instance segmentation neural networks and SfM photogrammetry

  • Gregorio López, Eduard
  • Sanz Cortiella, Ricardo
  • Rosell Polo, Joan Ramon
  • Morros Rubió, Josep Ramon
  • Ruiz Hidalgo, Javier
  • Vilaplana Besler, Verónica
  • Gregorio López, Eduard
The development of remote fruit detection systems able to identify and 3D locate fruits provides opportunities to improve the effi-ciency of agriculture management. Most of the current fruit detec-tion systems are based on 2D image analysis. Although the use of 3D sensors is emerging, precise 3D fruit location is still a pending issue. This work presents a new methodology for fruit detection and 3D location, combining the use of instance segmentation neu-ral networks and Structure-from-Motion (SfM) photogrammetry., This work was partly funded by the Secretaria d’Universitats i Recerca de la Gener-alitat de Catalunya (grant 2017 SGR 646), the Spanish Ministry of Economy and Competitiveness (projects AGL2013-48297-C2-2-R and TEC2016-75976-R) and the Spanish Ministry of Science, Innovation and Universities (project RTI2018-094222-B-I00). The Spanish Ministry of Education is thanked for Mr. J. Gené’s pre-doctoral fellowships (FPU15/03355).
Repositori Obert UdL
Publicación Contribución de congreso (ConferenceOutput)

Fruit detection and sizing using photonic sensors and artificial intelligence

  • Gené Mola, Jordi
  • Gregorio López, Eduard
  • Sanz Cortiella, Ricardo
  • Escolà i Agustí, Alexandre
  • Rosell Polo, Joan Ramon
The Secretaria d’Universitats i Recerca del Departament d’Economia i Coneixement de la Generalitat de Catalunya, the Spanish Ministry of Education and the Spanish Ministry of Science, Innovation and Universities are thanked the pre-doctoral fellowships 2016FI_B00669, FPU15/03355 and EST18/00487, respectively. The Spanish Ministry of Universities is thanked for the posdoctoral Margarita Salas grant given to Jordi Gené, funded by the European Union-Next Generation EU. The research work was partly funded by the Secretaria d’Universitats i Recerca del Departament d’Empresa i Coneixement de la Generalitat de Catalunya (grant 2017SGR646), the Spanish Ministry of Economy and Competitiveness (project AGL2013-48297-C2-2-R) and the Spanish Ministry of Science, Innovation and Universities (project RTI2018-094222-B-I00).
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

Video-Based Fruit Detection and Tracking for Apple Counting and Mapping

  • Gené Mola, Jordi
  • Felip Pomés, Marc
  • Net Barnés, Francesc
  • Morros Rubió, Josep Ramon
  • Miranda, Juan Carlos
  • Arnó Satorra, Jaume
  • Asin Jones, Luis
  • Lordan Sanahuja, Jaume
  • Ruiz Hidalgo, Javier
  • Gregorio López, Eduard
Automatic fruit counting systems have garnered interest from farmers and agronomists to monitor fruit production, predict yields in advance, and identify production variability across orchards. However, accurately counting fruits poses challenges, particularly due to occlusions. This study proposes a multi-view sensing approach using continuous motion videos captured by a camera moved along the row of trees, followed by fruit detection in all video frames and application of Multi-Object Tracking (MOT) algorithms to prevent double-counting. Three tracking methods, namely SORT, DeepSORT, and ByteTrack, are compared for fruit counting using the YOLOv5x object detector. The methodology is applied to map fruit production in an experimental apple orchard at two different dates: four weeks and one week before harvest. The results demonstrate that ByteTrack (MOTA=0.682; IDF1=0.837; HOTA=0.689) outperforms SORT and DeepSORT, indicating its superior tracking performance. Computational efficiency analysis reveals similar processing times between SORT and ByteTrack (about 15 ms), while DeepSORT requires significantly more processing time per image (128 ms). Fruit counting evaluation shows reasonably accurate yield predictions on both dates, with reduced errors and improved performance closer to the harvest date (MAPE=7.47 %; R2=0.70). The system proves effective in estimating orchard fruit production using computer vision technology, offering valuable insights for yield forecasting. These findings contribute to optimizing fruit production and supporting precision agriculture practices. The code and the dataset have been made publicly available and a video visualization of results is accessible at http://www.grap.udl.cat/en/publications/video_fruit_counting., This work was partly funded by the Departament de Recerca i Universitats de la Generalitat de Catalunya (grant 2021 LLAV 00088), the Spanish Ministry of Science, Innovation and Universities (grants RTI2018-094222-B-I00 [PAgFRUIT project], PID2021-126648OB-I00 [PAgPROTECT project] and PID2020-117142GB-I00 [DeeLight project] by MCIN/AEI/10.13039/501100011033 and by “ERDF, a way of making Europe”, by the European Union). The work of Jordi Gené Mola was supported by the Spanish Ministry of Universities through a Margarita Salas postdoctoral grant funded by the European Union - NextGenerationEU. The Secretariat of Universities and Research of the Department of Business and Knowledge of the Generalitat de Catalunya and European Social Fund (ESF) are also thanked for financing Juan Carlos Miranda’s pre doctoral fellowship (2020 FI_B 00586).
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

Satellite multispectral indices to estimate canopy parameters and within‑feld management zones in super‑intensive almond orchards

  • Sandonís Pozo, Leire
  • Llorens Calveras, Jordi
  • Escolà i Agustí, Alexandre
  • Arnó Satorra, Jaume
  • Pascual Roca, Miquel
  • Martínez Casasnovas, José Antonio
Continuous canopy status monitoring is an essential factor to support and precisely apply orchard management actions such as pruning, pesticide and foliar treatment applications, or fertirrigation, among others. For that, this work proposes the use of multispectral vegetation indices to estimate geometric and structural orchard parameters from remote sensing images (high temporal and spatial resolution) as an alternative to more time-consuming processing techniques, such as LiDAR surveys or UAV photogrammetry. A super-intensive almond (Prunus dulcis) orchard was scanned using a mobile terrestrial laser (LiDAR) in two diferent vegetative stages (after spring pruning and before harvesting). From the LiDAR point cloud, canopy orchard parameters, including maximum height and width, cross-sectional area and porosity, were summarized every 0.5 m along the rows and interpolated using block kriging to the pixel centroids of PlanetScope (3×3 m) and Sentinel-2 (10×10 m) image grids. To study the association between the LiDAR-derived parameters and 4 diferent vegetation indices. A canonical correlation analysis was carried out, showing the normalized diference vegetation index (NDVI) and the green normalized difference vegetation index (GNDVI) to have the best correlations. A cluster analysis was also performed. Results can be considered optimistic both for PlanetScope and Sentinel-2 images to delimit within-feld management zones, being supported by signifcant diferences in LiDAR-derived canopy parameters.
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

Looking behind occlusions: A study on amodal segmentation for robust on-tree apple fruit size estimation

  • Gené Mola, Jordi
  • Ferrer Ferrer, Mar
  • Gregorio López, Eduard
  • Blok, Pieter
  • Hemming, Jochen
  • Morros Rubió, Josep Ramon
  • Rosell Polo, Joan Ramon
  • Vilaplana Besler, Verónica
  • Ruiz Hidalgo, Javier
The detection and sizing of fruits with computer vision methods is of interest because it provides relevant information to improve the management of orchard farming. However, the presence of partially occluded fruits limits the performance of existing methods, making reliable fruit sizing a challenging task. While previous fruit segmentation works limit segmentation to the visible region of fruits (known as modal segmentation), in this work we propose an amodal segmentation algorithm to predict the complete shape, which includes its visible and occluded regions. To do so, an end-to-end convolutional neural network (CNN) for sim ultaneous modal and amodal instance segmentation was implemented. The predicted amodal masks were used to estimate the fruit diameters in pixels. Modal masks were used to identify the visible region and measure the distance between the apples and the camera using the depth image. Finally, the fruit diameters in millimetres (mm) were computed by applying the pinhole camera model. The method was developed with a Fuji apple dataset consisting of 3925 RGB-D images acquired at different growth stages with a total of 15,335 annotated apples, and was subsequently tested in a case study to measure the diameter of Elstar apples at different growth stages. Fruit detection results showed an F1-score of 0.86 and the fruit diameter results reported a mean absolute error (MAE) of 4.5 mm and R2 = 0.80 irrespective of fruit visibility. Besides the diameter estimation, modal and amodal masks were used to automatically determine the percentage of visibility of measured apples. This feature was used as a confidence value, improving the diameter estimation to MAE = 2.93 mm and R2 = 0.91 when limiting the size estimation to fruits detected with a visibility higher than 60%. The main advantages of the present methodology are its robustness for measuring partially occluded fruits and the capability to determine the visibility percentage. The main limitation is that depth images were generated by means of photogrammetry methods, which limits the efficiency of data acquisition. To overcome this limitation, future works should consider the use of commercial RGB-D sensors. The code and the dataset used to evaluate the method have been made publicly available at https://github.com/GRAP-UdL-AT/Amodal_Fruit_Sizing., This work was partly funded by the Departament de Recerca i Universitats de la Generalitat de Catalunya (grant 2021 LLAV 00088), the Spanish Ministry of Science, Innovation and Universities (grants RTI2018-094222-B-I00 [PAgFRUIT project], PID2021-126648OB-I00 [PAgPROTECT project] and PID2020-117142GB-I00 [DeeLight project] by MCIN/AEI/10.13039/501100011033 and by “ERDF, a way of making Europe”, by the European Union). The work of Jordi Gen´e Mola was supported by the Spanish Ministry of Universities through a Margarita Salas postdoctoral grant funded by the European Union - NextGenerationEU. We would also like to thank Nufri (especially Santiago Salamero and Oriol Morreres) for their support during data acquisition, and Pieter van Dalfsen and Dirk de Hoog from Wageningen University & Research for additional data collection used in the case study.
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

PFuji-Size dataset: A collection of images and photogrammetry-derived 3D point clouds with ground truth annotations for Fuji apple detection and size estimation in field conditions

  • Gené Mola, Jordi
  • Sanz Cortiella, Ricardo
  • Rosell Polo, Joan Ramon
  • Escolà i Agustí, Alexandre
  • Gregorio López, Eduard
The PFuji-Size dataset is comprised of a collection of 3D point clouds of Fuji apple trees (Malus domestica Borkh. cv. Fuji) scanned at different maturity stages and annotated for fruit detection and size estimation. Structure-from-motion and multi-view stereo techniques were used to generate the 3D point clouds of 6 complete Fuji apple trees containing a total of 615 apples. The resulting point clouds were 3D segmented by identifying the 3D points corresponding to each apple (3D instance segmentation), obtaining a single point cloud for each apple. All segmented apples were labelled with ground truth diameter annotations. Since the data was acquired in field conditions and at different maturity stages, the set includes different fruit diameters -from 26.9 mm to 94.8 mm- and different fruit occlusion percentages due to foliage. In addition, 25 apples were photographed 360° in laboratory conditions, obtaining high resolution 3D point clouds of this sub-set. To the best of the authors' knowledge, this is the first publicly available dataset for apple size estimation in field conditions. This dataset was used to evaluate different fruit size estimation methods in the research article titled 'In-field apple size estimation using photogrammetry-derived 3D point clouds: comparison of 4 different methods considering fruit occlusion' (Gené-Mola et al., 2021)., This work was partly funded by the Secretaria d'Universitats i Recerca del Departament d'Empresa i Coneixement de la Generalitat de Catalunya (grant 2017 SGR 646) and the Spanish Ministry of Economy and Competitiveness (project AGL2013-48297-C2-2-R). Part of the work was founded with the Grant RTI2018-094222-B-I00 (PAgFRUIT project) by MCIN/AEI/10.13039/501100011033 and by ``ERDF, a way of making Europe'', by the European Union. The Spanish Ministry of Education is thanked for Mr. J. Gené's pre-doctoral fellowships (FPU15/03355). We would also like to thank Nufri (especially Santiago Salamero and Oriol Morreres) for their support during data acquisition.
Repositori Obert UdL
Publicación Contribución de congreso (ConferenceOutput)

A new Leafiness-LiDAR index to estimate light interception in intensive olive orchards

  • Sandonís Pozo, Leire
  • Martínez Casasnovas, José Antonio
  • Escolà i Agustí, Alexandre
  • Rosell Polo, Joan Ramon
  • Rufat i Lamarca, Josep
  • Pascual Roca, Miquel
The 14th European Conference on Precision Agriculture, July 2-6, 2023, Bologna, Italy, Canopy light interception constitutes an important yield limiting factor in high density olive orchards. However, its characterisation still implies laborious measurements. A new index, the Leafiness-LiDAR index (LLI), is presented as a LAI estimator. LLI combines LiDAR-derived parameters: Cross-Section and Leafiness from 3D point clouds. To validate the results, photosynthetically active radiation (PAR) measurements, canopy volume, yield and quality parameters were collected and analysed. LLI showed significant correlations both with PAR and canopy volume (r = 0.8) and quality parameters (r = -0.6). LLI may be useful as an early decision canopy monitoring tool in the framework of Precision Fructiculture., This work was carried out with data acquired in the project IRTA2012-00059-C02-01 funded by the Instituto Nacional de Investigación y Tecnología Agraria y Alimentaria, as well as in the projects AGL2010-22304-C04-03 and AGL2013-48297-C2-2-R funded by the Spanish Ministry of Economy and Competitiveness and developed under the frame of the grants RTI2018-094222-B-I00 (PAgFRUIT project) and PID2021-126648OB-I00 (PAgPROTECT project) by MCIN/AEI/10.13039/501100011033 and by “ERDF, a way of making Europe”, by the European Union.
Repositori Obert UdL
Publicación Contribución de congreso (ConferenceOutput)

Manejo de malas hierbas bajo la línea del viñedo mediante acolchados orgánicos y su efecto sobre el vigor del cultivo

  • Cabrera Pérez, Carlos
  • Llorens Calveras, Jordi
  • Escolà i Agustí, Alexandre
  • Royo-Esnal, Aritz
  • Recasens i Guinjuan, Jordi
En una parcela de viñedo de Raimat (Lleida) cv. ‘Chardonnay’ se estudió, durante la campaña 2019, el efecto de cuatro estrategias de manejo de malas hierbas bajo las cepas: 1) laboreo con intercepas, 2) pases de segadora, 3) acolchado de cáscaras de almendra y 4) acolchado de astillas de pino. Además de la presencia de malas hierbas bajo la línea, se estimó, en nueve cepas distintas y para cada manejo, la longitud de los sarmientos, el potencial hídrico de tallo, el rendimiento y el peso de poda. A su vez, en el mes de julio y agosto se escaneó la parcela con un escáner láser móvil terrestre equipado con sensores LiDAR para la medición del dosel foliar como indicador de vigor. La presencia de malas hierbas fue significativamente menor en los acolchados que en los otros manejos coincidiendo también con diferencias significativas en los otros parámetros. Con acolchados las cepas mostraron mayores valores de longitud de sarmientos, rendimiento, peso de poda y mejor estado hídrico. El sistema basado en LiDAR confirmó estas diferencias a nivel de dosel foliar. Los resultados demuestran que el uso de acolchados orgánicos permite reducir la presencia de malas hierbas y favorecer el vigor de las cepas., Trabajo desarrollado con la financiación de la Agencia Española de Investigación (AEI) con los proyectos AGL2017-83325-C4-2-R y RTI2018-094222-B-I00.
Repositori Obert UdL
Publicación Contribución de congreso (ConferenceOutput)

Low-cost terrestrial photogrammetry for orchard sidewards 3D reconstruction

  • Martínez Casasnovas, José Antonio
  • Rosell Tarragó, Miquel
  • Rosell Polo, Joan Ramon
  • Sanz Cortiella, Ricardo
  • Gregorio López, Eduard
  • Gené Mola, Jordi
  • Arnó Satorra, Jaume
  • Plata Moreno, José Manuel
  • Escolà i Agustí, Alexandre
The present study was part of the grants RTI2018-094222-B-I00 and PID2021-126648OB-I00 (PAgFRUIT and PAgPROTECT projects), funded by MCIN/AEI/10.13039/501100011033 and by “ERDF, a way of making Europe”, by the European Union
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

Simultaneous fruit detection and size estimation using multitask deep neural networks

  • Ferrer Ferrer, Mar
  • Ruiz Hidalgo, Javier
  • Gregorio López, Eduard
  • Vilaplana Besler, Verónica
  • Morros Rubió, Josep Ramon
  • Gené Mola, Jordi
The measurement of fruit size is of great interest to estimate the yield and predict the harvest resources in advance. This work proposes a novel technique for in-field apple detection and measurement based on Deep Neural Networks. The proposed framework was trained with RGB-D data and consists of an end-to-end multitask Deep Neural Network architecture specifically designed to perform the following tasks: 1) detection and segmentation of each fruit from its surroundings; 2) estimation of the diameter of each detected fruit. The methodology was tested with a total of 15,335 annotated apples at different growth stages, with diameters varying from 27 mm to 95 mm. Fruit detection results reported an F1-score for apple detection of 0.88 and a mean absolute error of diameter estimation of 5.64 mm. These are state-of-the-art results with the additional advantages of: a) using an end-to-end multitask trainable network; b) an efficient and fast inference speed; and c) being based on RGB-D data which can be acquired with affordable depth cameras. On the contrary, the main disadvantage is the need of annotating a large amount of data with fruit masks and diameter ground truth to train the model. Finally, a fruit visibility analysis showed an improvement in the prediction when limiting the measurement to apples above 65% of visibility (mean absolute error of 5.09 mm). This suggests that future works should develop a method for automatically identifying the most visible apples and discard the prediction of highly occluded fruits., This work was partly funded by the Departament de Recerca i Universitats de la Generalitat de Catalunya (grant 2021 LLAV 00088), the Spanish Ministry of Science, Innovation and Universities (grants RTI2018-094222-B-I00[PAgFRUIT project], PID2021-126648OB-I00 [PAgPROTECT project] and PID2020- 117142 GB-I00 [DeeLight project] by MCIN/AEI/10.13039/ 501100011033 and by “ERDF, a way of making Europe”, by the European Union). The work of Jordi Gene Mola was supported by the Spanish Ministry of Universities through a Margarita Salas postdoctoral grant funded by the European Union - NextGenerationEU
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

Gossypol Treatment Restores Insufficient Apoptotic Function of DFF40/CAD in Human Glioblastoma Cells

  • Martínez Escardó, Laura
  • Alemany, Montse
  • Sánchez Osuna, María
  • Sánchez Chardi, Alejandro
  • Roig Martínez, Meritxell
  • Suárez García, Salvio
  • Ruiz Molina, Daniel
  • Vidal, Noemí
  • Plans, Gerard
  • Majós, Carles
  • Ribas i Fortuny, Judit
  • Baltrons, María Antonia
  • Bayascas Ramírez, José Ramón
  • Barcia, Carlos
  • Bruna, Jordi
  • Yuste Mateos, Víctor J. (Víctor José)
Glioblastoma (GBM) is a highly aggressive brain tumor and almost all patients die because of relapses. GBM-derived cells undergo cell death without nuclear fragmentation upon treatment with different apoptotic agents. Nuclear dismantling determines the point-of-no-return in the apoptotic process. DFF40/CAD is the main endonuclease implicated in apoptotic nuclear disassembly. To be properly activated, DFF40/CAD should reside in the cytosol. However, the endonuclease is poorly expressed in the cytosol and remains cumulated in the nucleus of GBM cells. Here, by employing commercial and non-commercial patient-derived GBM cells, we demonstrate that the natural terpenoid aldehyde gossypol prompts DFF40/CAD-dependent nuclear fragmentation. A comparative analysis between gossypol- and staurosporine-treated cells evidenced that levels of neither caspase activation nor DNA damage were correlated with the ability of each compound to induce nuclear fragmentation. Deconvoluted confocal images revealed that DFF40/CAD was almost completely excluded from the nucleus early after the staurosporine challenge. However, gossypol-treated cells maintained DFF40/CAD in the nucleus for longer times, shaping a ribbon-like structure piercing the nuclear fragments and building a network of bridged masses of compacted chromatin. Therefore, GBM cells can fragment their nuclei if treated with the adequate insult, making the cell death process irreversible., This work was supported by grants SAF2017-83206-R funded by MCIN/Government of Spain (to V.J.Y.), SLT008/18/00028 from the CERCA Program/Generalitat de Catalunya (to J.B.), PGC2018-096003-B-I00 funded by MCI/AEI/10.130339/501100011033 and by ERDF A way of making Europe (to C.B.), and RTI2018-098027-B-C21 funded by MCIN/AEI/10.13039/501100011033 and by ERDF A way of making Europe (to D.R.-M.). The ICN2 is supported by the Severo Ochoa Centres of Excellence Program, grant SEV-2017-0706 funded by MCIN/AEI/10.13039/501100011033. The ICN2 is under the CERCA Program/Generalitat de Catalunya. L.M.-E. was recipient of a “Personal Investigador en Formació” fellow (BQ-2016-2) from Universitat Autònoma de Barcelona, and later supported by Oncobell program (IDIBELL).
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

In-field apple size estimation using photogrammetry-derived 3D point clouds: Comparison of 4 different methods considering fruit occlusions

  • Gené Mola, Jordi
  • Sanz Cortiella, Ricardo
  • Rosell Polo, Joan Ramon
  • Escolà i Agustí, Alexandre
  • Gregorio López, Eduard
In-field fruit monitoring at different growth stages provides important information for farmers. Recent advances have focused on the detection and location of fruits, although the development of accurate fruit size estimation systems is still a challenge that requires further attention. This work proposes a novel methodology for automatic in-field apple size estimation which is based on four main steps: 1) fruit detection; 2) point cloud generation using structure-from-motion (SfM) and multi-view stereo (MVS); 3) fruit size estimation; and 4) fruit visibility estimation. Four techniques were evaluated in the fruit size estimation step. The first consisted of obtaining the fruit diameter by measuring the two most distant points of an apple detection (largest segment technique). The second and third techniques were based on fitting a sphere to apple points using least squares (LS) and M−estimator sample consensus (MSAC) algorithms, respectively. Finally, template matching (TM) was applied for fitting an apple 3D model to apple points. The best results were obtained with the LS, MSAC and TM techniques, which showed mean absolute errors of 4.5 mm, 3.7 mm and 4.2 mm, and coefficients of determination () of 0.88, 0.91 and 0.88, respectively. Besides fruit size, the proposed method also estimated the visibility percentage of apples detected. This step showed an of 0.92 with respect to the ground truth visibility. This allowed automatic identification and discrimination of the measurements of highly occluded apples. The main disadvantage of the method is the high processing time required (in this work 2760 s for 3D modelling of 6 trees), which limits its direct application in large agricultural areas. The code and the dataset have been made publicly available and a 3D visualization of results is accessible at http://www.grap.udl.cat/en/publications/apple_size_estimation_SfM., This work was partly funded by the Secretaria d’Universitats i Recerca del Departament d’Empresa i Coneixement de la Generalitat de Catalunya (grant 2017 SGR 646), the Spanish Ministry of Economy and Competitiveness (project AGL2013-48297-C2-2-R) and the Spanish Ministry of Science, Innovation and Universities (project RTI2018-094222-B-I00). The Spanish Ministry of Education is thanked for Mr. J. Gené’s pre-doctoral fellowships (FPU15/03355). We would also like to thank Nufri (especially Santiago Salamero and Oriol Morreres) for their support during data acquisition.
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

Organic mulches as an alternative for under-vine weed management in Mediterranean irrigated vineyards: Impact on agronomic performance

  • Cabrera Pérez, Carlos
  • Llorens Calveras, Jordi
  • Escolà i Agustí, Alexandre
  • Royo-Esnal, Aritz
  • Recasens i Guinjuan, Jordi
One of the main challenges for organic vineyards is weed management. Weeds tend to compete for water and nutrients, and can cause large yield reductions. Traditional under-vine weed management in organic vineyards consists on mechanical cultivation along the season, which is associated to soil and young vine root damages, and to high fuel consumption. Thus, sustainable alternatives need to be found. Cover crops are becoming common in the last decades due to their multiple benefits in agroecosystems. Nevertheless, under-vine cover crop implementation in Mediterranean vineyards is limited as this competes for resources (water and nutrients), reducing the yield, vegetative development, and grape size of vines. The use of organic mulches could overcome all these problems, while benefitting vine performance. In the present work, the response of vines, soil and weeds to mulching was evaluated. An experiment was carried out in Raimat, Lleida (Catalonia, NE Spain) in a commercial vineyard from 2019 to 2021, and the following treatments applied: 1) mechanical cultivation with an in-row tiller; 2) mowing a permanent spontaneous cover with an in-row mower; 3) almond shell mulch; and 4) chopped pine wood mulch. Results showed lower weed cover along the three seasons in mulched treatments, as well as higher yield, better vine water status, and greater vegetative development from traditional measurement. The latter was confirmed by and analised with further detail with measurements acquired with a mobile terrestrial laser scanner (MTLS) based on light detection and ranging (LiDAR) sensors. Besides, petiole nutrient status was better in vines without a spontaneous living cover. Organic mulches improved vine performance and weed control, so these results allow to optimize water use efficiency in the Mediterranean basin with scarce water resources. Mulching can be considered as a useful strategy that enhances a more sustainable viticulture., This work has been supported by the Spanish State Research Agency (AEI) and the European Regional Development Fund (ERDF) through the Projects AGL2017-83325-C4-2-R and RTI2018-094222-B-I00 (PAgFRUIT), by the Agency for Administration of University and Research Grants (Generalitat de Catalunya, Spain) under the Project 2017 SGR 00646, and also by the Centre for Technological and Industrial Development (CDTI). The first author obtained a PhD grant from the University of Lleida (PhD grants). Second author contract is supported by a Jaume Serra Húnter Programme promoted by Generalitat de Catalunya.
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

Comparison of 3D scan matching techniques for autonomous robot navigation in urban and agricultural environments

  • Guevara, Javier
  • Gené Mola, Jordi
  • Gregorio López, Eduard
  • Torres-Torriti, Miguel
  • Reina, Giulio
  • Auat Cheein, Fernando
Global navigation satellite system (GNSS) is the standard solution for solving the localization problem in outdoor environments, but its signal might be lost when driving in dense urban areas or in the presence of heavy vegetation or overhanging canopies. Hence, there is a need for alternative or complementary localization methods for autonomous driving. In recent years, exteroceptive sensors have gained much attention due to significant improvements in accuracy and cost-effectiveness, especially for 3D range sensors. By registering two successive 3D scans, known as scan matching, it is possible to estimate the pose of a vehicle. This work aims to provide in-depth analysis and comparison of the state-of-the-art 3D scan matching approaches as a solution to the localization problem of autonomous vehicles. Eight techniques (deterministic and probabilistic) are investigated: iterative closest point (with three different embodiments), normal distribution transform, coherent point drift, Gaussian mixture model, support vector-parametrized Gaussian mixture and the particle filter implementation. They are demonstrated in long path trials in both urban and agricultural environments and compared in terms of accuracy and consistency. On the one hand, most of the techniques can be successfully used in urban scenarios with the probabilistic approaches that show the best accuracy. On the other hand, agricultural settings have proved to be more challenging with significant errors even in short distance trials due to the presence of featureless natural objects. The results and discussion of this work will provide a guide for selecting the most suitable method and will encourage building of improvements on the identified limitations., This project has been supported by the National Agency of Research and Development (ANID, ex-Conicyt) under Fondecyt grant 1201319, Basal grant FB0008, DGIIP-UTFSM Chile, National Agency for Research and Development (ANID)/PCHA/Doctorado Nacional/2020-21200700, Secretaria d’Universitats i Recerca del Departament d’Empresa i Coneixement de la Generalitat de Catalunya (grant 2017 SGR 646), the Span ish Ministry of Science, Innovation and Universities (project RTI2018- 094222-B-I00) for partially funding this research. The Spanish Ministry of Education is thanked for Mr. J. Gene’s pre-doctoral fellowships (FPU15/03355). We would also like to thank Nufri (especially Santiago Salamero and Oriol Morreres) for their support during data acquisition
Repositori Obert UdL
Publicación Capítulo o parte de un libro (BookPart)

Sensores de conductividad eléctrica aparente para el análisis de la variabilidad del suelo en Agricultura de Precisión

  • Martínez Casasnovas, José Antonio
  • Arnó Satorra, Jaume
  • Escolà i Agustí, Alexandre
Los suelos son un recurso natural fundamental en agricultura, ya que sustentan la vida de las plantas. El conocimiento de sus propiedades y cómo varían en el espacio es fundamental para mantener su productividad y para la toma de decisiones adecuadas sobre su manejo. No obstante, y dadas las características intrínsecas de los suelos de ser entes naturales que se desarrollan en profundidad, los hace difíciles de estudiar y de determinar su variabilidad en un grado de detalle adecuado para aplicaciones en Agricultura de Precisión. No obstante, desde la expansión de las tecnologías de la información geográfica (SIG, Teledetección, GNSS), y de métodos de interpolación espacial, la percepción y la obtención de mapas del suelo o de propiedades de los suelos está cambiando. Así, dentro del ámbito de las técnicas y tecnologías de la Agricultura de Precisión, los sensores que miden la conductividad eléctrica aparente del suelo (CEa) pueden ser una alternativa a tener en cuenta para poder inferir la variabilidad de las propiedades del suelo en cada punto de una parcela agrícola. Estos sensores se utilizan cada vez más para comprender y evaluar cómo varía espacialmente el suelo y también para definir zonas de manejo diferenciado en parcelas agrícolas, tanto en cultivos extensivos como en plantaciones frutícolas. En el presente artículo se explica qué es y qué mide la conductividad eléctrica aparente del suelo y con qué propiedades del suelo se puede correlacionar. También, los dos tipos de sensores que miden la CEa en continuo y que se utilizan en aplicaciones de Agricultura de Precisión: contacto galvánico directo e inducción electromagnética. Finalmente se exponen diversas aplicaciones de esta tecnología llevadas a cabo por el Grupo de Investigación en AgróTICa y Agricultura de Precisión de la Universitat de Lleida y Agrotecnio-CERCA Center en fruticultura, viñedo y cultivos extensivos., Los autores quieren agradecer la financiación obtenida en los proyectos de investigación AgVANCE (AGL2013-48297-C2-2-R, Ministerio de Economía, Industria y Competitividad), LISA-Low Input Sustainable Agriculture (COMRDI16-1-0031, Fondo Europeo de Desarrollo Regional de la Unión Europea), PAgFRUIT (RTI2018-094222-B-I00, Ministerio de Ciencia, Innovación y Universidades), ayuda 2017 SGR 646 (Secretaria d’Universitats i Recerca del Departament d’Empresa i Coneixement de la Generalitat de Catalunya) y el contrato de investigación con la empresa Ventafarinas, S.L., que han hecho posible llevar a cabo la investigación cuyos ejemplos se han mostrado en este artículo. También a los miembros del Grupo de Investigación en AgróTICa y Agricultura de Precisión de la Universitat de Lleida/Agrotecnio-CERCA Center (www.grap.udl.cat) que han participado en estos proyectos.
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

3D Spectral Graph Wavelet Point Signatures in Pre-Processing Stage for Mobile Laser Scanning Point Cloud Registration in Unstructured Orchard Environments

  • Guevara, Javier
  • Gené Mola, Jordi
  • Gregorio López, Eduard
  • Auat Cheein, Fernando
The use of three-dimensional registration techniques is an important component for sensor-based localization and mapping. Several approaches have been proposed to align three-dimensional data, obtaining meaningful results in structured scenarios. However, the increased use of high-frame-rate 3D sensors has lead to more challenging application scenarios here the performance of registration techniques may degrade significantly. In order to improve the accuracy of the procedure, different works have considered a representative subset of points while preserving application-dependent features for registration. In this work, we tackle such a problem, considering the use of a general feature-extraction operator in the spectral domain as a prior step to the registration. The proposed spectral strategies use three wavelet transforms that are evaluated along with four well-known registration techniques. The methodology was experimentally validated in a dense orchard environment. The results show that the probability of failure in registration can be reduced up to 12.04% for the evaluated approaches, leading to a significant increase in the localization accuracy. Those results validate the effectiveness and efficiency of the spectral-assisted registration algorithms in an agricultural setting and motivate their usage for a wider range of applications., This project has been supported by the National Agency of Research and Development (ANID, ex-Conicyt) under Fondecyt grant 1171760, Basal grant FB0008 and National Agency for Research and Devel- opment (ANID)/ PCHA/ Doctorado Nacional/ 2020-21200700. The authors would like to thank to Secretaria d’Universitats i Recerca del Departament d’Empresa i Coneixement de la Generalitat de Catalunya (grant 2017 SGR 646), the Spanish Ministry of Science, Innovation and Universities (project RTI2018-094222-B-I00) for partially funding this research. The Spanish Ministry of Education is thanked for Mr. J. Gene ́’s pre-doctoral fellowships (FPU15/03355). We would also like to thank Nufri (especially Santiago Salamero and Oriol Morreres) for their support during data acquisition.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Analyzing and overcoming the effects of GNSS error on LiDAR based orchard parameters estimation

  • Guevara, Javier
  • Auat Cheein, Fernando
  • Gené Mola, Jordi
  • Rosell Polo, Joan Ramon
  • Gregorio López, Eduard
Currently, 3D point clouds are obtained via LiDAR (Light Detection and Ranging) sensors to compute vegetation parameters to enhance agricultural operations. However, such a point cloud is intrinsically dependent on the GNSS (global navigation satellite system) antenna used to have absolute positioning of the sensor within the grove. Therefore, the error associated with the GNSS receiver is propagated to the LiDAR readings and, thus, to the crown or orchard parameters. In this work, we first describe the error propagation of GNSS over the laser scan measurements. Second, we present our proposal to overcome this effect based only on the LiDAR readings. Such a proposal uses a scan matching approach to reduce the error associated with the GNSS receiver. To accomplish such purpose, we fuse the information from the scan matching estimations with the GNSS measurements. In the experiments, we statistically analyze the dependence of the grove parameters extracted from the 3D point cloud -specifically crown surface area, crown volume, and crown porosity- to the localization error. We carried out 150 trials with positioning errors ranging from 0.01 meters (ground truth) to 2 meters. When using only GNSS as a localization system, the results showed that errors associated with the estimation of vegetation parameters increased more than 100 when positioning error was equal or bigger than 1 meter. On the other hand, when our proposal was used as a localization system, the results showed that for the same case of 1 meter, the estimation of orchard parameters improved in 20 overall. However, in lower positioning errors of the GNSS, the estimation of orchard parameters were improved up to 50% overall. These results suggest that our work could lead to better decisions in agricultural operations, which are based on foliar parameter measurements, without the use of external hardware., This work was partly funded by CONICYT FB0008, CONICYT FONDECYT 1171431, PIIC 030/2018 DGIIP-UTFSM Chile, the Secretaria d’Universitats i Recerca del Departament d’Empresa i Coneixement de la Generalitat de Catalunya (grant 2017 SGR 646), the Spanish Ministry of Science, Innovation and Universities (project RTI2018- 094222-B-I00). The Spanish Ministry of Education is thanked for Mr. J. Gené’s pre-doctoral fellowship (FPU15/03355).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

NDVI from satellite images to estimate LiDAR-derived geometric and structural parameters in super-intensive almond orchards

  • Martínez Casasnovas, José Antonio
  • Llorens Calveras, Jordi
  • Sandonís Pozo, Leire
  • Escolà i Agustí, Alexandre
  • Arnó Satorra, Jaume
The present work tries to bridge a gap about the estimation of geometric and structural orchard parameters (LiDAR-derived) from vegetation indices from satellites. The maximum height and width, the cross-sectional area and the porosity were measured along the rows in a super-intensive almond (Prunus dulcis) orchard every 0.5 m by means of a Velodyne VLP16 LiDAR sensor. These parameters were interpolated to the pixel centroids of PlanetScope and Sentinel-2 and correlated with the normalized difference vegetation index (NDVI) from both platforms. The highest correlations were obtained between the NDVI of PlanetScope images and the cross-sectional area of the almond trees (R=0.72) and with the maximum width of the cross-sections (R=0.71). The results can be useful to estimate important canopy geometric parameters for site-specific management of orchards., This work was funded by the Spanish Ministry of Science, Innovation and Universities through the project PAgFRUIT (RTI2018-094222-B-I00). The authors thank the Copernicus program for the use of Sentinel-2 images and Planet Labs Inc. for the use of PlanetScope images under the Educational and Research License agreement with the Universitat de Lleida.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Delineation of management zones in hedgerow almond orchards based on vegetation indices from UAV images validated by LiDAR-derived canopy parameters

  • Martínez Casasnovas, José Antonio
  • Sandonís Pozo, Leire
  • Escolà i Agustí, Alexandre
  • Arnó Satorra, Jaume
  • Llorens Calveras, Jordi
One of the challenges in orchard management, in particular of hedgerow tree plantations, is the delineation of management zones on the bases of high-precision data. Along this line, the present study analyses the applicability of vegetation indices derived from UAV images to estimate the key structural and geometric canopy parameters of an almond orchard. In addition, the classes created on the basis of the vegetation indices were assessed to delineate potential management zones. The structural and geometric orchard parameters (width, height, cross-sectional area and porosity) were characterized by means of a LiDAR sensor, and the vegetation indices were derived from a UAV-acquired multispectral image. Both datasets summarized every 0.5 m along the almond tree rows and were used to interpolate continuous representations of the variables by means of geostatistical analysis. Linear and canonical correlation analyses were carried out to select the best performing vegetation index to estimate the structural and geometric orchard parameters in each cross-section of the tree rows. The results showed that NDVI averaged in each cross-section and normalized by its projected area achieved the highest correlations and served to define potential management zones. These findings expand the possibilities of using multispectral images in orchard management, particularly in hedgerow plantations., Grant RTI2018-094222-B-I00 (PAgFRUIT project) by MCIN/AEI/10.13039/501100011033 and by “ERDF, a way of making Europe”, by the European Union
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Comparison of 3D scan matching techniques for autonomous robot navigation in urban and agricultural environments

  • Guevara, Javier
  • Gené Mola, Jordi
  • Gregorio López, Eduard
  • Torres-Torriti, Miguel
  • Reina, Giulio
  • Auat Cheein, Fernando
Global navigation satellite system (GNSS) is the standard solution for solving the localization problem in outdoor environments, but its signal might be lost when driving in dense urban areas or in the presence of heavy vegetation or overhanging canopies. Hence, there is a need for alternative or complementary localization methods for autonomous driving. In recent years, exteroceptive sensors have gained much attention due to significant improvements in accuracy and cost-effectiveness, especially for 3D range sensors. By registering two successive 3D scans, known as scan matching, it is possible to estimate the pose of a vehicle. This work aims to provide in-depth analysis and comparison of the state-of-the-art 3D scan matching approaches as a solution to the localization problem of autonomous vehicles. Eight techniques (deterministic and probabilistic) are investigated: iterative closest point (with three different embodiments), normal distribution transform, coherent point drift, Gaussian mixture model, support vector-parametrized Gaussian mixture and the particle filter implementation. They are demonstrated in long path trials in both urban and agricultural environments and compared in terms of accuracy and consistency. On the one hand, most of the techniques can be successfully used in urban scenarios with the probabilistic approaches that show the best accuracy. On the other hand, agricultural settings have proved to be more challenging with significant errors even in short distance trials due to the presence of featureless natural objects. The results and discussion of this work will provide a guide for selecting the most suitable method and will encourage building of improvements on the identified limitations., This project has been supported by the National Agency of Research and Development (ANID, ex-Conicyt) under Fondecyt grant 1201319, Basal grant FB0008, DGIIP-UTFSM Chile, National Agency for Research and Development (ANID)/PCHA/Doctorado Nacional/2020-21200700, Secretaria d’Universitats i Recerca del Departament d’Empresa i Coneixement de la Generalitat de Catalunya (grant 2017 SGR 646), the Span ish Ministry of Science, Innovation and Universities (project RTI2018- 094222-B-I00) for partially funding this research. The Spanish Ministry of Education is thanked for Mr. J. Gene’s pre-doctoral fellowships (FPU15/03355). We would also like to thank Nufri (especially Santiago Salamero and Oriol Morreres) for their support during data acquisition
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Fruit detection and 3D location using instance segmentation neural networks and SfM photogrammetry

  • Gregorio López, Eduard
  • Sanz Cortiella, Ricardo
  • Rosell Polo, Joan Ramon
  • Morros Rubió, Josep Ramon
  • Ruiz Hidalgo, Javier
  • Vilaplana Besler, Verónica
  • Gregorio López, Eduard
The development of remote fruit detection systems able to identify and 3D locate fruits provides opportunities to improve the effi-ciency of agriculture management. Most of the current fruit detec-tion systems are based on 2D image analysis. Although the use of 3D sensors is emerging, precise 3D fruit location is still a pending issue. This work presents a new methodology for fruit detection and 3D location, combining the use of instance segmentation neu-ral networks and Structure-from-Motion (SfM) photogrammetry., This work was partly funded by the Secretaria d’Universitats i Recerca de la Gener-alitat de Catalunya (grant 2017 SGR 646), the Spanish Ministry of Economy and Competitiveness (projects AGL2013-48297-C2-2-R and TEC2016-75976-R) and the Spanish Ministry of Science, Innovation and Universities (project RTI2018-094222-B-I00). The Spanish Ministry of Education is thanked for Mr. J. Gené’s pre-doctoral fellowships (FPU15/03355).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Multi-beam LiDAR-derived data analysis for optimal canopy 3D monitoring in super-intensive almond (Prunus dulcis) orchards

  • Llorens Calveras, Jordi
  • Alsina Tehàs, Albert
  • Arnó Satorra, Jaume
  • Martínez Casasnovas, José Antonio
  • Escolà i Agustí, Alexandre
An analysis of data obtained by a LiDAR sensor was carried out. The sensor uses 16 laser beams and was moved along super-intensive almond orchard alleyways to obtain a 3D point cloud. Different beam combinations were used to obtain three geometrical crop parameters: canopy height, width and cross-sectional area. The parameters were computed using a single central beam, a combination of the two outer beams and all 16 beams. The results showed statistically significant differences in width and cross-sectional area when using one, two or sixteen beams. The more the laser beams considered, the larger the canopy width and cross-sectional area. 28-33% larger width was obtained in comparison to the central beam whereas the cross-sectional area was doubled when all beams were considered., This work was funded by the Spanish Ministry of Science, Innovation and Universities through the project PAgFRUIT (RTI2018-094222-B-I00). Also this work was supported by Secretaria d’Universitats i Recerca del Departament d’Empresa i Coneixement de la Generalitat de Catalunya under Grant 2017-SGR-646.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

A systematic analysis of scan matching techniques for localization in dense orchards

  • Guevara, Javier
  • Gené Mola, Jordi
  • Gregorio López, Eduard
  • Auat Cheein, Fernando
In recent years, different methods have been studied to determine machinery position within a grove, as an alternative for complementing GNSS (global navigation satellite system) information in cases where GNSS signal is occluded. Such a situation can be observed when agricultural machinery travels under dense foliage or on the slopes of mountains. Scan matching techniques arise as a possible solution for localizing the machinery, complementing the absence of the GNSS signal when necessary. However, since key points are difficult to obtain in heterogeneous, unstructured and non-rigid environments (such as orchard plants), the performance of scan matching techniques often decreases in agricultural environments. This paper suggests dividing the point clouds into horizontal and vertical segments to improve the performance of scan-matching methods in orchards. It also examines the best way for registered frames to overlap. We validate the analysis with extensive experimentation in a Fuji apple orchard. The results show that the cumulative localization error in scan matching techniques can be notoriously decreased with selective parts of the orchard, by up to 60%. The experimentation performed herein suggests that the proposed methodology can complement the GNSS navigation in a middle-long path., This work was partly funded by ANID FB0008, PIIC 030/2018 DGIIP-UTFSM Chile, the Secretaria d'Universitats i Recerca del Departament d'Empresa i Coneixement de la Generalitat de Catalunya (grant 2017 SGR 646), the Spanish Ministry of Science, Innovation and Universities (project RTI2018-094222-B-I00). This work is also part of the DIGIFRUIT project (grant TED2021-131871B-I00) funded by MICIU/AEI/10.13039/501100011033 and by the European Union NextGenerationEU/PRTR. The Spanish Ministry of Education is thanked for Mr. J. Gené's pre-doctoral fellowships (FPU15/03355).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Assessing the Performance of RGB-D Sensors for 3D Fruit Crop Canopy Characterization under Different Operating and Lighting Conditions

  • Gené Mola, Jordi
  • Llorens Calveras, Jordi
  • Rosell Polo, Joan Ramon
  • Gregorio López, Eduard
  • Arnó Satorra, Jaume
  • Solanelles Batlle, Francesc
  • Martínez Casasnovas, José Antonio
  • Escolà i Agustí, Alexandre
The use of 3D sensors combined with appropriate data processing and analysis has provided tools to optimise agricultural management through the application of precision agriculture. The recent development of low-cost RGB-Depth cameras has presented an opportunity to introduce 3D sensors into the agricultural community. However, due to the sensitivity of these sensors to highly illuminated environments, it is necessary to know under which conditions RGB-D sensors are capable of operating. This work presents a methodology to evaluate the performance of RGB-D sensors under different lighting and distance conditions, considering both geometrical and spectral (colour and NIR) features. The methodology was applied to evaluate the performance of the Microsoft Kinect v2 sensor in an apple orchard. The results show that sensor resolution and precision decreased significantly under middle to high ambient illuminance (>2000 lx). However, this effect was minimised when measurements were conducted closer to the target. In contrast, illuminance levels below 50 lx affected the quality of colour data and may require the use of artificial lighting. The methodology was useful for characterizing sensor performance throughout the full range of ambient conditions in commercial orchards. Although Kinect v2 was originally developed for indoor conditions, it performed well under a range of outdoor conditions., This research was funded by the Spanish Ministry of Economy and Competitiveness and the Ministry of Science, Innovation and Universities through the program Plan Estatal I+D+i Orientada a los Retos de la Sociedad, grant numbers AGL2013-48297-C2-2-R and RTI2018-094222-B-I00, respectively.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Análisis del dosel foliar de setos olivo mediante LiDAR y su relación con la productividad y atributos de calidad del aceite

  • Sandonís Pozo, Leire
  • Arnó Satorra, Jaume
  • Rufat i Lamarca, Josep
  • Villar Mir, Josep Ma.
  • Martínez Casasnovas, José Antonio
  • Pascual Roca, Miquel
La gestión del cultivo del olivo, particularmente en condiciones superintensivas, es clave para alcanzar la productividad y la calidad del aceite necesarias para mantener las expectativas económicas de las explotaciones. En este sentido, los sensores LiDAR (Light Detection And Ranging) pueden aportar la información necesaria para cuantificar las características geométricas y estructurales del dosel foliar de las plantaciones. El presente trabajo se ha realizado en una plantación comercial superintensiva de olivo, variedad “Arbequina”, en la que se diseñó un experimento con diferentes dosis de nitrógeno y de riego (desde condiciones deficitarias en diferentes períodos hasta riego completo), cruzado con dosis de N subóptimas y suficientes. Los resultados obtenidos del análisis LiDAR permiten estimar adecuadamente el volumen de los árboles y la porosidad del dosel, pudiendo relacionar estos indicadores con diversos e importantes atributos cuantitativos (producción, crecimiento vegetativo y frondosidad del seto), y cualitativos del aceite obtenido (MUFA, PUFA, estabilidad, polifenoles y esteroles)., Este trabajo ha sido financiado por el Ministerio de Ciencia, Innovación y Universidades a través del Proyecto PAgFRUIT (RTI 2018 -094222 -B-I00).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

R software code to process and extract information from 3D Lidar point clouds

  • Llorens Calveras, Jordi
  • Cabrera Pérez, Carlos
  • Escolà i Agustí, Alexandre
  • Arnó Satorra, Jaume
Poster Proceedings of the 12th European Conference on Precision Agriculture, July 8-11, Montpellier, France. pp. 114-115. e-book publication. SupAgro Montpellier. ISBN 978-2-900792-49-0, In the process of electronic canopy characterization, it is necessary to process efficiently point clouds obtained by means of sensors or other capturing information systems. These point clouds may have different origin but they define the main structural characteristics of the scanned crop. For this reason, a fast, easy-to-configure and precise methodology is necessary to extract such information. The work presented in this poster defines the main features of a procedure carried out with R Software code., This work was partly funded by the Secretaria d’Universitats i Recerca del Departament d’Empresa i Coneixement de la Generalitat de Catalunya and the Spanish Ministry of Economy and Competitiveness under Grants 2017 SGR 646, AGL2013-48297-C2-2-R and RTI2018-094222-B-I00(PAgFRUIT). The work of Jordi Llorens was supported by Spanish Ministry of Economy, Industry and Competitiveness through a postdoctoral position named Juan de la Cierva Incorporació (JDCI-2016-29464_N18003).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Assessing automatic data processing algorithms for RGB-D cameras to predict fruit size and weight in apples

  • Miranda, Juan Carlos
  • Arnó Satorra, Jaume
  • Gené Mola, Jordi
  • Lordan Sanahuja, Jaume
  • Asin Jones, Luis
  • Gregorio López, Eduard
Data acquired using an RGB-D Azure Kinect DK camera were used to assess different automatic algorithms to estimate the size, and predict the weight of non-occluded and occluded apples. The programming of the algorithms included: (i) the extraction of images of regions of interest (ROI) using manual delimitation of bounding boxes or binary masks; (ii) estimating the lengths of the major and minor geometric axes for the purpose of apple sizing; and (iii) predicting the final weight by allometric modelling. In addition to the use of bounding boxes, the algorithms also allowed other post-mask settings (circles, ellipses and rotated rectangles) to be implemented, and different depth options (distance between the RGB-D camera and the fruits detected) for subsequent sizing through the application of the thin lens theory. Both linear and nonlinear allometric models demonstrated the ability to predict apple weight with a high degree of accuracy (R2 greater than 0.942 and RMSE < 16 g). With respect to non-occluded apples, the best weight predictions were achieved using a linear allometric model including both the major and minor axes of the apples as predictors. The mean absolute percentage error (MAPE) ranged from 5.1% to 5.7% with respective RMSE of 11.09 g and 13.02 g, depending to whether circles, ellipses, or bounding boxes were used to adjust fruit shape. The results were therefore promising and open up the possibility of implementing reliable in-field apple measurements in real time. Importantly, final weight prediction error and intermediate size estimation errors (from sizing algorithms) interact but in a way that is not easily quantifiable when weight allometric models with implicit prediction error are used. In addition, allometric models should be reviewed when applied to other apple cultivars, fruit development stages or even for different fruit growth conditions depending on canopy management., This work was partly funded by the Department of Research and Universities of the Generalitat de Catalunya (grants 2017, SGR 646 and 2021 LLAV 00088), by the Spanish Ministry of Science and Innovation / AEI/10.13039/501100011033 / ERDF (grants RTI2018-094222-B-I00 [PAgFRUIT project], PID2021-126648OB-I00 [PAgPROTECT project]) and by the Spanish Ministry of Science and Innovation / AEI/10.13039/ 501100011033 / European Union NextGeneration / PRTR (grantTED2021-131871B-I00 [DIGIFRUIT project]). We would also like to thank the Secretariat of Universities and Research of the Department of Business and Knowledge of the Generalitat de Catalunya and the European Social Fund (ESF) for financing Juan Carlos Miranda’s pre-doctoral fellowship (2020 FI_B 00586). The work of Jordi Gen´e-Mola was supported by the Spanish Ministry of Universities through a Margarita Salas postdoctoral grant funded by the European Union - NextGenerationEU.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

PlanetScope Vegetation Indices to Estimate UAV and LiDAR-derived Canopy Parameters in a Super-Intensive Almond Orchard

  • Sandonís Pozo, Leire
  • Plata Moreno, José Manuel
  • Llorens Calveras, Jordi
  • Escolà i Agustí, Alexandre
  • Pascual Roca, Miquel
  • Martínez Casasnovas, José Antonio
The continuous monitoring of geometric and structural parameters is a key aspect in sustainable and accurate orchard management. Although LiDAR and UAV photogrammetry are widely used to measure canopy architecture, there is still a gap to bridge in the development of software to process this information. The present work tries to estimate the maximum height and width in a hedgerow fruit tree orchard from PlanetScope vegetation indices (NDVI and GNDVI). To analyze the correspondence between geometric parameters and the vegetation indices, LiDAR and UAV point clouds were acquired on two 2021 dates in a super-intensive almond orchard: after mechanical pruning (June) and before harvesting (September). The 3D point clouds were summarized every 0.5 m and the maximum width and height along the rows were calculated and interpolated by means of block kriging to the pixel centroids of the PlanetScope image. These maps were later classified using a k means algorithm in two classes. Results indicate that the NDVI was the best performing index in estimation of maximum height and width on the two analyzed dates. GNDVI obtained its best results in September, when vegetation was fully developed. In conclusion, these vegetation indices could be useful for monitoring canopy geometry in this type of orchard, in particular to decide about pruning intensity., This work is a result of the RTI2018-094222-B-I00 project (PAgFRUIT), granted by MCIN/AEI/10.13039/501100011033 and by “ERDF, a way of making Europe”, by the European Union. The authors also thank Planet Labs Inc. for the use of PlanetScope images under an Educational and Research License agreement; Alrasa Agraria S.L. (Raimat, Spain), the Centre for Technological and Industrial Development (Ministry of Science and Innovation, Spanish Government) and EuroChem Iberia S.A., for providing experimental facilities and/or funds.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Fruit detection and sizing using photonic sensors and artificial intelligence

  • Gené Mola, Jordi
  • Gregorio López, Eduard
  • Sanz Cortiella, Ricardo
  • Escolà i Agustí, Alexandre
  • Rosell Polo, Joan Ramon
The Secretaria d’Universitats i Recerca del Departament d’Economia i Coneixement de la Generalitat de Catalunya, the Spanish Ministry of Education and the Spanish Ministry of Science, Innovation and Universities are thanked the pre-doctoral fellowships 2016FI_B00669, FPU15/03355 and EST18/00487, respectively. The Spanish Ministry of Universities is thanked for the posdoctoral Margarita Salas grant given to Jordi Gené, funded by the European Union-Next Generation EU. The research work was partly funded by the Secretaria d’Universitats i Recerca del Departament d’Empresa i Coneixement de la Generalitat de Catalunya (grant 2017SGR646), the Spanish Ministry of Economy and Competitiveness (project AGL2013-48297-C2-2-R) and the Spanish Ministry of Science, Innovation and Universities (project RTI2018-094222-B-I00).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

LiDAR-derived indices and their relationship with productivity and oil quality attributes in high-density olive orchards

  • Sandonís Pozo, Leire
  • Rufat i Lamarca, Josep
  • Pascual Roca, Miquel
  • Villar Mir, Josep Ma.
  • Arnó Satorra, Jaume
  • Escolà i Agustí, Alexandre
  • Rosell Polo, Joan Ramon
  • Martínez Casasnovas, José Antonio
Optimising the leaf area index (LAI) and light exposure are key aspects to improve yield and quality in highdensity olive orchards. Traditionally, these characteristics are estimated using ceptometers, but this method is both labour intensive and dependent on light conditions, with limitations in effectiveness for precision horticulture management purposes. This study investigates the potential of four LiDAR-derived indices to: i) estimate the LAI and canopy light interception under different fertigation treatments, and ii) to assess their impact on yield and oil quality throughout a growing season in a high-density olive orchard. The treatments included two nitrogen dose rates (N0: 0 kg ha-¹ and N50: 50 kg ha-¹) combined with full irrigation (FI) and deficit irrigation (DI). The results provide strong evidence for the effectiveness of these indices in monitoring canopy response to treatments over time. The N50 and FI treatments increased the LAI and yield but led to poorer light attenuation within the canopy and lower oil quality. In contrast, N0 and DI promoted more light-permeable canopies and improved oil quality, with higher phenolic content, better oxidative stability and improved organoleptic oil attributes. These indices can improve the understanding of canopy light environments, help to optimise management practices, and ultimately improve the sustainability and profitability of intensive olive cultivation., This work was carried out with data acquired in the project IRTA2012–00059-C02–01 funded by Spain’s National Institute for Agricultural and Food Research and Technology, as well as in the projects AGL2010–22304-C04–03 and AGL2013–48297-C2–2-R funded by the Spanish Ministry of Economy and Competitiveness. The study was carried out under the framework of the grants RTI2018–094222-B-I00 (PAgFRUIT project) and PID2021–126648OB-I00 (PAgPROTECT project) through MCIN/AEI/10.13039/501100011033 and the European Union’s “ERDF, a way of making Europe”.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

LFuji-air dataset: annotated 3D LiDAR point clouds of Fuji apple trees for fruit detection scanned under different forced air flow conditions

  • Gené Mola, Jordi
  • Gregorio López, Eduard
  • Auat Cheein, Fernando
  • Guevara, Javier
  • Llorens Calveras, Jordi
  • Sanz Cortiella, Ricardo
  • Escolà i Agustí, Alexandre
  • Rosell Polo, Joan Ramon
This article presents the LFuji-air dataset, which contains LiDAR based point clouds of 11 Fuji apples trees and the corresponding apples location ground truth. A mobile terrestrial laser scanner (MTLS) comprised of a LiDAR sensor and a real-time kinematics global navigation satellite system was used to acquire the data. The MTLS was mounted on an air-assisted sprayer used to generate different air flow conditions. A total of 8 scans per tree were performed, including scans from different LiDAR sensor positions (multi-view approach) and under different air flow conditions. These variability of the scanning conditions allows to use the LFuji-air dataset not only for training and testing new fruit detection algorithms, but also to study the usefulness of the multi-view approach and the application of forced air flow to reduce the number of fruit occlusions. The data provided in this article is related to the research article entitled 'Fruit detection, yield prediction and canopy geometric characterization using LiDAR with forced air flow' [1]., This work was partly funded by the Secretaria d’Universitats i Recerca del Departament d'Empresa i Coneixement de la Generalitat de Catalunya (grant 2017 SGR 646), the Spanish Ministry of Economy and Competitiveness (project AGL2013-48297-C2-2-R) and the Spanish Ministry of Science, Innovation and Universities (project RTI2018-094222-B-I00). The Spanish Ministry of Education is thanked for Mr. J. Gené's pre-doctoral fellowships (FPU15/03355). The work of Jordi Llorens was supported by the Spanish Ministry of Economy, Industry and Competitiveness through a postdoctoral position named Juan de la Cierva Incorporación (JDCI-2016-29464_N18003). We would also like to thank CONICYT FONDECYT 1171431 and CONICYT FB0008.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Simultaneous fruit detection and size estimation using multitask deep neural networks

  • Ferrer Ferrer, Mar
  • Ruiz Hidalgo, Javier
  • Gregorio López, Eduard
  • Vilaplana Besler, Verónica
  • Morros Rubió, Josep Ramon
  • Gené Mola, Jordi
The measurement of fruit size is of great interest to estimate the yield and predict the harvest resources in advance. This work proposes a novel technique for in-field apple detection and measurement based on Deep Neural Networks. The proposed framework was trained with RGB-D data and consists of an end-to-end multitask Deep Neural Network architecture specifically designed to perform the following tasks: 1) detection and segmentation of each fruit from its surroundings; 2) estimation of the diameter of each detected fruit. The methodology was tested with a total of 15,335 annotated apples at different growth stages, with diameters varying from 27 mm to 95 mm. Fruit detection results reported an F1-score for apple detection of 0.88 and a mean absolute error of diameter estimation of 5.64 mm. These are state-of-the-art results with the additional advantages of: a) using an end-to-end multitask trainable network; b) an efficient and fast inference speed; and c) being based on RGB-D data which can be acquired with affordable depth cameras. On the contrary, the main disadvantage is the need of annotating a large amount of data with fruit masks and diameter ground truth to train the model. Finally, a fruit visibility analysis showed an improvement in the prediction when limiting the measurement to apples above 65% of visibility (mean absolute error of 5.09 mm). This suggests that future works should develop a method for automatically identifying the most visible apples and discard the prediction of highly occluded fruits., This work was partly funded by the Departament de Recerca i Universitats de la Generalitat de Catalunya (grant 2021 LLAV 00088), the Spanish Ministry of Science, Innovation and Universities (grants RTI2018-094222-B-I00[PAgFRUIT project], PID2021-126648OB-I00 [PAgPROTECT project] and PID2020- 117142 GB-I00 [DeeLight project] by MCIN/AEI/10.13039/ 501100011033 and by “ERDF, a way of making Europe”, by the European Union). The work of Jordi Gene Mola was supported by the Spanish Ministry of Universities through a Margarita Salas postdoctoral grant funded by the European Union - NextGenerationEU
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

A new Leafiness-LiDAR index to estimate light interception in intensive olive orchards

  • Sandonís Pozo, Leire
  • Martínez Casasnovas, José Antonio
  • Escolà i Agustí, Alexandre
  • Rosell Polo, Joan Ramon
  • Rufat i Lamarca, Josep
  • Pascual Roca, Miquel
The 14th European Conference on Precision Agriculture, July 2-6, 2023, Bologna, Italy, Canopy light interception constitutes an important yield limiting factor in high density olive orchards. However, its characterisation still implies laborious measurements. A new index, the Leafiness-LiDAR index (LLI), is presented as a LAI estimator. LLI combines LiDAR-derived parameters: Cross-Section and Leafiness from 3D point clouds. To validate the results, photosynthetically active radiation (PAR) measurements, canopy volume, yield and quality parameters were collected and analysed. LLI showed significant correlations both with PAR and canopy volume (r = 0.8) and quality parameters (r = -0.6). LLI may be useful as an early decision canopy monitoring tool in the framework of Precision Fructiculture., This work was carried out with data acquired in the project IRTA2012-00059-C02-01 funded by the Instituto Nacional de Investigación y Tecnología Agraria y Alimentaria, as well as in the projects AGL2010-22304-C04-03 and AGL2013-48297-C2-2-R funded by the Spanish Ministry of Economy and Competitiveness and developed under the frame of the grants RTI2018-094222-B-I00 (PAgFRUIT project) and PID2021-126648OB-I00 (PAgPROTECT project) by MCIN/AEI/10.13039/501100011033 and by “ERDF, a way of making Europe”, by the European Union.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Organic mulches as an alternative for under-vine weed management in Mediterranean irrigated vineyards: Impact on agronomic performance

  • Cabrera Pérez, Carlos
  • Llorens Calveras, Jordi
  • Escolà i Agustí, Alexandre
  • Royo-Esnal, Aritz
  • Recasens i Guinjuan, Jordi
One of the main challenges for organic vineyards is weed management. Weeds tend to compete for water and nutrients, and can cause large yield reductions. Traditional under-vine weed management in organic vineyards consists on mechanical cultivation along the season, which is associated to soil and young vine root damages, and to high fuel consumption. Thus, sustainable alternatives need to be found. Cover crops are becoming common in the last decades due to their multiple benefits in agroecosystems. Nevertheless, under-vine cover crop implementation in Mediterranean vineyards is limited as this competes for resources (water and nutrients), reducing the yield, vegetative development, and grape size of vines. The use of organic mulches could overcome all these problems, while benefitting vine performance. In the present work, the response of vines, soil and weeds to mulching was evaluated. An experiment was carried out in Raimat, Lleida (Catalonia, NE Spain) in a commercial vineyard from 2019 to 2021, and the following treatments applied: 1) mechanical cultivation with an in-row tiller; 2) mowing a permanent spontaneous cover with an in-row mower; 3) almond shell mulch; and 4) chopped pine wood mulch. Results showed lower weed cover along the three seasons in mulched treatments, as well as higher yield, better vine water status, and greater vegetative development from traditional measurement. The latter was confirmed by and analised with further detail with measurements acquired with a mobile terrestrial laser scanner (MTLS) based on light detection and ranging (LiDAR) sensors. Besides, petiole nutrient status was better in vines without a spontaneous living cover. Organic mulches improved vine performance and weed control, so these results allow to optimize water use efficiency in the Mediterranean basin with scarce water resources. Mulching can be considered as a useful strategy that enhances a more sustainable viticulture., This work has been supported by the Spanish State Research Agency (AEI) and the European Regional Development Fund (ERDF) through the Projects AGL2017-83325-C4-2-R and RTI2018-094222-B-I00 (PAgFRUIT), by the Agency for Administration of University and Research Grants (Generalitat de Catalunya, Spain) under the Project 2017 SGR 00646, and also by the Centre for Technological and Industrial Development (CDTI). The first author obtained a PhD grant from the University of Lleida (PhD grants). Second author contract is supported by a Jaume Serra Húnter Programme promoted by Generalitat de Catalunya.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Looking behind occlusions: A study on amodal segmentation for robust on-tree apple fruit size estimation

  • Gené Mola, Jordi
  • Ferrer Ferrer, Mar
  • Gregorio López, Eduard
  • Blok, Pieter
  • Hemming, Jochen
  • Morros Rubió, Josep Ramon
  • Rosell Polo, Joan Ramon
  • Vilaplana Besler, Verónica
  • Ruiz Hidalgo, Javier
The detection and sizing of fruits with computer vision methods is of interest because it provides relevant information to improve the management of orchard farming. However, the presence of partially occluded fruits limits the performance of existing methods, making reliable fruit sizing a challenging task. While previous fruit segmentation works limit segmentation to the visible region of fruits (known as modal segmentation), in this work we propose an amodal segmentation algorithm to predict the complete shape, which includes its visible and occluded regions. To do so, an end-to-end convolutional neural network (CNN) for sim ultaneous modal and amodal instance segmentation was implemented. The predicted amodal masks were used to estimate the fruit diameters in pixels. Modal masks were used to identify the visible region and measure the distance between the apples and the camera using the depth image. Finally, the fruit diameters in millimetres (mm) were computed by applying the pinhole camera model. The method was developed with a Fuji apple dataset consisting of 3925 RGB-D images acquired at different growth stages with a total of 15,335 annotated apples, and was subsequently tested in a case study to measure the diameter of Elstar apples at different growth stages. Fruit detection results showed an F1-score of 0.86 and the fruit diameter results reported a mean absolute error (MAE) of 4.5 mm and R2 = 0.80 irrespective of fruit visibility. Besides the diameter estimation, modal and amodal masks were used to automatically determine the percentage of visibility of measured apples. This feature was used as a confidence value, improving the diameter estimation to MAE = 2.93 mm and R2 = 0.91 when limiting the size estimation to fruits detected with a visibility higher than 60%. The main advantages of the present methodology are its robustness for measuring partially occluded fruits and the capability to determine the visibility percentage. The main limitation is that depth images were generated by means of photogrammetry methods, which limits the efficiency of data acquisition. To overcome this limitation, future works should consider the use of commercial RGB-D sensors. The code and the dataset used to evaluate the method have been made publicly available at https://github.com/GRAP-UdL-AT/Amodal_Fruit_Sizing., This work was partly funded by the Departament de Recerca i Universitats de la Generalitat de Catalunya (grant 2021 LLAV 00088), the Spanish Ministry of Science, Innovation and Universities (grants RTI2018-094222-B-I00 [PAgFRUIT project], PID2021-126648OB-I00 [PAgPROTECT project] and PID2020-117142GB-I00 [DeeLight project] by MCIN/AEI/10.13039/501100011033 and by “ERDF, a way of making Europe”, by the European Union). The work of Jordi Gen´e Mola was supported by the Spanish Ministry of Universities through a Margarita Salas postdoctoral grant funded by the European Union - NextGenerationEU. We would also like to thank Nufri (especially Santiago Salamero and Oriol Morreres) for their support during data acquisition, and Pieter van Dalfsen and Dirk de Hoog from Wageningen University & Research for additional data collection used in the case study.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

AKFruitYield: Modular benchmarking and video analysis software for Azure Kinect cameras for fruit size and fruit yield estimation in apple orchards

  • Miranda, Juan Carlos
  • Arnó Satorra, Jaume
  • Gené Mola, Jordi
  • Fountas, Spyros
  • Gregorio López, Eduard
AKFruitYield is a modular software that allows orchard data from RGB-D Azure Kinect cameras to be processed for fruit size and fruit yield estimation. Specifically, two modules have been developed: i) AK_SW_BENCHMARKER that makes it possible to apply different sizing algorithms and allometric yield prediction models to manually labelled color and depth tree images; and ii) AK_VIDEO_ANALYSER that analyses videos on which to automatically detect apples, estimate their size and predict yield at the plot or per hectare scale using the appropriate algorithms. Both modules have easy-to-use graphical interfaces and provide reports that can subsequently be used by other analysis tools., This work was partly funded by the Department of Research and Universities of the Generalitat de Catalunya (grants 2017 SGR 646) and by the Spanish Ministry of Science and Innovation/AEI/10.13039/501100011033/ERDF (grant RTI2018–094222-B-I00 [PAgFRUIT project] and PID2021–126648OB-I00 [PAgPROTECT project]). The Secretariat of Universities and Research of the Department of Business and Knowledge of the Generalitat de Catalunya and European Social Fund (ESF) are also thanked for financing Juan Carlos Miranda's pre-doctoral fellowship (2020 FI_B 00586). The work of Jordi Gené-Mola was supported by the Spanish Ministry of Universities through a Margarita Salas postdoctoral grant funded by the European Union - NextGenerationEU. The authors would also like to thank the Institut de Recerca i Tecnologia Agroalimentàries (IRTA) for allowing the use of their experimental fields, and in particular Dr. Luís Asín and Dr. Jaume Lordán who have contributed to the success of this work.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Assessment of different N treatments in Hedgerow Almond Orchards by means of LiDAR point clouds

  • Sandonís Pozo, Leire
  • Llorens Calveras, Jordi
  • Escolà i Agustí, Alexandre
  • Arnó Satorra, Jaume
  • Pascual Roca, Miquel
  • Martínez Casasnovas, José Antonio
Monitoring of canopy status in fruit tree orchards allows better decisions in the canopy management, such as pruning or fertirrigation. LiDAR is an effective tool to acquire accurate 3D geometric and structural data, such as height, width, volume or canopy porosity, among others. In the present work, a super-intensive almond orchard (Prunus Dulcis) with 8 different N treatments (N50, N100, N150, NStop: N100 only in Fase I and with and without DMPSA nitrification inhibitor in 24 rows and 3 blocks, was scanned during three years (2019-21) in two different vegetative stages (after spring pruning and before harvesting) by means of a terrestrial LiDAR scanner. Canopy parameters such maximum height and width, cross section and porosity were summarized from the LiDAR 3D point cloud every 0.5 m along the almond tree hedgerows. A repeated measure mixed statistical model was applied to each parameter in order to assess the effect of the N treatments. The adjusted R2 ranged from 0.73 of the canopy width to 0.83 of the porosity. Canopy parameters and their main interactions with the different treatments were significantly differentiated. The N100+DMPSA treatment was the one favoring higher canopy development (higher cross sections and widths, and less porosity), while the NStop+DMPSA treatment was related to lower canopy development and higher porosity., This work was funded by the Spanish Ministry of Science, Innovation and Universities through the project PAgFRUIT (RTI2018-094222 -B-I00). Also this work was supported by Secretaria d’Universitats i Recercadel del Departament d’Empresa i Coneixement de la Generalitat Generalitat de Catalunya under Grant 2017-SGR-646.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Estimation of geometric and structural parameters in a super-intensive almond (Prunus dulcis) orchard from multispectral vegetation indices derived from UAV-based imagery

  • Llorens Calveras, Jordi
  • Escolà i Agustí, Alexandre
  • Casañas, E.
  • Rosell Polo, Joan Ramon
  • Arnó Satorra, Jaume
  • Martínez Casasnovas, José Antonio
Canopy geometric and structural parameters in a super-intensive almond (Prunus dulcis) orchard were estimated from multispectral vegetation indices from very high-resolution UAV images (0.07 m/pixel). As ground truth data, the canopy geometric and structural parameters were extracted from a 3D LiDAR point cloud. These data were summarized every 0.5 m along the tree rows. The vegetation indices CCCI, NDRE, NDVI, GNDVI and WDRVI were calculated and summarized at the same points as the LiDAR data. The highest correlations (R>0.70) were obtained between the NDVI and the maximum width and the cross-sectional area. The porosity was negatively correlated (R=-0.59) with the NDVI. This research opens the opportunity of using remotely sensed vegetation indices to estimate canopy geometric and structural parameters in addition to vigour for precise canopy management., This work was funded by the Spanish Ministry of Science, Innovation and Universities through the project PAgFRUIT (RTI2018-094222-B-I00).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Fruit detection, yield prediction and canopy geometric characterization using LiDAR with forced air flow

  • Gené Mola, Jordi
  • Gregorio López, Eduard
  • Auat Cheein, Fernando
  • Guevara, Javier
  • Llorens Calveras, Jordi
  • Sanz Cortiella, Ricardo
  • Escolà i Agustí, Alexandre
  • Rosell Polo, Joan Ramon
Yield monitoring and geometric characterization of crops provide information about orchard variability and vigor, enabling the farmer to make faster and better decisions in tasks such as irrigation, fertilization, pruning, among others. When using LiDAR technology for fruit detection, fruit occlusions are likely to occur leading to an underestimation of the yield. This work is focused on reducing the fruit occlusions for LiDAR-based approaches, tackling the problem from two different approaches: applying forced air flow by means of an air-assisted sprayer, and using multi-view sensing. These approaches are evaluated in fruit detection, yield prediction and geometric crop characterization. Experimental tests were carried out in a commercial Fuji apple (Malus domestica Borkh. cv. Fuji) orchard. The system was able to detect and localize more than 80% of the visible fruits, predict the yield with a root mean square error lower than 6% and characterize canopy height, width, cross-section area and leaf area. The forced air flow and multi-view approaches helped to reduce the number of fruit occlusions, locating 6.7% and 6.5% more fruits, respectively. Therefore, the proposed system can potentially monitor the yield and characterize the geometry in apple trees. Additionally, combining trials with and without forced air flow and multi-view sensing presented significant advantages for fruit detection as they helped to reduce the number of fruit occlusions., This work was partly funded by the Secretaria d’Universitats i Recerca del Departament d’Empresa i Coneixement de la Generalitat de Catalunya (grant 2017 SGR 646), the Spanish Ministry of Economy and Competitiveness (project AGL2013-48297-C2-2-R) and the Spanish Ministry of Science, Innovation and Universities (project RTI2018-094222-B-I00). The Spanish Ministry of Education is thanked for Mr. J. Gené’s pre-doctoral fellowships (FPU15/03355). The work of Jordi Llorens was supported by the Spanish Ministry of Economy, Industry and Competitiveness through a postdoctoral position named Juan de la Cierva Incorporación (JDCI-2016-29464_N18003). We would also like to thank CONICYT FONDECYT 1171431 and CONICYT FB0008. Nufri (especially Santiago Salamero and Oriol Morreres) and Vicens Maquinària Agrícola S.A. are also thanked for their support during data acquisition, and Ernesto Membrillo and Roberto Maturino for their support in dataset labelling.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Video-based fruit detection and tracking: effects of scanning conditions on fruit load estimation

  • Felip-Pomés, , Marc
  • Gené Mola, Jordi
  • Arnó Satorra, Jaume
  • Lordan Sanahuja, Jaume
  • Ruiz Hidalgo, Javier
  • Morros Rubió, Josep Ramon
  • Arasanz-Malo,Miguel
  • Net Barnés, Francesc
  • Gregorio López, Eduard
Automated fruit counting and yield estimation systems are necessary for efficient orchard management. This study presents a computer vision system based on video multi-object-tracking for fruit load estimation in apple orchards and provides a comprehensive analysis of the system performance under diverse scanning conditions. The system integrates fruit detection, tracking, localization within orchard, and fruit load map generation. Experiments were carried out in an experimental apple orchard containing 420 apple trees. Data was collected with two different RGB-D sensors (Azure Kinect DK and ZED 2) at three different scanning distances (125 cm, 175 cm, and 225 cm) on two different dates prior to the harvest. Comparing the two evaluated sensors, Azure Kinect provided more consistent performance across different dates. Results also show that the longer scanning distance improves accuracy due to seeing the full tree view gives better fruit counts than close partial views. Between the two dates, best results were achieved near harvest due to fruit color at this stage, achieving a Mean Absolute Percentage Error (MAPE) of 6.91 % and a determination coefficient (R2) of 0.733 (using ZED2 sensor at 225 cm distance). Finally, a test comparing scanning from one or both sides of the tree row showed that bilateral scanning improved fruit load estimation at the stretch level by incorporating information from both sides of the canopy. The results of this work demonstrate the effectiveness of the video fruit tracking systems as a useful tool for automating fruit load estimation., This work was partly funded by the Department of Research and Universities of the Generalitat de Catalunya (grants 2017, SGR 646 and 2021 LLAV 00088), by the Spanish Ministry of Science and Innovation /AEI/10.13039/501100011033 / ERDF (grants RTI2018-094222-B-I00 [PAgFRUIT project], PID2021-126648OB-I00 [PAgPROTECT project], PID2024-161868OB-I00 [C3DRUM project], and PID2024-156495OR-C31 [YIELD4CAST]), by the Spanish Ministry of Science and Innovation / AEI/10.13039/501100011033 / European Union NextGeneration / PRTR (grant TED2021-131871B-I00 [DIGIFRUIT project]), and by the Agrotecnio-IRTA Joint Projects Call 2025 (PhotonFruit project). The work of Jordi Gené-Mola was partially supported by the Spanish Ministry of Universities through a Margarita Salas postdoctoral grant funded by the European Union - NextGenerationEU.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Fuji-SfM dataset: A collection of annotated images and point clouds for Fuji apple detection and location using structure-from-motion photogrammetry

  • Gené Mola, Jordi
  • Sanz Cortiella, Ricardo
  • Rosell Polo, Joan Ramon
  • Morros Rubió, Josep Ramon
  • Ruiz Hidalgo, Javier
  • Vilaplana Besler, Verónica
  • Gregorio López, Eduard
The present dataset contains colour images acquired in a commercial Fuji apple orchard (Malus domestica Borkh. cv. Fuji) to reconstruct the 3D model of 11 trees by using structure-from-motion (SfM) photogrammetry. The data provided in this article is related to the research article entitled “Fruit detection and 3D location using instance segmentation neural networks and structure-from-motion photogrammetry” [1]. The Fuji-SfM dataset includes: (1) a set of 288 colour images and the corresponding annotations (apples segmentation masks) for training instance segmentation neural networks such as Mask-RCNN; (2) a set of 582 images defining a motion sequence of the scene which was used to generate the 3D model of 11 Fuji apple trees containing 1455 apples by using SfM; (3) the 3D point cloud of the scanned scene with the corresponding apple positions ground truth in global coordinates. With that, this is the first dataset for fruit detection containing images acquired in a motion sequence to build the 3D model of the scanned trees with SfM and including the corresponding 2D and 3D apple location annotations. This data allows the development, training, and test of fruit detection algorithms either based on RGB images, on coloured point clouds or on the combination of both types of data. Dades primàries associades a l'article http://hdl.handle.net/10459.1/68505, This work was partly funded by the Secretaria d'Universitats i Recerca del Departament d'Empresa i Coneixement de la Generalitat de Catalunya (grant 2017 SGR 646), the Spanish Ministry of Economy and Competitiveness (project AGL2013-48297-C2-2-R) and the Spanish Ministry of Science, Innovation and Universities (project RTI2018-094222-B-I00). Part of the work was also developed within the framework of the project TEC2016-75976-R, financed by the Spanish Ministry of Economy, Industry and Competitiveness and the European Regional Development Fund (ERDF). The Spanish Ministry of Education is thanked for Mr. J. Gené’s pre-doctoral fellowships (FPU15/03355).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Manejo de malas hierbas bajo la línea del viñedo mediante acolchados orgánicos y su efecto sobre el vigor del cultivo

  • Cabrera Pérez, Carlos
  • Llorens Calveras, Jordi
  • Escolà i Agustí, Alexandre
  • Royo-Esnal, Aritz
  • Recasens i Guinjuan, Jordi
En una parcela de viñedo de Raimat (Lleida) cv. ‘Chardonnay’ se estudió, durante la campaña 2019, el efecto de cuatro estrategias de manejo de malas hierbas bajo las cepas: 1) laboreo con intercepas, 2) pases de segadora, 3) acolchado de cáscaras de almendra y 4) acolchado de astillas de pino. Además de la presencia de malas hierbas bajo la línea, se estimó, en nueve cepas distintas y para cada manejo, la longitud de los sarmientos, el potencial hídrico de tallo, el rendimiento y el peso de poda. A su vez, en el mes de julio y agosto se escaneó la parcela con un escáner láser móvil terrestre equipado con sensores LiDAR para la medición del dosel foliar como indicador de vigor. La presencia de malas hierbas fue significativamente menor en los acolchados que en los otros manejos coincidiendo también con diferencias significativas en los otros parámetros. Con acolchados las cepas mostraron mayores valores de longitud de sarmientos, rendimiento, peso de poda y mejor estado hídrico. El sistema basado en LiDAR confirmó estas diferencias a nivel de dosel foliar. Los resultados demuestran que el uso de acolchados orgánicos permite reducir la presencia de malas hierbas y favorecer el vigor de las cepas., Trabajo desarrollado con la financiación de la Agencia Española de Investigación (AEI) con los proyectos AGL2017-83325-C4-2-R y RTI2018-094222-B-I00.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

PFuji-Size dataset: A collection of images and photogrammetry-derived 3D point clouds with ground truth annotations for Fuji apple detection and size estimation in field conditions

  • Gené Mola, Jordi
  • Sanz Cortiella, Ricardo
  • Rosell Polo, Joan Ramon
  • Escolà i Agustí, Alexandre
  • Gregorio López, Eduard
The PFuji-Size dataset is comprised of a collection of 3D point clouds of Fuji apple trees (Malus domestica Borkh. cv. Fuji) scanned at different maturity stages and annotated for fruit detection and size estimation. Structure-from-motion and multi-view stereo techniques were used to generate the 3D point clouds of 6 complete Fuji apple trees containing a total of 615 apples. The resulting point clouds were 3D segmented by identifying the 3D points corresponding to each apple (3D instance segmentation), obtaining a single point cloud for each apple. All segmented apples were labelled with ground truth diameter annotations. Since the data was acquired in field conditions and at different maturity stages, the set includes different fruit diameters -from 26.9 mm to 94.8 mm- and different fruit occlusion percentages due to foliage. In addition, 25 apples were photographed 360° in laboratory conditions, obtaining high resolution 3D point clouds of this sub-set. To the best of the authors' knowledge, this is the first publicly available dataset for apple size estimation in field conditions. This dataset was used to evaluate different fruit size estimation methods in the research article titled 'In-field apple size estimation using photogrammetry-derived 3D point clouds: comparison of 4 different methods considering fruit occlusion' (Gené-Mola et al., 2021)., This work was partly funded by the Secretaria d'Universitats i Recerca del Departament d'Empresa i Coneixement de la Generalitat de Catalunya (grant 2017 SGR 646) and the Spanish Ministry of Economy and Competitiveness (project AGL2013-48297-C2-2-R). Part of the work was founded with the Grant RTI2018-094222-B-I00 (PAgFRUIT project) by MCIN/AEI/10.13039/501100011033 and by ``ERDF, a way of making Europe'', by the European Union. The Spanish Ministry of Education is thanked for Mr. J. Gené's pre-doctoral fellowships (FPU15/03355). We would also like to thank Nufri (especially Santiago Salamero and Oriol Morreres) for their support during data acquisition.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Relationship between yield and tree growth in almond as influenced by nitrogen nutrition

  • Sandonís Pozo, Leire
  • Martínez Casasnovas, José Antonio
  • Llorens Calveras, Jordi
  • Escolà i Agustí, Alexandre
  • Arnó Satorra, Jaume
  • Pascual Roca, Miquel
Understanding the relationship between nitrogen (N), tree growth and yield, can maximize productivity and sustainability. This study analyzed the effect of N on canopy development and its relation with yield in a super-intensive almond orchard in Spain over two seasons. The treatments included 50 kg N ha−1, 100 kg N ha−1, 150 kg N ha−1, and 100 kg N ha−1 applied between 3.1 and 7.7 Growth Stages, and their combinations with a nitrification inhibitor, DMPSA. The canopy was measured using LiDAR technology after pruning in spring and before harvest. Differences were found in canopy parameters comparing early N (Nstop) against N applied along the season. The treatments N50, N100 and N150 resulted in higher cross sections and widths, less porosity and higher yield, fruit set and hull weights. In contrast, Nstop gave higher porosity and higher flower density. DMPSA produced more homogeneous canopies and improved N use efficiency, combined with N100 or N150. These findings provide evidence to support the management of N in super-intensive orchards., This research was funded by Grant RTI2018–094,222-B-I00 (PAgFRUIT project) by MCIN/AEI/10.13039/501,100,011,033 and by the EU’s “ERDF, a way of making Europe”.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Fruit sizing using AI: A review of methods and challenges

  • Miranda, Juan Carlos
  • Gené Mola, Jordi
  • Zude-Sasse, Manuela
  • Tsoulias, Nikos
  • Escolà i Agustí, Alexandre
  • Arnó Satorra, Jaume
  • Rosell Polo, Joan Ramon
  • Sanz Cortiella, Ricardo
  • Martínez Casasnovas, José Antonio
  • Gregorio López, Eduard
Fruit size at harvest is an economically important variable for high-quality table fruit production in orchards and vineyards. In addition, knowing the number and size of the fruit on the tree is essential in the framework of precise production, harvest, and postharvest management. A prerequisite for analysis of fruit in a real-world environment is the detection and segmentation from background signal. In the last five years, deep learning convolutional neural network have become the standard method for automatic fruit detection, achieving F1-scores higher than 90 %, as well as real-time processing speeds. At the same time, different methods have been developed for, mainly, fruit size and, more rarely, fruit maturity estimation from 2D images and 3D point clouds. These sizing methods are focused on a few species like grape, apple, citrus, and mango, resulting in mean absolute error values of less than 4 mm in apple fruit. This review provides an overview of the most recent methodologies developed for in-field fruit detection/counting and sizing as well as few upcoming examples of maturity estimation. Challenges, such as sensor fusion, highly varying lighting conditions, occlusions in the canopy, shortage of public fruit datasets, and opportunities for research transfer, are discussed., his work was partly funded by the Department of Research and Universities of the Generalitat de Catalunya (grants 2017 SGR 646 and 2021 LLAV 00088) and by the Spanish Ministry of Science and Innovation / AEI/10.13039/501100011033 / FEDER (grants RTI2018-094222-B-I00 [PAgFRUIT project] and PID2021-126648OB-I00 [PAgPROTECT project]). The Secretariat of Universities and Research of the Department of Business and Knowledge of the Generalitat de Catalunya and European Social Fund (ESF) are also thanked for financing Juan Carlos Miranda’s pre-doctoral fellowship (2020 FI_B 00586). The work of Jordi Gené-Mola was supported by the Spanish Ministry of Universities through a Margarita Salas postdoctoral grant funded by the European Union - NextGenerationEU.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Gossypol Treatment Restores Insufficient Apoptotic Function of DFF40/CAD in Human Glioblastoma Cells

  • Martínez Escardó, Laura
  • Alemany, Montse
  • Sánchez Osuna, María
  • Sánchez Chardi, Alejandro
  • Roig Martínez, Meritxell
  • Suárez García, Salvio
  • Ruiz Molina, Daniel
  • Vidal, Noemí
  • Plans, Gerard
  • Majós, Carles
  • Ribas i Fortuny, Judit
  • Baltrons, María Antonia
  • Bayascas Ramírez, José Ramón
  • Barcia, Carlos
  • Bruna, Jordi
  • Yuste Mateos, Víctor J. (Víctor José)
Glioblastoma (GBM) is a highly aggressive brain tumor and almost all patients die because of relapses. GBM-derived cells undergo cell death without nuclear fragmentation upon treatment with different apoptotic agents. Nuclear dismantling determines the point-of-no-return in the apoptotic process. DFF40/CAD is the main endonuclease implicated in apoptotic nuclear disassembly. To be properly activated, DFF40/CAD should reside in the cytosol. However, the endonuclease is poorly expressed in the cytosol and remains cumulated in the nucleus of GBM cells. Here, by employing commercial and non-commercial patient-derived GBM cells, we demonstrate that the natural terpenoid aldehyde gossypol prompts DFF40/CAD-dependent nuclear fragmentation. A comparative analysis between gossypol- and staurosporine-treated cells evidenced that levels of neither caspase activation nor DNA damage were correlated with the ability of each compound to induce nuclear fragmentation. Deconvoluted confocal images revealed that DFF40/CAD was almost completely excluded from the nucleus early after the staurosporine challenge. However, gossypol-treated cells maintained DFF40/CAD in the nucleus for longer times, shaping a ribbon-like structure piercing the nuclear fragments and building a network of bridged masses of compacted chromatin. Therefore, GBM cells can fragment their nuclei if treated with the adequate insult, making the cell death process irreversible., This work was supported by grants SAF2017-83206-R funded by MCIN/Government of Spain (to V.J.Y.), SLT008/18/00028 from the CERCA Program/Generalitat de Catalunya (to J.B.), PGC2018-096003-B-I00 funded by MCI/AEI/10.130339/501100011033 and by ERDF A way of making Europe (to C.B.), and RTI2018-098027-B-C21 funded by MCIN/AEI/10.13039/501100011033 and by ERDF A way of making Europe (to D.R.-M.). The ICN2 is supported by the Severo Ochoa Centres of Excellence Program, grant SEV-2017-0706 funded by MCIN/AEI/10.13039/501100011033. The ICN2 is under the CERCA Program/Generalitat de Catalunya. L.M.-E. was recipient of a “Personal Investigador en Formació” fellow (BQ-2016-2) from Universitat Autònoma de Barcelona, and later supported by Oncobell program (IDIBELL).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Video-Based Fruit Detection and Tracking for Apple Counting and Mapping

  • Gené Mola, Jordi
  • Felip Pomés, Marc
  • Net Barnés, Francesc
  • Morros Rubió, Josep Ramon
  • Miranda, Juan Carlos
  • Arnó Satorra, Jaume
  • Asin Jones, Luis
  • Lordan Sanahuja, Jaume
  • Ruiz Hidalgo, Javier
  • Gregorio López, Eduard
Automatic fruit counting systems have garnered interest from farmers and agronomists to monitor fruit production, predict yields in advance, and identify production variability across orchards. However, accurately counting fruits poses challenges, particularly due to occlusions. This study proposes a multi-view sensing approach using continuous motion videos captured by a camera moved along the row of trees, followed by fruit detection in all video frames and application of Multi-Object Tracking (MOT) algorithms to prevent double-counting. Three tracking methods, namely SORT, DeepSORT, and ByteTrack, are compared for fruit counting using the YOLOv5x object detector. The methodology is applied to map fruit production in an experimental apple orchard at two different dates: four weeks and one week before harvest. The results demonstrate that ByteTrack (MOTA=0.682; IDF1=0.837; HOTA=0.689) outperforms SORT and DeepSORT, indicating its superior tracking performance. Computational efficiency analysis reveals similar processing times between SORT and ByteTrack (about 15 ms), while DeepSORT requires significantly more processing time per image (128 ms). Fruit counting evaluation shows reasonably accurate yield predictions on both dates, with reduced errors and improved performance closer to the harvest date (MAPE=7.47 %; R2=0.70). The system proves effective in estimating orchard fruit production using computer vision technology, offering valuable insights for yield forecasting. These findings contribute to optimizing fruit production and supporting precision agriculture practices. The code and the dataset have been made publicly available and a video visualization of results is accessible at http://www.grap.udl.cat/en/publications/video_fruit_counting., This work was partly funded by the Departament de Recerca i Universitats de la Generalitat de Catalunya (grant 2021 LLAV 00088), the Spanish Ministry of Science, Innovation and Universities (grants RTI2018-094222-B-I00 [PAgFRUIT project], PID2021-126648OB-I00 [PAgPROTECT project] and PID2020-117142GB-I00 [DeeLight project] by MCIN/AEI/10.13039/501100011033 and by “ERDF, a way of making Europe”, by the European Union). The work of Jordi Gené Mola was supported by the Spanish Ministry of Universities through a Margarita Salas postdoctoral grant funded by the European Union - NextGenerationEU. The Secretariat of Universities and Research of the Department of Business and Knowledge of the Generalitat de Catalunya and European Social Fund (ESF) are also thanked for financing Juan Carlos Miranda’s pre doctoral fellowship (2020 FI_B 00586).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

3D Spectral Graph Wavelet Point Signatures in Pre-Processing Stage for Mobile Laser Scanning Point Cloud Registration in Unstructured Orchard Environments

  • Guevara, Javier
  • Gené Mola, Jordi
  • Gregorio López, Eduard
  • Auat Cheein, Fernando
The use of three-dimensional registration techniques is an important component for sensor-based localization and mapping. Several approaches have been proposed to align three-dimensional data, obtaining meaningful results in structured scenarios. However, the increased use of high-frame-rate 3D sensors has lead to more challenging application scenarios here the performance of registration techniques may degrade significantly. In order to improve the accuracy of the procedure, different works have considered a representative subset of points while preserving application-dependent features for registration. In this work, we tackle such a problem, considering the use of a general feature-extraction operator in the spectral domain as a prior step to the registration. The proposed spectral strategies use three wavelet transforms that are evaluated along with four well-known registration techniques. The methodology was experimentally validated in a dense orchard environment. The results show that the probability of failure in registration can be reduced up to 12.04% for the evaluated approaches, leading to a significant increase in the localization accuracy. Those results validate the effectiveness and efficiency of the spectral-assisted registration algorithms in an agricultural setting and motivate their usage for a wider range of applications., This project has been supported by the National Agency of Research and Development (ANID, ex-Conicyt) under Fondecyt grant 1171760, Basal grant FB0008 and National Agency for Research and Devel- opment (ANID)/ PCHA/ Doctorado Nacional/ 2020-21200700. The authors would like to thank to Secretaria d’Universitats i Recerca del Departament d’Empresa i Coneixement de la Generalitat de Catalunya (grant 2017 SGR 646), the Spanish Ministry of Science, Innovation and Universities (project RTI2018-094222-B-I00) for partially funding this research. The Spanish Ministry of Education is thanked for Mr. J. Gene ́’s pre-doctoral fellowships (FPU15/03355). We would also like to thank Nufri (especially Santiago Salamero and Oriol Morreres) for their support during data acquisition.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Proyecto fin de carrera (BachelorThesis)

Anàlisi de paràmetres vegetatius en plantacions intensives d’ametllers mitjançant diferents tècniques de teledetecció

  • Casañas Bosch, Eva
Des dels inicis de L’agricultura de precisió, aquesta ha tingut més expansió en els cultius extensius, però no tant en fruiters. Així, un dels temes de recerca actual és si és possible obtenir paràmetres estructurals i geomètrics de la vegetació d'una plantació a partir de les imatges multiespectrals. La tecnologia més avançada per a poder obtenir aquests paràmetres és el LiDAR. L'escaneig LiDAR permet obtenir precisió dels paràmetres estructurals i geomètrics de qualsevol cultiu. Entre els principals inconvenients d'aquesta tecnologia és l'elevat cost d'execució i la quantitat de temps que requereix la seva aplicació. En aquest Treball Final de Grau s'ha volgut investigar la correlació dels paràmetres estructurals i geomètrics obtinguts amb el LiDAR amb els índex derivats d’imatges multiespectrals. Els paràmetres calculats, han estat l’amplada màxima, l’alçada, la secció i la porositat en ametllers superintensius. Per a fer-ho, s'han obtingut els paràmetres LiDAR d'un escaneig realitzat a una parcel·la d'ametllers situada en Raimat (Lleida), i s’ha realitzat un vol dron amb una càmera multiespectral, per a poder obtenir les imatges aèries en el mateix període de temps que l'escaneig LiDAR. També s’han obtingut les imatges multiespectrals de les plataformes dels satèl·lits Sentinel-2 i Planet Scope. Els resultats de les comparacions van mostrar que les correlacions entre paràmetres i índexs de vegetació van tenir correlacions màximes del 0,72. Això fa, que de moment, encara segueixi sent necessari realitzar escanejos LiDAR per a poder extreure els paràmetres amb exactitud. També s'ha observat, que és necessària la resolució del dron per a obtenir aquest resultat. Aquest resultat elevat s'ha obtingut mitjançant la normalització dels paràmetres, segons els rang de valors obtinguts, i s'ha obtingut gràcies a realitzar una classificació de la vegetació d’estudi. Finalment, a partir de l’índex de vegetació NDVI calculat a partir de la imatge multiespectral adquirida amb el dron, s’ha dissenyat i pressupostat un servei professional d’aquesta tasca, el qual consisteix en caracteritzar el vigor i estimar l’amplada de la fila de vegetació, la secció i calcular la porositat, ja que aquests són els paràmetres que millor correlació han obtingut en l’estudi., Treball final de grau desenvolupat gràcies al Projecte PAgFRUIT: Tecnologías de agricultura de precisión para optimizar el manejo del dosel foliar y la protección fitosanitaria sostenible en plantaciones frutales del Programa Estatal I+D+i Orientada a los Retos de la Sociedad i finançat pel Ministerio de Ciencia, Innovación y Universidades. Referència del Projecte: RTI2018-094222-B-I00
Recercat. Dipósit de la Recerca de Catalunya
Publicación Proyecto fin de carrera (BachelorThesis)

Prestacions d'una càmera monofocal per a la caracterització d'arbres fruiters des de plataformes aèries i terrestres: mesura de l’NDVI i comparació amb sensors de reflectància

  • Rotés Biosca, Albert
Cada vegada és més comú utilitzar tecnologies per tenir informació rellevant de les parcel·les agrícoles. La tecnologia avança a un ritme frenètic: el què fins fa pocs anys es feia amb costosos satèl·lits ara es pot dur a terme amb un simple dron i una càmera de pocs centenars d’euros. Estem parlant de mesurar i mapar el vigor de cultius extensius i fruiters amb l’índex NDVI, clau des de fa dècades en l’agricultura de precisió. Aquest proporciona informa-ció de l’estat dels vegetals en una escala del 0 a l’1. La tecnologia avança molt, sí, però s’ha de saber utilitzar. En aquest estudi es pretén conèixer en quines condicions ha de funcionar una càmera monofocal NDVI recent sortida al mercat que en principi ha estat dissenyada per funcionar en plataformes aèries(drons). Es desenvolupa un assaig en què s’utilitza aquesta càmera i un sensor de reflectància molt utilitzat, del qual se n’ha demostrat en molts estudis la seva eficàcia, per obtenir diferents tipus de mesures de l’NDVI en una fila d’arbres perer si saber, a partir d’anàlisis estadístics: i) si la càmera funciona correctament, ii) en quines condicions la cà-mera ha de treballar per donar bones lectures de NDVI, iii)comprovar la viabilitat d’obtenir un mapa depunts 3D de NDVI, iv) quines lectures són més interessants conèixer d’una filera d’arbresperers, v) elaborar un estudi d’interès de la utilització d’aquesta tecnologia en Fructicultura de Precisió.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

In-field apple size estimation using photogrammetry-derived 3D point clouds: Comparison of 4 different methods considering fruit occlusions

  • Gené Mola, Jordi
  • Sanz Cortiella, Ricardo
  • Rosell Polo, Joan Ramon
  • Escolà i Agustí, Alexandre
  • Gregorio López, Eduard
In-field fruit monitoring at different growth stages provides important information for farmers. Recent advances have focused on the detection and location of fruits, although the development of accurate fruit size estimation systems is still a challenge that requires further attention. This work proposes a novel methodology for automatic in-field apple size estimation which is based on four main steps: 1) fruit detection; 2) point cloud generation using structure-from-motion (SfM) and multi-view stereo (MVS); 3) fruit size estimation; and 4) fruit visibility estimation. Four techniques were evaluated in the fruit size estimation step. The first consisted of obtaining the fruit diameter by measuring the two most distant points of an apple detection (largest segment technique). The second and third techniques were based on fitting a sphere to apple points using least squares (LS) and M−estimator sample consensus (MSAC) algorithms, respectively. Finally, template matching (TM) was applied for fitting an apple 3D model to apple points. The best results were obtained with the LS, MSAC and TM techniques, which showed mean absolute errors of 4.5 mm, 3.7 mm and 4.2 mm, and coefficients of determination () of 0.88, 0.91 and 0.88, respectively. Besides fruit size, the proposed method also estimated the visibility percentage of apples detected. This step showed an of 0.92 with respect to the ground truth visibility. This allowed automatic identification and discrimination of the measurements of highly occluded apples. The main disadvantage of the method is the high processing time required (in this work 2760 s for 3D modelling of 6 trees), which limits its direct application in large agricultural areas. The code and the dataset have been made publicly available and a 3D visualization of results is accessible at http://www.grap.udl.cat/en/publications/apple_size_estimation_SfM., This work was partly funded by the Secretaria d’Universitats i Recerca del Departament d’Empresa i Coneixement de la Generalitat de Catalunya (grant 2017 SGR 646), the Spanish Ministry of Economy and Competitiveness (project AGL2013-48297-C2-2-R) and the Spanish Ministry of Science, Innovation and Universities (project RTI2018-094222-B-I00). The Spanish Ministry of Education is thanked for Mr. J. Gené’s pre-doctoral fellowships (FPU15/03355). We would also like to thank Nufri (especially Santiago Salamero and Oriol Morreres) for their support during data acquisition.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Fruit detection and 3D location using instance segmentation neural networks and structure-from-motion photogrammetry

  • Gené Mola, Jordi
  • Sanz Cortiella, Ricardo
  • Rosell Polo, Joan Ramon
  • Morros Rubió, Josep Ramon
  • Ruiz Hidalgo, Javier
  • Vilaplana Besler, Verónica
  • Gregorio López, Eduard
The development of remote fruit detection systems able to identify and 3D locate fruits provides opportunities to improve the efficiency of agriculture management. Most of the current fruit detection systems are based on 2D image analysis. Although the use of 3D sensors is emerging, precise 3D fruit location is still a pending issue. This work presents a new methodology for fruit detection and 3D location consisting of: (1) 2D fruit detection and segmentation using Mask R-CNN instance segmentation neural network; (2) 3D point cloud generation of detected apples using structure-from-motion (SfM) photogrammetry; (3) projection of 2D image detections onto 3D space; (4) false positives removal using a trained support vector machine. This methodology was tested on 11 Fuji apple trees containing a total of 1455 apples. Results showed that, by combining instance segmentation with SfM the system performance increased from an F1-score of 0.816 (2D fruit detection) to 0.881 (3D fruit detection and location) with respect to the total amount of fruits. The main advantages of this methodology are the reduced number of false positives and the higher detection rate, while the main disadvantage is the high processing time required for SfM, which makes it presently unsuitable for real-time work. From these results, it can be concluded that the combination of instance segmentation and SfM provides high performance fruit detection with high 3D data precision. The dataset has been made publicly available and an interactive visualization of fruit detection results is accessible at http://www.grap.udl.cat/documents/photogrammetry_fruit_detection.html. Dades primàries associades a l'article http://hdl.handle.net/10459.1/68505, This work was partly funded by the Secretaria d’Universitats i Recerca del Departament d’Empresa i Coneixement de la Generalitat de Catalunya (grant 2017 SGR646), the Spanish Ministry of Economy and Competitiveness (project AGL2013-48297-C2-2-R) and the Spanish Ministry of Science, Innovation and Universities (project RTI2018-094222-B-I00). Part of the work was also developed within the framework of the project TEC2016-75976-R, financed by the Spanish Ministry of Economy, Industry and Competitiveness and the European Regional Development Fund (ERDF). The Spanish Ministry of Educationis thanked for Mr. J.Gené’s pre-doctoral fellowships (FPU15/03355). We would also like to thank Nufri (especially Santiago Salamero and Oriol Morreres) and Vicens Maquinària Agrícola S.A. for their support during data acquisition, and Ernesto Membrillo and Roberto Maturino for their support in dataset labelling.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Apple size estimation using photogrammetry-derived 3D point clouds

  • Gené Mola, Jordi
  • Sanz Cortiella, Ricardo
  • Rosell Polo, Joan Ramon
  • Escolà i Agustí, Alexandre
  • Gregorio López, Eduard
In-field fruit monitoring at different growth stages provides important information for farmers. Recent advances have focused on the detection and location of fruits, although the development of accurate fruit size estimation systems is still a challenge that requires further attention. The present work proposes a novel methodology for in-field measurement of spherical fruits using SfMMVS- based point clouds and considering different percentages of fruit occlusions., This work was partly funded by the Secretaria d’Universitats i Recerca de la Generalitat de Catalunya (grant 2017 SGR 646), the Spanish Ministry of Economy and Competitiveness (projects AGL2013-48297-C2-2-R and TEC2016-75976-R) and the Spanish Ministry of Science, Innovation and Universities (grant RTI2018- 094222-B-I00[PAgFRUIT project] by MCIN/AEI/10.13039/501100011033 and by “ERDF, a way of making Europe”, by the European Union).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

AKFruitData: A dual software application for Azure Kinect cameras to acquire and extract informative data in yield tests performed in fruit orchard environments

  • Miranda, Juan Carlos
  • Gené Mola, Jordi
  • Arnó Satorra, Jaume
  • Gregorio López, Eduard
The emergence of low-cost 3D sensors, and particularly RGB-D cameras, together with recent advances in artificial intelligence, is currently driving the development of in-field methods for fruit detection, size measurement and yield estimation. However, as the performance of these methods depends on the availability of quality fruit datasets, the development of ad-hoc software to use RGB-D cameras in agricultural environments is essential. The AKFruitData software introduced in this work aims to facilitate use of the Azure Kinect RGB-D camera for testing in field trials. This software presents a dual structure that addresses both the data acquisition and the data creation stages. The acquisition software (AK_ACQS) allows different sensors to be activated simultaneously in addition to the Azure Kinect. Then, the extraction software (AK_FRAEX) allows videos generated with the Azure Kinect camera to be processed to create the datasets, making available colour, depth, IR and point cloud metadata. AKFruitData has been used by the authors to acquire and extract data from apple fruit trees for subsequent fruit yield estimation. Moreover, this software can also be applied to many other areas in the framework of precision agriculture, thus making it a very useful tool for all researchers working in fruit growing., This work is a result of the RTI2018-094222-B-I00 project (PAgFRUIT) granted by MCIN/AEI and by the European Regional Development Fund (ERDF). This work was also supported by the Secretaria d’Universitats i Recerca del Departament d’Empresa i Coneixement de la Generalitat de Catalunya under Grant 2017-SGR-646. The Secretariat of Universities and Research of the Department of Business and Knowledge of the Generalitat de Catalunya and Fons Social Europeu (FSE) are also thanked for financing Juan Carlos Miranda’s pre-doctoral fellowship (2020 FI_B 00586). The work of Jordi Gené-Mola was supported by the Spanish Ministry of Universities through a Margarita Salas postdoctoral grant funded by the European Union - NextGenerationEU. The authors would also like to thank the Institut de Recerca i Tecnologia Agroalimentàries (IRTA) for allowing the use of their experimental fields, and in particular Dr. Luís Asín and Dr. Jaume Lordán who have contributed to the success of this work. 
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Aplicaciones de la teledetección en la caracterización de frutales y en la fertilización de cultivos extensivos

  • Martínez Casasnovas, José Antonio
  • Arnó Satorra, Jaume
  • Daniele, Elisa
  • Escolà i Agustí, Alexandre
  • Sandonís Pozo, Leire
  • Llorens Calveras, Jordi
  • Rosell Polo, Joan Ramon
  • Uribeetxebarria Alonso de Armiño, Asier
Proyecto AgVANCE (AGL2013‐48297‐C2‐2‐R), Proyecto PAgFRUIT (RTI2018‐094222‐B‐I00)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Capítulo o parte de un libro (BookPart)

Sensores de conductividad eléctrica aparente para el análisis de la variabilidad del suelo en Agricultura de Precisión

  • Martínez Casasnovas, José Antonio
  • Arnó Satorra, Jaume
  • Escolà i Agustí, Alexandre
Los suelos son un recurso natural fundamental en agricultura, ya que sustentan la vida de las plantas. El conocimiento de sus propiedades y cómo varían en el espacio es fundamental para mantener su productividad y para la toma de decisiones adecuadas sobre su manejo. No obstante, y dadas las características intrínsecas de los suelos de ser entes naturales que se desarrollan en profundidad, los hace difíciles de estudiar y de determinar su variabilidad en un grado de detalle adecuado para aplicaciones en Agricultura de Precisión. No obstante, desde la expansión de las tecnologías de la información geográfica (SIG, Teledetección, GNSS), y de métodos de interpolación espacial, la percepción y la obtención de mapas del suelo o de propiedades de los suelos está cambiando. Así, dentro del ámbito de las técnicas y tecnologías de la Agricultura de Precisión, los sensores que miden la conductividad eléctrica aparente del suelo (CEa) pueden ser una alternativa a tener en cuenta para poder inferir la variabilidad de las propiedades del suelo en cada punto de una parcela agrícola. Estos sensores se utilizan cada vez más para comprender y evaluar cómo varía espacialmente el suelo y también para definir zonas de manejo diferenciado en parcelas agrícolas, tanto en cultivos extensivos como en plantaciones frutícolas. En el presente artículo se explica qué es y qué mide la conductividad eléctrica aparente del suelo y con qué propiedades del suelo se puede correlacionar. También, los dos tipos de sensores que miden la CEa en continuo y que se utilizan en aplicaciones de Agricultura de Precisión: contacto galvánico directo e inducción electromagnética. Finalmente se exponen diversas aplicaciones de esta tecnología llevadas a cabo por el Grupo de Investigación en AgróTICa y Agricultura de Precisión de la Universitat de Lleida y Agrotecnio-CERCA Center en fruticultura, viñedo y cultivos extensivos., Los autores quieren agradecer la financiación obtenida en los proyectos de investigación AgVANCE (AGL2013-48297-C2-2-R, Ministerio de Economía, Industria y Competitividad), LISA-Low Input Sustainable Agriculture (COMRDI16-1-0031, Fondo Europeo de Desarrollo Regional de la Unión Europea), PAgFRUIT (RTI2018-094222-B-I00, Ministerio de Ciencia, Innovación y Universidades), ayuda 2017 SGR 646 (Secretaria d’Universitats i Recerca del Departament d’Empresa i Coneixement de la Generalitat de Catalunya) y el contrato de investigación con la empresa Ventafarinas, S.L., que han hecho posible llevar a cabo la investigación cuyos ejemplos se han mostrado en este artículo. También a los miembros del Grupo de Investigación en AgróTICa y Agricultura de Precisión de la Universitat de Lleida/Agrotecnio-CERCA Center (www.grap.udl.cat) que han participado en estos proyectos.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

AmodalAppleSize_RGB-D dataset: RGB-D images of apple trees annotated with modal and amodal segmentation masks for fruit detection, visibility and size estimation

  • Gené Mola, Jordi
  • Ferrer Ferrer, Mar
  • Hemming, Jochen
  • Dalfsen, Pieter van
  • Hoog, Dirk de
  • Sanz Cortiella, Ricardo
  • Rosell Polo, Joan Ramon
  • Vilaplana Besler, Verónica
  • Ruiz Hidalgo, Javier
  • Gregorio López, Eduard
The present dataset comprises a collection of RGB-D apple tree images that can be used to train and test computer vision-based fruit detection and sizing methods. This dataset encompasses two distinct sets of data obtained from a Fuji and an Elstar apple orchards. The Fuji apple orchard sub-set consists of 3925 RGB-D images containing a total of 15,335 apples annotated with both modal and amodal apple segmentation masks. Modal masks denote the visible portions of the apples, whereas amodal masks encompass both visible and occluded apple regions. Notably, this dataset is the first public resource to incorporate on-tree fruit amodal masks. This pioneering inclusion addresses a critical gap in existing datasets, enabling the development of robust automatic fruit sizing methods and accurate fruit visibility estimation, particularly in the presence of partial occlusions. Besides the fruit segmentation masks, the dataset also includes the fruit size (calliper) ground truth for each annotated apple. The second sub-set comprises 2731 RGB-D images capturing five Elstar apple trees at four distinct growth stages. This sub-set includes mean diameter information for each tree at every growth stage and serves as a valuable resource for evaluating fruit sizing methods trained with the first sub-set. The present data was employed in the research paper titled “Looking behind occlusions: a study on amodal segmentation for robust on-tree apple fruit size estimation”., This work was partly funded by the Departament de Recerca i Universitats de la Generalitat de Catalunya (grant 2021 LLAV 00088 ), the Spanish Ministry of Science, Innovation and Universities (grants RTI2018-094222-B-I00 [PAgFRUIT project], PID2021-126648OB-I00 [PAgPROTECT project] and PID2020-117142GB-I00 [DeeLight project] by MCIN/AEI/10.13039/501100011033 and by “ERDF, a way of making Europe”, by the European Union). Data presented in this paper is also part of a Public Private Partnership project Precisie Tuinbouw, WP Fruit 4.0 (PPS KV 1604-025) and financed by Topsector Tuinbouw & Uitgangsmateriaal and various private companies. The work of Jordi Gené Mola was supported by the Spanish Ministry of Universities through a Margarita Salas postdoctoral grant funded by the European Union - NextGenerationEU. We would also like to thank Nufri (especially Santiago Salamero and Oriol Morreres) for their support during data acquisition.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

A photogrammetry-based methodology to obtain accurate digital ground-truth of leafless fruit trees

  • Lavaquiol Colell, Bernat
  • Sanz Cortiella, Ricardo
  • Llorens Calveras, Jordi
  • Arnó Satorra, Jaume
  • Escolà i Agustí, Alexandre
In recent decades, a considerable number of sensors have been developed to obtain 3D point clouds that have great potential in optimizing management in agriculture through the application of precision agriculture techniques. In order to use the data provided by these sensors, it is essential to know their measurement error. In this paper, a methodology is presented for obtaining a 3D point cloud of a central axis training system defoliated fruit tree (Malus domestica Bork.) obtained from stereophotogrammetry techniques based on structure-from-motion (SfM) and multi-view stereo-photogrammetry (MVS). The point cloud was made from a set of 288 photographs of the scene including the ground truth tree which was used to generate the digital 3D model. The resulting point cloud was validated and proven to faithfully represent reality. The bias of the resulting model is −0.15 mm and 0.05 mm, for diameters and lengths, respectively. In addition, the presented methodology allows small changes in the ground truth actual tree to be detected as a consequence of the wood dehydration process. Having an actual and a digital ground-truth is the basis for validating other sensing systems for 3D vegetation characterization which can be used to obtain data to make more informed management decisions., This research was funded by the Spanish Ministry of Economy and Competitiveness and the Ministry of Science, Innovation and Universities through the program Plan Estatal I+D+i Orientada a los Retos de la Sociedad, Project PAgFRUIT RTI2018-094222-B-I00. In addition, this work was also supported by the Secretaria d’Universitats i Recerca del Departament d’Empresa i Coneixement de la Generalitat de Catalunya under Grant 2017-SGR-646 and under the research grant program BFC2020S - Programa Santander Predocs UdL 2020. We would also like to thank Jaume Badia from Nufri for providing the tree used in this article as ground truth.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Metodología para el análisis de los errores y validación de nubes de puntos 3D obtenidas en campo para la caracterización de la arquitectura de árboles frutales

  • Lavaquiol Colell, Bernat
  • Llorens Calveras, Jordi
  • Sanz Cortiella, Ricardo
  • Gené Mola, Jordi
  • Arnó Satorra, Jaume
  • Gregorio López, Eduard
  • Escolà i Agustí, Alexandre
El estudio de la estructura de la planta (índice de área foliar, porosidad del dosel, densidad foliar, arquitectura leñosa y sistema de entrenamiento) y de su geometría (tamaño, forma y volumen) es básico para realizar un manejo óptimo del cultivo. Antes de la introducción de los sensores 3D, la caracterización precisa de cultivos en 3D era una tarea muy laboriosa que resultaba inviable en grandes cultivos comerciales. Sin embargo, la introducción de nuevos sensores 3D ha supuesto una oportunidad para realizar esta tarea de una forma relativamente sencilla y rápida. Antes de utilizar un sistema de escaneo 3D para caracterizar el dosel, es fundamental conocer su error de medición o precisión. En esta investigación proponemos una metodología para evaluar la precisión de los sensores LiDAR comparando las nubes de puntos 3D basadas en LiDAR con un modelo digital de Ground-Truth (DGT) generado mediante la aplicación de técnicas de fotogrametría. La nube de puntos 3D de la DGT se obtuvo a partir de 288 fotografías de la escena que incluye el árbol Ground-Truth (Malus domestica Bork). La nube de puntos resultante tiene un sesgo de - 0,15 mm de diámetro y 0,05 mm de longitud, por lo que se puede considerar que la DGT representa fielmente la realidad. Este DGT es utilizado posteriormente para validar la nube de puntos generada por un sistema mobile terrestrial laser scanner (MTLS) compuesto por un sensor VLP-16 Velodyne LiDAR sincronizado con un sistema de posicionamiento GNSS-RTK. El MTLS se condujo a velocidades de 0,14 m/s y 0,55 m/s. Se obtuvo un error promedio de 4,3 cm y 4,4 cm, respectivamente. El número de puntos obtenidos a 0,14 m/s fue de 50 051 puntos y a 0,55 m/s de 12 503 puntos. A pesar de tener un error de medición bajo cuando se escanea a ambas velocidades, se obtiene una densidad de puntos óptima cuando se escanea a 0,14 m/s y pobre cuando se escanea a 0,55 m/s. De estos resultados se concluye que el error obtenido con el sensor Velodyne VLP-16 se considera aceptable en aplicaciones agronómicas., This research was funded by the Spanish Ministry of Economy and Competitiveness and the Ministry of Science, Innovation and Universities through the program Plan Estatal I+D+i Orientada a los Retos de la Sociedad, Project PAgFRUIT RTI2018-094222-B-I00.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Satellite multispectral indices to estimate canopy parameters and within‑feld management zones in super‑intensive almond orchards

  • Sandonís Pozo, Leire
  • Llorens Calveras, Jordi
  • Escolà i Agustí, Alexandre
  • Arnó Satorra, Jaume
  • Pascual Roca, Miquel
  • Martínez Casasnovas, José Antonio
Continuous canopy status monitoring is an essential factor to support and precisely apply orchard management actions such as pruning, pesticide and foliar treatment applications, or fertirrigation, among others. For that, this work proposes the use of multispectral vegetation indices to estimate geometric and structural orchard parameters from remote sensing images (high temporal and spatial resolution) as an alternative to more time-consuming processing techniques, such as LiDAR surveys or UAV photogrammetry. A super-intensive almond (Prunus dulcis) orchard was scanned using a mobile terrestrial laser (LiDAR) in two diferent vegetative stages (after spring pruning and before harvesting). From the LiDAR point cloud, canopy orchard parameters, including maximum height and width, cross-sectional area and porosity, were summarized every 0.5 m along the rows and interpolated using block kriging to the pixel centroids of PlanetScope (3×3 m) and Sentinel-2 (10×10 m) image grids. To study the association between the LiDAR-derived parameters and 4 diferent vegetation indices. A canonical correlation analysis was carried out, showing the normalized diference vegetation index (NDVI) and the green normalized difference vegetation index (GNDVI) to have the best correlations. A cluster analysis was also performed. Results can be considered optimistic both for PlanetScope and Sentinel-2 images to delimit within-feld management zones, being supported by signifcant diferences in LiDAR-derived canopy parameters.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Low-cost terrestrial photogrammetry for orchard sidewards 3D reconstruction

  • Martínez Casasnovas, José Antonio
  • Rosell Tarragó, Miquel
  • Rosell Polo, Joan Ramon
  • Sanz Cortiella, Ricardo
  • Gregorio López, Eduard
  • Gené Mola, Jordi
  • Arnó Satorra, Jaume
  • Plata Moreno, José Manuel
  • Escolà i Agustí, Alexandre
The present study was part of the grants RTI2018-094222-B-I00 and PID2021-126648OB-I00 (PAgFRUIT and PAgPROTECT projects), funded by MCIN/AEI/10.13039/501100011033 and by “ERDF, a way of making Europe”, by the European Union