Pasar al contenido principal

Resultados relacionados

Resultados totales (Incluyendo duplicados): 48
Encontrada(s) 1 página(s)

e-Archivo. Repositorio Institucional de la Universidad Carlos III de Madrid
Publicación Artículo científico (JournalArticle)

Safe operation of mini UAVs: a review of regulation and best practices

  • Sanz, D.
  • Pereira Valente, João Ricardo
  • Cerro, J. del
  • Colorado, J.
  • Barrientos, A.
This paper is focused on the safety of mini UAV (mUAV) systems. It presents the great efforts that are being done in air legislation, including the present and future normative. Nevertheless, considering that the work is not finished yet, a low-level risk analysis concept is introduced. Based on the international regulations, a specific three-step structure for mUAV hazard analysis is presented: identification, assessment, and reduction in a recursive loop that provides a solid architecture for facing the wide range of possible risks., This work has been supported by the Robotics and Cybernetics Research Group at Technique University of Madrid (Spain), and funded under the projects ‘ROTOS: Multi-Robot system for outdoor infrastructures protection’, sponsored by Spain Ministry of Education and Science (DPI2010-17998), and ’Robot Fleets for Highly Effective Agriculture and Forestry Management’, (RHEA) sponsored by the European Commission’s Seventh Framework Programme (NMP-CP-IP 245986-2 RHEA)., European Community's Seventh Framework Program
e-Archivo. Repositorio Institucional de la Universidad Carlos III de Madrid
Publicación Artículo científico (JournalArticle)

A Multi-Robot Sense-Act Approach to Lead to a Proper Acting in Environmental Incidents

  • Conesa Muñóz, Jesús
  • Pereira Valente, Joao Ricardo
  • Del Cerro, Jaime
  • Barrientos, Antonio
  • Ribeiro, Ángela
Many environmental incidents affect large areas, often in rough terrain constrained by natural obstacles, which makes intervention difficult. New technologies, such as unmanned aerial vehicles, may help address this issue due to their suitability to reach and easily cover large areas. Thus, unmanned aerial vehicles may be used to inspect the terrain and make a first assessment of the affected areas; however, nowadays they do not have the capability to act. On the other hand, ground vehicles rely on enough power to perform the intervention but exhibit more mobility constraints. This paper proposes a multi-robot sense-act system, composed of aerial and ground vehicles. This combination allows performing autonomous tasks in large outdoor areas by integrating both types of platforms in a fully automated manner. Aerial units are used to easily obtain relevant data from the environment and ground units use this information to carry out interventions more efficiently. This paper describes the platforms and sensors required by this multi-robot sense-act system as well as proposes a software system to automatically handle the workflow for any generic environmental task. The proposed system has proved to be suitable to reduce the amount of herbicide applied in agricultural treatments. Although herbicides are very polluting, they are massively deployed on complete agricultural fields to remove weeds. Nevertheless, the amount of herbicide required for treatment is radically reduced when it is accurately applied on patches by the proposed multi-robot system. Thus, the aerial units were employed to scout the crop and build an accurate weed distribution map which was subsequently used to plan the task of the ground units. The whole workflow was executed in a fully autonomous way, without human intervention except when required by Spanish law due to safety reasons., This project was funded in part by the 7th Framework Programme of the European Union under Grant Agreement No. 245986.
idUS. Depósito de Investigación de la Universidad de Sevilla
Publicación Artículo científico (JournalArticle)

Comparison of positional accuracy between RTK and RTX GNSS gased on the autonomous agricultural vehicles under field conditions

  • Carballido, Jacob
  • Pérez Ruiz, Manuel
  • Emmi, L.
  • Agüera Vega, Juan
Currently, many systems (machine vision, high resolution remote sensing, global positioning systems, and odometry techniques) have been integrated into agricultural e quipment to increase the efficiency, productivity, and safety of the individual in all field activities. This study focused upon assessing a satellite-based localization solution used in straight path guidance of an autonomou s vehicle developed for ag ricultural applica tions. The autonom ous agricultural vehicle was designed and constructed under RHEA (Robot fleets for highly effective agriculture and forestry management) project and is part of a three-unit fleet of similar vehicles. Static tests showed that 99% of all positions are placed within a circle with a 2.9 cm radius centered at the geo-position usi ng real-time satellite corrections (RTX). Dynamic tests between rows demonstrated a mean (N=610) of the standard deviation for real-time base station corrections (RTK) of 1.43 cm and for real-time satellite corrections (RTX) of 2.55 cm. These re sults demonstrate that the tractor was able to track each straight line with high degree of accuracy. The integration of a Global Navigation Satellite System (GNSS) with sensors (e.g., inertial sensor, altimeters, odomet ers, etc.) within the vehicle showed th e potential of autonomous tractors for expanding agricultural applications utilizing this technology., European Union FP7/2007-2013
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Otros (Other)

Proceedings of the first International workshop on robotics and associated high-technologies and equipment por agriculture (RHEA-2011), RHEA-2011

  • RHEA Consortium
These proceedings are the result of the work developed by the RHEA consortium throughout the first year of the RHEA project (Robot fleets for highly effective agriculture and forestry management-FP7-NMP 245986). RHEA comprises a number of research centres, universities, and companies funded by the European Commission through the Seventh Framework Programme to develop robotic fleets for weed control and pesticide management in agriculture and forestry., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Otros (Other)

Moisture measurement in crops using spherical robots

  • Hernández Vega, Juan D.
  • Barrientos, Jorge
  • Cerro, Jaime del
  • Barrientos, Antonio
  • Sanz Muñoz, David
[Purpose] The purpose of this paper is to present a new low-cost system based on a spherical robot for performing moisture monitoring in precision agriculture., [Design/methodology/approach] The work arose from the necessity of providing farmers with alternative methods for crop monitoring. Thus, after analysing the main requirements, a spherical robot was chosen as a tentative approach. The presented work summarizes the work carried out in selecting the basics to apply in the robot, as well as its mechanical and electronic design. After designing and constructing the robot, several tests have been performed, in order to validate the robot for performing monitoring task and moving on different types of soil., [Findings]The performed tests reveal that spherical robot is a suitable solution for performing the task., [Research limitations/implications] Some improvements in control should be applied in order to reach a fully autonomous navigation in very slippery soils. Nevertheless, the performance of the robot in teleoperated mode allows validating of the system., [Practical implications] The robot turned out to be friendly and harmless in its use for this application. The cost of final series will be affordable in comparison with the cost of other methods. Endurance of the robot can be considered as fair., [Originality/value] The paper presents a new tool for farming based on non-common robot. © Emerald Group Publishing Limited., This work has been supported by the Robotics and Cybernetics Research Group at Universidad Politécnica de Madrid (Spain), and funded under the project ’Robot Fleets for Highly Effective Agriculture and Forestry Management’, (RHEA) sponsored by the European Commission’s Seventh Framework Programme (NMP-CP-IP 245986-2 RHEA)., Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Otros (Other)

Aerial coverage optimization in precision agriculture management: A musical harmony inspired approach

  • Valente, João
  • Cerro, Jaime del
  • Barrientos, Antonio
  • Sanz Muñoz, David
Preprint submitted to Computers and Electronics in Agriculture, The coverage path planning (CPP) problem belongs to a sub-field of motion planning where the goal is to compute a complete coverage trajectory from initial to final position, within the robot workspace subjected to a set of restrictions. This problem has a complexity NP-complete, and has no general solution. Moreover, there are very few studies addressing this problem applied to aerial vehicles. Previous studies point out that the variable of interest to be optimized is the number of turns. Thus, by minimizing the number of turns, it can be ensured that the mission time is likewise minimized. In this paper, an approach to optimize this cost variable is proposed. This approach uses a quite novel algorithm called Harmony Search (HS). HS is a meta-heuristic algorithm based on jazz musician's improvisation through a pleasant harmony. Finally, the results achieved with this technique are compared with the results obtained with the previous approach found in the literature., ROTOS: Multi-Robot system for outdoor infrastructures protection, sponsored by Spain Ministry of Education and Science (DPI2010-17998), and 'Robot Fleets for Highly Eective Agriculture and Forestry Management', (RHEA) sponsored by the European Commission's Seventh Framework Programme (NMP-CP-IP 245986-2 RHEA). The authors want to thank all the project partners., Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Assessing the accuracy of mosaics from unmanned aerial vehicle (UAV) imagery for precision agriculture purposes in wheat

  • Gómez-Candón, David
  • Castro, Ana Isabel de
  • López Granados, Francisca
High spatial resolution images taken by unmanned aerial vehicles (UAVs) have been shown to have the potential for monitoring agronomic and environmental variables. However, it is necessary to capture a large number of overlapped images that must be mosaicked together to produce a single and accurate ortho-image (also called an ortho-mosaicked image) representing the entire area of work. Thus, ground control points (GCPs) must be acquired to ensure the accuracy of the mosaicking process. UAV ortho-mosaics are becoming an important tool for early site-specific weed management (ESSWM), as the discrimination of small plants (crop and weeds) at early growth stages is subject to serious limitations using other types of remote platforms with coarse spatial resolutions, such as satellite or conventional aerial platforms. Small changes in flight altitude are crucial for low-altitude image acquisition because these variations can cause important differences in the spatial resolution of the ortho-images. Furthermore, a decrease of flying altitude reduces the area covered by each single overlapped image, which implies an increase of both the sequence of images and the complexity of the image mosaicking procedure to obtain an ortho-image covering the whole study area. This study was carried out in two wheat fields naturally infested by broad-leaved and grass weeds at a very early phenological stage. The geometric accuracy differences and crop line alignment among ortho-mosaics created from UAV image series were investigated while taking into account three different flight altitudes (30, 60 and 100 m) and a number of GCPs (from 11 to 45). The results did not show relevant differences in geo-referencing accuracy on the interval of altitudes studied. Similarly, the increase of the number of GCPs did not imply a relevant increase of geo-referencing accuracy. Therefore, the most important parameter to consider when choosing the flying altitude is the ortho-image spatial resolution required rather than the geo-referencing accuracy. Regarding the crop mis-alignment, the results showed that the overall errors were less than twice the spatial resolution, which did not break the crop line continuity at the studied spatial resolutions (pixels from 7.4 to 24.7 mm for 30, 60 and 100 m flying altitudes respectively) on the studied crop (early wheat). The results lead to the conclusion that a UAV flying at a range of 30 to 100 m altitude and using a moderate number of GCPs is able to generate ultra-high spatial resolution ortho-imagesortho-images with the geo-referencing accuracy required to map small weeds in wheat at a very early phenological stage. This is an ambitious agronomic objective that is being studied in a wide research program whose global aim is to create broad-leaved and grass weed maps in wheat crops for an effective ESSWM. © 2013 Springer Science+Business Media New York., This research was partly financed by the AGL2011-30442-CO2-01 Project (Spanish Ministry of Economy and Competition, FEDER Funds) and the RHEA Project (ref.: NMP-CP-IP 245986-2, EU-7th Frame Program). The research by Ms. de Castro was co-financed by CSIC and FEDER funds (JAE-Pre Program)., Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Contribución de congreso (ConferenceOutput)

How the spatial resolution can affect the quality of mosaics and assessment of optimum number of tie points necessary to obtain good quality images

  • Gómez-Candón, David
  • Labbé, Sylvain
  • Jurado-Expósito, Montserrat
  • Peña Barragán, José Manuel
  • Rabatel, Gilles
  • López Granados, Francisca
Ponencia presentada en la First International Workshop On Robotics And Associated High Technologies And Equipment For Agriculture, celebrado en Montpellier (Francia) el 9 de septiembre de 2011., Orthorectification and mosaicing are two important steps in the design of input application strategies for precision agriculture. Images with low spatial resolution and big georreferencing errors are not useful to obtain good quality maps. In this paper we tried to compare the usefulness between two different pieces of software for orthorectificacion and mosaicing of remote images. Furthermore, we studied the spatial resolution requirements and minimum number of tie points/GCPs needed to obtain good quality orthomosaics. These orthomosaics have to be ready to be used to detect weeds in crops and to obtain high precision prescription maps., The research leading to these results has received funding from the European Union’s Seventh Framework Programme [FP7/2007-2013] under Grant Agreement nº 245986., Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Integrating sensory/actuation systems in agricultural vehicles

  • Emmi, Luis Alfredo
  • González-de-Soto, Mariano
  • Pajares, Gerardo
  • González-de-Santos, Pablo
In recent years, there have been major advances in the development of new and more powerful perception systems for agriculture, such as computer-vision and global positioning systems. Due to these advances, the automation of agricultural tasks has received an important stimulus, especially in the area of selective weed control where high precision is essential for the proper use of resources and the implementation of more efficient treatments. Such autonomous agricultural systems incorporate and integrate perception systems for acquiring information from the environment, decision-making systems for interpreting and analyzing such information, and actuation systems that are responsible for performing the agricultural operations. These systems consist of different sensors, actuators, and computers that work synchronously in a specific architecture for the intended purpose. The main contribution of this paper is the selection, arrangement, integration, and synchronization of these systems to form a whole autonomous vehicle for agricultural applications. This type of vehicle has attracted growing interest, not only for researchers but also for manufacturers and farmers. The experimental results demonstrate the success and performance of the integrated system in guidance and weed control tasks in a maize field, indicating its utility and efficiency. The whole system is sufficiently flexible for use in other agricultural tasks with little effort and is another important contribution in the field of autonomous agricultural vehicles. © 2014 by the authors; licensee MDPI, Basel, Switzerland., The research leading to these results has been funded by the European Union’s Seventh Framework Programme (FP7/2007-2013) under Grant Agreement No. 245986. The authors thank all of the RHEA partners for supporting this work in many different ways. Additionally, the authors wish to make a special acknowledgment to Andrea Peruzzi and his research group of the Agricultural Machinery and Farm Mechanization, Department of Agriculture, Food and Environment (DAFE), University of Pisa, Italy, for the confidential information provided. We acknowledge support by the CSIC Open Access Publication Initiative through its Unit of Information Resources for Research (URICI)., Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

A Novel Approach for Weed Type Classification Based on Shape Descriptors and a Fuzzy Decision-Making Method

  • Herrera Caro, Pedro Javier
  • Dorado, José
  • Ribeiro Seijas, Ángela
This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited., An important objective in weed management is the discrimination between grasses (monocots) and broad-leaved weeds (dicots), because these two weed groups can be appropriately controlled by specific herbicides. In fact, efficiency is higher if selective treatment is performed for each type of infestation instead of using a broadcast herbicide on the whole surface. This work proposes a strategy where weeds are characterised by a set of shape descriptors (the seven Hu moments and six geometric shape descriptors). Weeds appear in outdoor field images which display real situations obtained from a RGB camera. Thus, images present a mixture of both weed species under varying conditions of lighting. In the presented approach, four decision-making methods were adapted to use the best shape descriptors as attributes and a choice was taken. This proposal establishes a novel methodology with a high success rate in weed species discrimination., This research was partly financed by the Spanish Ministry of Economy and Competition (AGL2011-30442-C02-02 project) and by the 7th Framework Programme of the European Union under the Grand Agreement CP-IP245986-2 (RHEA project). Research of Herrera was supported by the JAE-Doc Program, financed by the Spanish National Research Council (CSIC) and the European Social Fund (ESF). We acknowledge support by the CSIC Open Access Publication Initiative throught its Unit of Information Resources for Research (URICI)., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Otros (Other)

Distributed multi-level supervision to effectively monitor the operations of a fleet of autonomous vehicles in agricultural tasks

  • Conesa-Muñoz, Jesús
  • González-de-Soto, Mariano
  • González-de-Santos, Pablo
  • Ribeiro Seijas, Ángela
The first video shows a tractor that selectively sprays the weed patches. The tractor trajectory, shown in the left bottom corner, was designed to cover the entire field and try the weed patches, represented in green, with a sprayer bar of 6 m long (12 nozzles). The second video shows two tractors that simultaneously and coordinately cover the same field by following parallel trajectories. The potential collisions during the turns on the headlands (see left bottom corner) are detected and solved by the Supervision System., A supervisor system for monitoring the operation of automated agricultural vehicles has been developed. The system analyses all of the information provided by the sensors and subsystems on the vehicles in real time and notifies the user when a failure or potentially dangerous situation is detected. In some situations, it is even able to execute a neutralising protocol to remedy the failure such as pausing and resuming the vehicles while working. The system is based on a distributed and multi-level architecture that divides the supervision into different subsystems, allowing for better management of the detection and repair of failures. The proposed supervision system performs well in several scenarios, such as spraying canopy treatments against insects and diseases and selective weeds treatments. The system is able to detect failures such as service disruptions, incorrect working speeds, incorrect implement states, and potential collisions. Moreover, the system is able to prevent collisions between vehicles by pausing/resuming the vehicles while working to avoid intersecting trajectories., Sponsorship: - RHEA: Robot fleets for highly effective agriculture and forestry management. Tipo proyecto: 7º Programa Marco; FP7-NMP-2009-LARGE-3, Grant Agreement: 245986; Duración: 2010-2014. - GroW: Sistema de inspección terrestre en vehículos autónomos y su aplicación efectiva a la detección de malas hierbas y su control localizado (GroW). Entidad Financiadora: MINECO, PLAN NACIONAL; AGL2011-30442-C02-02 Duración: 2012-2014., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Highlights and preliminary results for autonomous crop protection

  • Pérez Ruiz, Manuel
  • González-de-Santos, Pablo
  • Ribeiro Seijas, Ángela
  • Fernández-Quintanilla, César
  • Peruzzi, A.
  • Vieri, Marco
  • Tomic, S.
  • Agüera, Juan
© 2014 Elsevier B.V. New technologies are required for safe, site-specific and efficient control of weeds, pathogens and insects in agricultural crops and in forestry. The development and use of autonomous tractors equipped with innovative sensor systems, data processing techniques and actuation tools can be highly beneficial because this technology allows pest control measures to be applied only if, when, and where they are genuinely needed, thus reducing costs, environmental damage and risks to farmers. RHEA (Robotics and associated High-technologies and Equipment for Agriculture) is an EC-funded research project conducted by a consortium composed of 15 research partners from eight European countries. The focus of the project is the design, development and testing of a new generation of automatic and robotic systems for both chemical and physical pest management. A heterogeneous fleet of small, cooperative ground and aerial robots equipped with advanced sensors, enhanced end effectors and improved decision control algorithms will be used. Initially, we are investigating three major scenarios: (a) chemical weed control in winter wheat, (b) thermal weed control (i.e., flaming) in maize and (c) variable applications of pesticides in olive crops. A preliminary system evaluation demonstrated that the intelligent sprayer boom applied the control agent to over 95% of the target area and that the response time, 10s, of the direct-injection system was anticipated in the sprayer system to ensure the accuracy of herbicide spraying. Field trial results showed that the estimated cost for site-specific flame weeding was approximately 24€ha-1, whereas approximately 52€ha-1 was needed to perform a conventional broadcast treatment. Thus, the use of VRA (Variable Rate Application) flaming reduces the use of liquid petroleum gas (cost savings of 28€ha-1). The results also indicated that the control system, mounted on a prototype, air-blast sprayer design, produced a precise system response to variation in the target features, an approximate accuracy of 0.1m in horizontal resolution and a rapid actuation response of approximately 100ms. Workshop and field experiments provide convincing evidence that autonomous agricultural vehicles equipped with intelligent implements represent an important step forward for optimizing pest control applications in sustainable row crop, orchard and cereal crop production systems., This project is funded in part by the 7th Framework Programme of the European Union under Grant Agreement No. 245986. The authors also want to express recognition to the RHEA beneficiaries: CSIC (Spain), CogVis (Austria), FTW (Austria), Cyberbotics (Switzerland), University of Pisa (Italy), University Complutense of Madrid (Spain), Tropical (Greece), AGROSAP (Spain), Polytechnic University of Madrid (Spain), AirRobot (Germany), University of Florence (Italy), IRSTEA (France), CNH (Belgium), Bluebotics (Switzerland) and CM (Italy)., Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Contribución de congreso (ConferenceOutput)

Application of the Dempster-Shafer theory to classify monocot and dicot weeds based on geometric shape descriptors

  • Herrera Caro, Pedro Javier
  • Dorado, José
  • Ribeiro Seijas, Ángela
An important objective in weed management is the discrimination between monocots and dicots, because these two types of weeds can be controlled more appropriately by specific herbicides. Monocot and dicot weeds differ in morphological characteristics such as the shape of leaves and stems. For this reason, the regions¿ structure belonging to weed classes plays a key role in the proposed discrimination process. Thus six geometric shaped descriptors were used as attributes to describe each isolated region in an image. Based on these attributes, this work established a strategy where the decision was taken by a classifier adapted from the Dempster-Shafer theory. Outdoor field images, taken under varying conditions of lighting, were used to test the proposal performance. This methodology based on distinguishing two types of weeds can be extrapolated to any situation where monocots and dicots are present, e.g. to discriminate between maize, a monocot crop, and dicot weeds., This research was partly financed by the Spanish Ministry of Economy and Competition (AGL2011-30442-C02-02 project) and by the 7th Framework Programme of the European Union under the Grand Agreement CP-IP245986-2 (RHEA project). Research of Dr. Herrera was supported by the JAE-Doc Program, financed by the Spanish National Research Council (CSIC) and the European Social Fund (ESF)., Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Contribución de congreso (ConferenceOutput)

Discriminación entre tipos de malas hierbas: monocotiledóneas y dicotiledóneas, Discrimination between types of weeds: monocots and dicots

  • Herrera Caro, Pedro Javier
  • Dorado, José
  • Ribeiro Seijas, Ángela
Póster divulgativo de la actividad realizada en el proyecto RHEA del Séptimo Programa Marco de la Unión Europea (NMP2-LA-2010-245986) http://www.rhea-project.eu/, An important objective in weed management is the discrimination between grasses (monocots) and broadleaf weeds (dicots), since these two weed groups can be appropriately controlled by specific herbicides. In fact, efficiency is higher if site-specific treatments with selective herbicides for each type of infestation are applied instead of using a single broadcast herbicide on the whole surface. A novel approach of discrimination between monocot and dicot weeds uses outdoor field images under varying conditions of lighting obtained from a conventional camera, which are characterized by the combination of the seven Hu moments and a set of fuzzy decision-making methods. The proposed combined strategy works properly when the weeds present an early stage of growth, which coincides with the right timing for herbicide application., Funded by the European Union’s Seventh Framework Programme (NMP2-LA-2010-245986)., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Contribución de congreso (ConferenceOutput)

Real-time image processing for crop/weed discrimination in wide-row crops

  • Bengochea-Guevara, José M.
  • Burgos Artizzu, Xavier P.
  • Ribeiro Seijas, Ángela
Accurate information about a crop is needed to apply a precision treatment to it as well as to perform other agricultural tasks. To achieve site-specific management of weeds, the first and most important step is the location and density estimation of weeds. In this context, the development of computer vision methods for real-time weed detection can be highly useful in the construction of fully automatic devices for weed control. This paper presents a visual method that discriminates between crop rows and weeds in wide-row crops, working in real time with the images acquired from a conventional camera on board a tractor and under uncontrolled lighting and movement conditions., This project has received funding from the European Union’s Seventh Framework Programme for research, technological development and demonstration under grant agreement no 245986, Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Contribución de congreso (ConferenceOutput)

Effective supervision of a tractor fleet

  • Conesa-Muñoz, Jesús
  • Emmi, Luis Alfredo
  • González-de-Soto, Mariano
  • Ribeiro Seijas, Ángela
This paper describes a supervisor system to monitor automated agricultural vehicles. The supervision system consists of a program that gathers and analyzes, continuously and in real time, the information provided by subsystems on board the vehicles, and notifies the user when it detects a failure, such as an inappropriate working speed or the wrong valve state. To develop this system, a modular and hierarchical architecture is proposed and used. Simple low level supervisors, only able to detect easy failures in small systems, are combined to build more complex, higher level supervisors able to detect more complex problems. The system was tested with automated tractors during the execution of a real agricultural task, spraying herbicide for selective weed treatment. The system successfully supervised the task, detecting the failures that arose. According to these results, it is concluded that the system proposed is a highly useful tool to manage fleets of agricultural vehicles, The Spanish Ministry of Economy and Competitiveness and the European Union have provided full and continuing support for this research work through projects: PLAN NACIONAL - AGL2011 - 30442 - C02 – 02 (GroW) and NMP-CP-IP 245986-2 RHEA., Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

New trends in robotics for agriculture: Integration and assessment of a real fleet of robots

  • Emmi, Luis Alfredo
  • González-de-Soto, Mariano
  • Pajares, Gerardo
  • González-de-Santos, Pablo
Computer-based sensors and actuators such as global positioning systems, machine vision, and laser-based sensors have progressively been incorporated into mobile robots with the aim of configuring autonomous systems capable of shifting operator activities in agricultural tasks. However, the incorporation of many electronic systems into a robot impairs its reliability and increases its cost. Hardware minimization, as well as software minimization and ease of integration, is essential to obtain feasible robotic systems. A step forward in the application of automatic equipment in agriculture is the use of fleets of robots, in which a number of specialized robots collaborate to accomplish one or several agricultural tasks. This paper strives to develop a system architecture for both individual robots and robots working in fleets to improve reliability, decrease complexity and costs, and permit the integration of software from different developers. Several solutions are studied, from a fully distributed to a whole integrated architecture in which a central computer runs all processes. This work also studies diverse topologies for controlling fleets of robots and advances other prospective topologies. The architecture presented in this paper is being successfully applied in the RHEA fleet, which comprises three ground mobile units based on a commercial tractor chassis. © 2014 Luis Emmi et al., The research leading to these results has received funding from the European Union’s Seventh Framework Programme [FP7/2007-2013] under Grant Agreement no. 245986., Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Sensors in agriculture and forestry

  • Pajares, Gerardo
  • Peruzzi, A.
  • González-de-Santos, Pablo
Agriculture and Forestry are two broad and promising areas demanding technological solutions with the aim of increasing production or accurate inventories for sustainability while the environmental impact is minimized by reducing the application of agro-chemicals and increasing the use of environmental friendly agronomical practices. In addition, the immediate consequence of this “trend” is the reduction of production costs. Sensors-based technologies provide appropriate tools to achieve the above mentioned goals. The explosive technological advances and development in recent years enormously facilitates the attainment of these objectives removing many barriers for their implementation, including the reservations expressed by the farmers themselves. Precision Agriculture is an emerging area where sensor-based technologies play an important role., RHEA project [42], which is funded by the European Union’s Seventh Framework Programme (FP7/2007-2013) under Grant Agreement NO.245986, which has been the platform for the two international conferences on Robotics and associated High-technologies and Equipment mentioned above., Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Distributed multi-level supervision to effectively monitor the operations of a fleet of autonomous vehicles in agricultural tasks

  • Conesa-Muñoz, Jesús
  • González-de-Soto, Mariano
  • González-de-Santos, Pablo
  • Ribeiro Seijas, Ángela
© 2015 by the authors; licensee MDPI, Basel, Switzerland. This paper describes a supervisor system for monitoring the operation of automated agricultural vehicles. The system analyses all of the information provided by the sensors and subsystems on the vehicles in real time and notifies the user when a failure or potentially dangerous situation is detected. In some situations, it is even able to execute a neutralising protocol to remedy the failure. The system is based on a distributed and multi-level architecture that divides the supervision into different subsystems, allowing for better management of the detection and repair of failures. The proposed supervision system was developed to perform well in several scenarios, such as spraying canopy treatments against insects and diseases and selective weed treatments, by either spraying herbicide or burning pests with a mechanical-thermal actuator. Results are presented for selective weed treatment by the spraying of herbicide. The system successfully supervised the task; it detected failures such as service disruptions, incorrect working speeds, incorrect implement states, and potential collisions. Moreover, the system was able to prevent collisions between vehicles by taking action to avoid intersecting trajectories. The results show that the proposed system is a highly useful tool for managing fleets of autonomous vehicles. In particular, it can be used to manage agricultural vehicles during treatment operations., RHEA: Robot fleets for highly effective agriculture and forestry management. Tipo proyecto: 7º Programa Marco; FP7-NMP-2009-LARGE-3, Grant Agreement: 245986; Duración: 2010-2014. - GroW: Sistema de inspección terrestre en vehículos autónomos y su aplicación efectiva a la detección de malas hierbas y su control localizado (GroW). Entidad Financiadora: MINECO, PLAN NACIONAL; AGL2011-30442-C02-02 Duración: 2012-2014., We acknowledge support of the publication fee by the CSIC Open Access Publication Support Initiative through its Unit of Information Resources for Research (URICI), Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Contribución de congreso (ConferenceOutput)

Integrating autonomous aerial scouting with autonomous ground actuation to reduce chemical pollution on crop soil

  • Conesa-Muñoz, Jesús
  • Valente, João
  • Cerro, Jaime del
  • Barrientos, Antonio
  • Ribeiro Seijas, Ángela
Accepted English written contributions will be published at Springer Series in Advances in Intelligent Systems and Computing, Many environmental problems cover large areas, often in rough ter-rain constrained by natural obstacles, which makes intervention difficult. New technologies, such as unmanned aerial units, may help to address this issue. Due to their suitability to access and easily cover large areas, unmanned aerial units may be used to inspect the terrain and make a first assessment of the affected areas; however, these platforms do not currently have the capability to imple-ment intervention. This paper proposes integrating autonomous aerial inspection with ground intervention to address environmental problems. Aerial units may be used to easily obtain relevant data about the environment, and ground units may use this information to perform the intervention more efficiently. Furthermore, an overall system to manage these combined missions, com-posed of aerial inspections and ground interventions performed by autonomous robots, is proposed and implemented. The approach was tested on an agricultural scenario, in which the weeds in a crop had to be killed by spraying herbicide on them. The scenario was ad-dressed using a real mixed fleet composed of drones and tractors. The drones were used to inspect the field and to detect weeds and to provide the tractors the exact coordinates to only spray the weeds. This aerial and ground mission col-laboration may save a large amount of herbicide and hence significantly reduce the environmental pollution and the treatment cost, considering the results of several research works that conclude that actual extensive crops are affected by less than a 40% of weed in the worst cases., This project was funded in part by the 7Th Framework Pro-gramme of the European Union under Grant Agreement No. 245986. The authors recognise the following RHEA beneficiaries: CSIC (Spain), CogVis (Austria), FTW (Austria), Cyberbotics (Switzerland), University of Pisa (Italy), University Complutense of Madrid (Spain), Tropical (Greece), AGROSAP (Spain), Polytechnic Uni-versity of Madrid (Spain), AirRobot (Germany), University of Florence (Italy), IRSTEA (France), CNH (Belgium), Bluebotics (Switzerland) and CM (Italy)., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Uso de imágenes procedentes de un vehículo aéreo no tripulado (UAV) para cartografía de objetivos agronómicos

  • Torres-Sánchez, Jorge
  • Peña Barragán, José Manuel
  • López Granados, Francisca
La Tecnología basada en un Vehículo Aéreo No Tripulado que se describe a continuación es extraordinariamente versátil lo que permite que sea extrapolable a diferentes objetivos agronómicos, medioambientales o de otra índole que requieran una cartografía del terreno. Este trabajo fue premiado en el 9th European Conference on Precision Agriculture-2013 donde se reunieron más de 300 investigadores de los 5 continentes y se expusieron más de 100 trabajos I+D+I, Este trabajo fue parcialmente financiado por los proyectos RHEA (ref.: NMP-CP-IP-245986-2, 7º Programa Marco de la UE), TOAS (Programa Marie Curie, ref.: FP7-PEOPLE-2011-CIG-293991, 7º Programa Marco de la UE) y TELEPLAM (AGL2011-30442-CO2-02, MINECO-FEDER). La investigación de Jorge Torres Sánchez y José Manuel Peña Barragán fue financiada por los programas FPI-MINECO, y JAE-Doc-CSIC, respectivamente., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Reducing fuel consumption in weed and pest control using robotic tractors

  • González-de-Soto, Mariano
  • Emmi, Luis Alfredo
  • Garcia, Isaías
  • González-de-Santos, Pablo
© 2015 Elsevier B.V. A significant problem exists concerning contamination of the environment, especially air pollution, and the consequent climatic change. Considering that agricultural vehicles that use fossil fuels emit significant amounts of atmospheric pollutants, the main objective of this paper is to include techniques to reduce the fuel consumption in the controls system of robotic tractors used in agriculture tasks and thereby reduce the atmospheric emissions from these automated applications. To achieve this goal, the first step is to analyze fuel consumption in real time for each of the applications to be improved and to implement the consumption model of a robotic tractor for each task, considering the mechanical energy variations, the performance losses, the energy used to overcome friction and the energy required by the given task. For calculating the mechanical energy, the model considers the potential energy of the system, which is a function of the mass, elevation and gravity. The terrain elevations are estimated from GeoTIFF images of DEM data, which have a pixel size equal to 1. arc second (approximately 30. m at the Equator), and an accuracy of integer meters. Regarding the system mass, the possible loss of mass from applying the treatment is considered. For estimating the frictional forces, the rolling resistance coefficient of the terrain surface conditions is used.The consumption model has been validated experimentally using real agricultural vehicles and implements within the RHEA project (FP7-NMP 245986), in which the instantaneous fuel consumption was measured.This fuel reduction method is applied to three different treatments: weed control on herbaceous crops through the spraying of herbicides, weed control on fire-resistant crops with wide furrows through plowing and flame treatment, and pest control on trees through fumigation using insecticides.Finally, a fuel reduction procedure is applied to each task using the system model implemented to predict the energy requirements. This enables one to find the optimum path plan with respect to fuel consumption. These theoretical results are compared with the experimental results. In addition, the goal is to demonstrate the fuel reduction technique by performing field experiments to show that the use of this method of fuel reduction leads to an reduced fuel consumption and thus reduces atmospheric emissions from agricultural tasks. The results obtained revealed that this fuel reduction method significantly reduces the energy requirements, with the consequent reduction in fuel consumption and atmospheric pollutant emissions., The research leading to these results received funding from the European Union’s Seventh Framework Programme [FP7/2007-2013] under Grant Agreement n. 245986., Peer reviewed, Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Safe operation of mini UAVs: A review of regulation and best practices

  • Sanz Muñoz, David
  • Valente, João
  • Cerro, Jaime del
  • Colorado, J. M.
  • Barrientos, Antonio
© 2015 © 2015 Taylor & Francis and The Robotics Society of Japan. This paper is focused on the safety of mini UAV (mUAV) systems. It presents the great efforts that are being done in air legislation, including the present and future normative. Nevertheless, considering that the work is not finished yet, a low-level risk analysis concept is introduced. Based on the international regulations, a specific three-step structure for mUAV hazard analysis is presented: identification, assessment, and reduction in a recursive loop that provides a solid architecture for facing the wide range of possible risks., This work has been supported by the Robotics and Cybernetics Research Group at Technique University of Madrid (Spain), and funded under the projects ‘ROTOS: Multi-Robot system for outdoor infrastructures protection’, sponsored by Spain Ministry of Education and Science (DPI2010-17998), and ’Robot Fleets for Highly EffectiveAgriculture and Forestry Management’, (RHEA) sponsored by the European Commission’s Seventh Framework Programme (NMP-CP-IP 245986-2 RHEA). The authors want to thank all the project partners: Agencia Estatal Consejo Superior de Investigaciones Científicas - CSIC (Centro de Automática y Robótica, Instituto de Ciencias Agrarias, Instituto de Agricultura Sostenible), CogVis GmbH, Forschungszentrum Telekommunikation Wien Ltd., Cyberbotics Ltd, Università di Pisa, Universidad Complutense de Madrid, Tropical, Soluciones Agrícolas de Precisión S.L., Universidad Politécnica de Madrid – UPM (ETS IngenierosAgrónomos,ETS Ingenieros Industriales),AirRobot GmbH & Co. KG, Università degli Studi di Firenze, Centre National du Machinisme Agricole, du Génie Rural, des Eaux et des Forèts -CEMAGREF, CNH Belgium NV, CNH France SA, Bluebotics S.A. y CM Srl., Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Otros (Other)

A fleet of aerial and ground robots: a scalable approach for autonomous site-specific herbicide application

  • Ribeiro Seijas, Ángela
  • Fernández-Quintanilla, César
  • Dorado, José
  • López Granados, Francisca
  • Peña Barragán, José Manuel
  • Rabatel, Gilles
  • Pérez Ruiz, Manuel
  • Conesa-Muñoz, Jesús
  • González-de-Santos, Pablo
The RHEA project (Robot Fleets for Highly Effective Agriculture and Forestry Management), funded by the 7th EC Framework Programme, focused on the configuration of a new generation of automated and robotic systems for both chemical and physical management of pests including weed control. RHEA addresses the crop treatments by a reconfigurable fleet of robots composed of unmanned ground vehicles (UGV) and unmanned aerial vehicles (UAV) equipped with advanced perception systems, improved end-effectors and enhanced decision-making algorithms. This paper describes the most important aspects of the modules that integrate RHEA and gives some performance results extracted from the trials conducted at the CSIC Experimental Farm (Madrid, Spain), in particular the weed treatment in two winter wheat fields., Funded by the 7th EC Framework Programme. Grant Agreement No. 245986, Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Contribución de congreso (ConferenceOutput)

Detección y tratamiento preciso de malas hierbas con una flota de robots autónomos aéreos y terrestres, Detection and accurate treatment of weeds with a fleet of autonomous aerial and ground robots

  • Ribeiro Seijas, Ángela
  • Fernández-Quintanilla, César
  • Dorado, José
  • López Granados, Francisca
  • Pérez Ruiz, Manuel
  • Agüera, Juan
  • González-de-Santos, Pablo
Trabajo presentado en el XV Congreso de la Sociedad Española de Malherbologia (SEMh), celebrado en Sevilla del 19 al 22 de octubre de 2015., The RHEA project (Robot Fleets for Highly Effective Agriculture and Forestry Management) funded by the 7th EC Framework Programme focused on the design, development and assess of a new generation of automated and robotic systems for both chemical and physical management of pests including weed control. RHEA addressed the crop treatments by a reconfigurable fleet of robots composed by unmanned aerial vehicles (UAV) and unmanned ground vehicles (UGV) equipped with advanced perception systems, intelligent implement and enhanced decision-making algorithms. This paper describes important aspects of the RHEA architecture and details the trials conducted at the Experimental Farm La Poveda (Madrid) where over 97% of the weed infested areas in two wheat crops were treated by the described system., El proyecto RHEA (Robot Fleets for Highly Effective Agriculture and Forestry Management) financiado por el 7º Programa Marco de la Comisión Europea, Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Contribución de congreso (ConferenceOutput)

Using a fleet of robots for patch spraying

  • Fernández-Quintanilla, César
  • Dorado, José
  • Ribeiro Seijas, Ángela
  • López Granados, Francisca
  • Rabatel, Gilles
  • Pérez Ruiz, Manuel
  • González-de-Santos, Pablo
17th European Weed Research Society Symposium. "Weed management in changing environments", 23-26 June 2015, Montpellier, France, Advanced technologies are essential for safe and efficient weed control. Using autonomous mobile platforms (both, ground and aerial) equipped with innovative perception techniques, data processing systems and tools for actuation makes possible to control weeds site-specifically, reducing costs, environmental damages and risks for farmers. From 2011 to 2014 the RHEA Project, funded by the EU 7th Framework Programme, has been involved in the configuration of a new generation of robotic systems for both chemical and physical management of weeds. This article summarizes the RHEA fleet of robots and analyzes the results achieved on the specific case of patch spraying winter wheat crops. The project has tackled two kinds of missions: (1) an inspection mission, made by aerial units which carry the remote perception system; and (2) a treatment mission performed by ground units equipped with the spraying system. The aerial units were hex-rotor Unmanned Aerial Vehicles (UAVs or “drones”) equipped with two DP2 Merril cameras. In one of these cameras the NIR blocking filter was removed in order to turn it into a NIR camera. This solution was able to supply a high image quality (around 446 × 106 pixels) with low-price equipment. The ground mobile units (GMUs) were based on three Boomer-3050 tractors (Case New Holland) tuned to host the onboard computer, the communication equipment, the GPS (RTK) receiver and the GMU controller. Other elements integrated into the vehicles were a camera system, a laser and GPS and communication antennas. The GMUs were carrying a sprayer with a 200L water tank and a 50L herbicide tank connected to a direct injection system to directly inject the chemicals into 12 solenoid nozzles activated independently and located on a 6m boom. The whole operation of the fleet (three GMUs and aerial vehicles) was controlled from an external Base Station equipped with a Mission Manager system and communication systems. In January and May 2014 two assessment trials were conducted in the CSIC Experimental Farm located close to Madrid (Spain), using two winter wheat fields. The assessments included the evaluation of the precision of the spraying operation, of the GMUs trajectories and the fleet integration. Regarding the accuracy of spraying herbicide, over 97% of the target area (weed patches) was sprayed. Slight delays in the opening and closing of the nozzles and some border errors were observed. The trajectory followed by the ground units barely deviated from the defined route plan pointing out high accuracy, deviating from the planned route less than 7cm (i.e., mean deviation) in the two tests performed. Regarding the evaluation of the fleet integration, the results showed that all three GMUs were able to work together cooperatively following pre-defined route plans., RHEA Project, funded by the EU 7th Framework Programme, European Commission, Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Tesis doctoral (DoctoralThesis)

Reducing air and water pollutants in precision agriculture using robotic system, Reducción de contaminantes atomsféricos e hídricos en agricultura de precisiónutilizando sistemas robotizados

  • González-de-Soto, Mariano
[EN]In the last decades there has been a large increase in environmental pollution. The incessant use of fossil fuels generates large air pollution with consequent climate change, in addition to the health problems caused by these pollutant emissions. These fuels are the main energy source for mobile vehicles, such as agricultural ones. Another problem generated in the current intensive agriculture is the use of chemicals to combat undesired pests that undermine and damage the production. Many of these products usually arrive to the water table polluting groundwater. Considering these issues, this doctoral dissertation presents a series of research publications to reduce pollution in agricultural tasks using automated systems. Concretely, the 4 publications presented in this doctoral dissertation by compendium of publications are focused on reducing atmospheric and water pollutants using robotic systems for precision treatments in agriculture. For the experimental tests presented in these publications, we have used robotic vehicles and implements developed in the RHEA project (European Union FP7-NMP 245986), the agricultural tasks considered in these publications have also been those developed within this project: (a) weed control in agricultural crops using herbicides; (b) weed control in crops with wide row spaces that can withstand high temperatures over short periods of times (such as corn, onions, garlic, leeks, etc.) by direct application of flame; and (c) pest control in trees using insecticides., [ES] En las últimas décadas se ha producido un gran aumento en la contaminación del medioambiente. El incesante uso de combustible fósil genera una gran contaminación atmosférica con las consecuentes alteraciones climáticas, además de los problemas de salud provocados por estas emisiones contaminantes. Estos combustibles son la principal fuente de energía para vehículos móviles, como lo son los vehículos agrícolas. Otra problemática generada en la actual agricultura intensiva es el uso de productos químicos utilizados para combatir las plagas indeseadas que merman y dañan la producción. Gran parte de estos productos suele terminar en el subsuelo contaminando las aguas freáticas. Abordando estas problemáticas, esta memoria de tesis doctoral presenta una serie de publicaciones de investigación para reducir la contaminación generada en las tareas agrícolas llevadas a cabo por sistemas automatizados. Concretamente, las 4 publicaciones expuestas en esta memoria de tesis doctoral por compendio de publicaciones se centran en la reducción contaminantes atmosféricos e hídricos utilizando sistemas robotizados para tratamientos de precisión aplicados en agricultura. Para las pruebas experimentales presentadas en estas publicaciones se han utilizado los vehículos robóticos e implementos desarrollados en el proyecto RHEA (European Union FP7-NMP 245986), las tareas agrícolas consideradas en estas publicaciones también han sido las desarrolladas dentro de este proyecto: (a) control de malas hierbas en cultivos agrícolas utilizando herbicidas; (b) control de malas hierbas en cultivos con surcos amplios y gran resistencia a temperaturas elevadas durante pequeños periodos de tiempo (como maíz, cebollas, ajos, puerros, etc.) mediante la aplicación directa de llamas; y (c) control de plagas en árboles aplicando insecticidas. Además, es importante tener en cuenta que gran parte de los resultados obtenidos se pueden extender a otras tareas, tanto del sector agrícola como de otros sectores., La investigación llevada a cabo para obtener los resultados de las publicaciones expuestas en esta memoria de tesis doctoral (presentada en modalidad de compendio de publicaciones) ha recibido financiación del Séptimo Programa Marco de la Unión Europea [FP7 / 2007-2013] en virtud de Acuerdo de Subvención nº 245986., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

A Multi-Robot Sense-Act Approach to Lead to a Proper Acting in Environmental Incidents

  • Conesa-Muñoz, Jesús
  • Valente, João
  • Cerro, Jaime del
  • Barrientos, Antonio
  • Ribeiro Seijas, Ángela
Many environmental incidents affect large areas, often in rough terrain constrained by natural obstacles, which makes intervention difficult. New technologies, such as unmanned aerial vehicles, may help address this issue due to their suitability to reach and easily cover large areas. Thus, unmanned aerial vehicles may be used to inspect the terrain and make a first assessment of the affected areas; however, nowadays they do not have the capability to act. On the other hand, ground vehicles rely on enough power to perform the intervention but exhibit more mobility constraints. This paper proposes a multi-robot sense-act system, composed of aerial and ground vehicles. This combination allows performing autonomous tasks in large outdoor areas by integrating both types of platforms in a fully automated manner. Aerial units are used to easily obtain relevant data from the environment and ground units use this information to carry out interventions more efficiently. This paper describes the platforms and sensors required by this multi-robot sense-act system as well as proposes a software system to automatically handle the workflow for any generic environmental task. The proposed system has proved to be suitable to reduce the amount of herbicide applied in agricultural treatments. Although herbicides are very polluting, they are massively deployed on complete agricultural fields to remove weeds. Nevertheless, the amount of herbicide required for treatment is radically reduced when it is accurately applied on patches by the proposed multi-robot system. Thus, the aerial units were employed to scout the crop and build an accurate weed distribution map which was subsequently used to plan the task of the ground units. The whole workflow was executed in a fully autonomous way, without human intervention except when required by Spanish law due to safety reasons., This project was funded in part by the 7th Framework Programme of the European Union under Grant Agreement No. 245986. The authors recognise the following RHEA beneficiaries: CSIC (Spain), CogVis (Austria), FTW (Austria), Cyberbotics (Switzerland), University of Pisa (Italy), University Complutense of Madrid (Spain), Tropical (Greece), AGROSAP (Spain), Polytechnic University of Madrid (Spain), AirRobot (Germany), University of Florence (Italy), IRSTEA (France), CNH (Belgium), Bluebotics (Switzerland), and CM (Italy). We acknowledge support by the CSIC Open Access Publication Initiative through its Unit of Information Resources for Research (URICI).
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Machine-Vision Systems Selection for Agricultural Vehicles: A Guide

  • Pajares, Gonzalo
  • García-Santillán, Iván
  • Campos, Yerania
  • Montalvo, Martín
  • Guerrero, José Miguel
  • Emmi, Luis Alfredo
  • Romeo, Juan
  • Guijarro, María
  • González-de-Santos, Pablo
Machine vision systems are becoming increasingly common onboard agricultural vehicles (autonomous and non-autonomous) for different tasks. This paper provides guidelines for selecting machine-vision systems for optimum performance, considering the adverse conditions on these outdoor environments with high variability on the illumination, irregular terrain conditions or different plant growth states, among others. In this regard, three main topics have been conveniently addressed for the best selection: (a) spectral bands (visible and infrared); (b) imaging sensors and optical systems (including intrinsic parameters) and (c) geometric visual system arrangement (considering extrinsic parameters and stereovision systems). A general overview, with detailed description and technical support, is provided for each topic with illustrative examples focused on specific applications in agriculture, although they could be applied in different contexts other than agricultural. A case study is provided as a result of research in the RHEA (Robot Fleets for Highly Effective Agriculture and Forestry Management) project for effective weed control in maize fields (wide-rows crops), funded by the European Union, where the machine vision system onboard the autonomous vehicles was the most important part of the full perception system, where machine vision was the most relevant. Details and results about crop row detection, weed patches identification, autonomous vehicle guidance and obstacle detection are provided together with a review of methods and approaches on these topics., The research leading to these results received funding from the European Union’s Seventh Framework Programme [FP7/2007–2013] under Grant Agreement No. 245986. Part of this work has been carried out by the first author funded by Universidad Politécnica Estatal del Carchi (Ecuador) and the second author funded by the National Council of Science and Technology of Mexico (CONACyT) for the doctoral grant number 210282 to undertake doctoral studies. We acknowledge support by the CSIC Open Access Publication Initiative through its Unit of Information Resources for Research (URICI).
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Camera sensor arrangement for crop/weed detection accuracy in agronomic images

  • Romeo, Juan
  • Guerrero Montávez, Juan Miguel
  • Montalvo, Martín
  • Emmi, Luis Alfredo
  • Guijarro, María
  • González-de-Santos, Pablo
  • Pajares, Gonzalo
In Precision Agriculture, images coming from camera-based sensors are commonly used for weed identification and crop line detection, either to apply specific treatments or for vehicle guidance purposes. Accuracy of identification and detection is an important issue to be addressed in image processing. There are two main types of parameters affecting the accuracy of the images, namely: (a) extrinsic, related to the sensor's positioning in the tractor; (b) intrinsic, related to the sensor specifications, such as CCD resolution, focal length or iris aperture, among others. Moreover, in agricultural applications, the uncontrolled illumination, existing in outdoor environments, is also an important factor affecting the image accuracy. This paper is exclusively focused on two main issues, always with the goal to achieve the highest image accuracy in Precision Agriculture applications, making the following two main contributions: (a) camera sensor arrangement, to adjust extrinsic parameters and (b) design of strategies for controlling the adverse illumination effects. © 2013 by the authors; licensee MDPI, Basel, Switzerland., The research leading to these results has received funding from the European Union's Seventh Framework Programme (FP7/2007-2013) under Grant Agreement NO.245986. This paper has been extended from a previous paper published in [20]. The authors wish also to acknowledge to the project AGL2011-30442-C02-02, supported by the Ministerio de Economía y Competitividad of Spain within the Plan Nacional de I+D+i., Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Fleets of robots for environmentally-safe pest control in agriculture

  • González-de-Santos, Pablo
  • Ribeiro Seijas, Ángela
  • Fernández-Quintanilla, César
  • López Granados, Francisca
  • Debilde, Benoit
González-de-Santos, Pablo et al., Feeding the growing global population requires an annual increase in food production. This requirement suggests an increase in the use of pesticides, which represents an unsustainable chemical load for the environment. To reduce pesticide input and preserve the environment while maintaining the necessary level of food production, the efficiency of relevant processes must be drastically improved. Within this context, this research strived to design, develop, test and assess a new generation of automatic and robotic systems for effective weed and pest control aimed at diminishing the use of agricultural chemical inputs, increasing crop quality and improving the health and safety of production operators. To achieve this overall objective, a fleet of heterogeneous ground and aerial robots was developed and equipped with innovative sensors, enhanced end-effectors and improved decision control algorithms to cover a large variety of agricultural situations. This article describes the scientific and technical objectives, challenges and outcomes achieved in three common crops., The research leading to these results received funding from the European Union’s Seventh Framework Programme [FP7/2007-2013] under Grant Agreement nº 245986. Support for publishing this article has been provided by CSIC., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Mapping Wide Row Crops with Video Sequences Acquired from a Tractor Moving at Treatment Speed

  • Sainz-Costa, Nadir
  • Ribeiro Seijas, Ángela
  • Burgos-Artizzu, Xavier P.
  • Guijarro, María
  • Pajares, Gonzalo
This paper presents a mapping method for wide row crop fields. The resulting map shows the crop rows and weeds present in the inter-row spacing. Because field videos are acquired with a camera mounted on top of an agricultural vehicle, a method for image sequence stabilization was needed and consequently designed and developed. The proposed stabilization method uses the centers of some crop rows in the image sequence as features to be tracked, which compensates for the lateral movement (sway) of the camera and leaves the pitch unchanged. A region of interest is selected using the tracked features, and an inverse perspective technique transforms the selected region into a bird’s-eye view that is centered on the image and that enables map generation. The algorithm developed has been tested on several video sequences of different fields recorded at different times and under different lighting conditions, with good initial results. Indeed, lateral displacements of up to 66% of the inter-row spacing were suppressed through the stabilization process, and crop rows in the resulting maps appear straight., The Spanish Ministry of Science and Innovation and the European Union have provided full and continuing support for this research work through projects PLAN NACIONAL AGL2008-04670-C03- 02/AGR and the RHEA project, which is funded by the EU 7th Framework Programme under contract number NMP2-LA-2010-245986.
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Contribución de congreso (ConferenceOutput)

Comparing visible and color-infrared UAV imagery for early-season weed mapping: The case of maize a wide row crop

  • Peña, José María
  • Torres-Sánchez, Jorge
  • Castro, Ana Isabel de
  • Serrano Pérez, Angélica
  • López Granados, Francisca
Trabajo presentado en la RHEA-2014 Second International Conference on Robotics and associated High-technologies and Equipment for Agriculture and forestry (New trends in mobile robotics, perception and actuation for agriculture and forestry), celebrada en Madrid del 21 al 23 de mayo de 2014.-- Edited by Pablo Gonzalez-de-Santos and Angela Ribeiro, This investigation quantified the efficacy of visible and color-infrared images for weed mapping in a maize field by using remote images captured with an unmanned aerial vehicle at several flight altitudes (from 40 to 100 m). Results on weed discrimination were significantly affected by type of image and by type of weed (broad-leaved or grass weeds). With independence on spatial resolution (i.e., flight altitude), weed coverage was underestimated in the visible images, mostly in the parts of the field infested with grass weeds. On the contrary, analysis done with the color-infrared images was highly precise in the images captured at 40-m flight altitude, although progressively overestimated weed coverage at higher altitude., This research was partly financed by the AGL Project (Spanish Ministry of Economy and Competition and FEDER Funds, ref.: AGL2011-30442-CO2-01), the TOAS Project (EU-7th Frame Program, ref.: FP7-PEOPLE-2011-CIG-293991) and the RHEA project (EU-7th Frame Program, ref: NMP-CP-IP 245986-2). Research of Dr. de Castro and Mr. Torres-Sánchez was financed by JAEPre and FPI Programs, respectively., No
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Contribución de congreso (ConferenceOutput)

Generating UAV accurate ortho-mosaicked images using a six-band multispectral camera arrangement

  • Mesas-Carrascosa, Francisco Javier
  • Torres-Sánchez, Jorge
  • Peña, José María
  • García-Ferrer, Alfonso
  • Castillejo González, Isabel L.
  • López Granados, Francisca
Trabajo presentado en la RHEA-2014 Second International Conference on Robotics and associated High-technologies and Equipment for Agriculture and forestry (New trends in mobile robotics, perception and actuation for agriculture and forestry), celebrada en Madrid del 21 al 23 de mayo de 2014.-- Edited by Pablo Gonzalez-de-Santos and Angela Ribeiro., Site-specific weed management in a very early phenological stage of crop and weed plants requires the ultra-high spatial resolution imagery provided by unmanned aerial vehicles (UAV) flying at low altitudes. These UAV images cannot cover the whole field, resulting in the need to take a sequence or series of multiple overlapped (end-lap and side-lap) images. As consequence, a large number of UAV images are acquired for each plot. These multiple overlapped images must be oriented by calculating the bundle adjustment and ortho-rectified throughout an aerial-triangulation procedure to create an accurately georeferenced ortho-mosaicked image of the entire field. As the spatial accuracy of ortho-mosaicked image is mainly dependent on camera calibration and percentage of overlapping, this paper describes the effect of flight parameters and sensor arrangement using an UAV flying at 30 m altitude and six-band multispectral camera (miniature camera array composed of a master channel and five more channels or bands) on the workflow of the mosaicking process. The objective is to develop a procedure to generate an accurate ortho-image. This procedure would be then used in multispectral UAV imagery taken on crops for weed seedling mapping. The main phases of UAV workflow were: sensor calibration, mission planning, UAV flight and processing images. Regarding the sensor calibration, six different geometric calibrations were calculated, one for each image registered corresponding to every band. Referring to mission planning, two end-lap and side-lap settings (60%-30% and 70%-40%) were considered. Calibration and image overlapping are related to the flight duration and accuracy resolving aerial-triangulation. Different aerialtriangulations were calculated for different scenarios taken into account several combinations of calibrations and the overlapping values. The spatial accuracy of the different generated ortho-mosaicked images using both overlapping values and calibration were evaluated by the ASPRS (American Society for Photogrammetry and Remote Sensing) test. The results showed that the best setting of flight to keep the spatial accuracy in the bundle adjustment was 40- 70% overlapping and using the master channel for the aero-triangulation and its own calibration parameters. Generally, high values of end-lap and side-lap improved the accuracy of block photogrammetric adjustment, although they increased the flight length and decreased the area overflow. In addition, the framework to process and mosaic the images taken by this type of sensor was defined., This research was partly financed by TOAS (ref.: PEOPLE-2011-CIG-293991, EC-7th Frame Program) and AGL2011-30442-CO2-01 (MINECO-FEDER Funds) Projects. Research of Mr. Torres-Sánchez and Dr. José M. Peña were financed by FPI Program (MINECO funds) and RHEA Project (NMP-CP-IP 245986-2, EC-7th Frame Program), respectively., No
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Contribución de congreso (ConferenceOutput)

Multitemporal weed mapping using UAV imagery for early site-specific control: the case of wheat as a narrow row crop.

  • Torres-Sánchez, Jorge
  • López Granados, Francisca
  • Castro, Ana Isabel de
  • Peña, José María
Trabajo presentado en la RHEA-2014 Second International Conference on Robotics and associated High-technologies and Equipment for Agriculture and forestry (New trends in mobile robotics, perception and actuation for agriculture and forestry), celebrada en Madrid del 21 al 23 de mayo de 2014.-- Edited by Pablo Gonzalez-de-Santos and Angela Ribeiro., Obtaining weed patch maps for herbaceous crops in early season for site-specific weed control using remote sensing techniques has been a major challenge due to their spectral and appearance similarities. This is particularly problematic in the case of narrow row crops as wheat, where the weed discrimination has to be undertaken in a short time window for a timely postemergence control, and using images with better resolution than the usually provided by remote platforms such as satellite and conventional aircrafts. Nowadays, the utilization of ultra-high resolution images captured by Unmanned Aerial Vehicles (UAV) has opened the door to the generation of weeds and treatment maps. This article describes the complete workflow developed to achieve the weed patch mapping in a wheat field, as paradigm of narrow row crops. An UAV flying at different altitudes and dates was used in order to determine the best spatial resolution and wheat-weeds growth stage to successfully reach our objective. Main steps of the workflow are as follows: 1) configuration of the UAV flights to acquire a set of overlapped imagery; 2) mosaicking of these images to create a georeferenced ortho-image of the whole crop field; 3) automatic object-based image analysis (OBIA) procedure developed for generating weed patch maps. The UAV was equipped with a commercial camera which provided images in the visible range of the spectra. The vehicle was programmed to overflow automatically a wheat field naturally infested by a grass weed, and to trigger the camera at the moment required to supply images with a previously fixed overlapping between them. Then, overlapped images were mosaicked to create an accurate georeferenced orthoimage of the entire crop field. At last, the mosaicked image was analyzed using a robust and completely automatic OBIA procedure developed by our research group. The OBIA analysis algorithm combines object-based features such as spectral, position, orientation and hierarchical relationships, and consists of three consecutive phases: 1) discrimination of crop rows by application of a dynamic and auto-adaptive classification approach, 2) discrimination of weeds on the basis of their relative positions with reference to the crop rows, and 3) generation of a weed patch map in a grid structure for a further use in early sitespecific weed control. The effect of ortho-image spatial resolution (ranging from 1 cm to 3.5 cm) and wheat-weeds growth stage on the workflow performance using OBIA was studied for the different flight altitudes and dates., This research was partly financed by Projects TOAS (Marie Curie Program, ref.: FP7- PEOPLE-2011-CIG-293991, EU-7th Frame Program) and RHEA (NMP-CP-IP 245986-2, EU-7th Frame Program). Research of Mr. Torres-Sánchez, Dr. Peña- Barragán and Dr. de Castro was financed by FPI, JAEDoc and JAEPre Programs, respectively., No
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Simulation of the effects of weed decision threshold, detection and treatment resolution on the errors in spraying decisions and on herbicide savings

  • San Martín, Carolina
  • Martín, José Manuel
  • Andújar, Dionisio
  • Fernández-Quintanilla, César
  • Dorado, José
  • Campos, D.
A series of scenarios were assessed by simulating various weed decision thresholds (WDT) and different weed detection and herbicide application resolutions. Variable responses were obtained depending on the spatial distribution pattern of the weed. In the case of a patchy distributed species (Sorghum halepense), errors in spraying decision increased as the resolution increased and the WDT decreased. In contrast, in a uniformly distributed species (Abutilon theophrasti) errors in spraying decision increased when both the resolution and the WDT increased. Weed decision threshold was essential in determining the suitability of patch spraying. Consequently, site-specific control would depend primarily on our ability to detect low weed densities., This research was funded by the European Union (Seventh Framework Programme, Project no. 245986: Automation and robotics for sustainable crop and forestry management)., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Automatic expert system based on images for accuracy crop row detection in maize fields

  • Guerrero, José Miguel
  • Guijarro, María
  • Montalvo, Martín
  • Romeo, Juan
  • Emmi, Luis Alfredo
  • Ribeiro Seijas, Ángela
  • Pajares, Gonzalo
This paper proposes an automatic expert system for accuracy crop row detection in maize fields based on images acquired from a vision system. Different applications in maize, particularly those based on site specific treatments, require the identification of the crop rows. The vision system is designed with a defined geometry and installed onboard a mobile agricultural vehicle, i.e. submitted to vibrations, gyros or uncontrolled movements. Crop rows can be estimated by applying geometrical parameters under image perspective projection. Because of the above undesired effects, most often, the estimation results inaccurate as compared to the real crop rows. The proposed expert system exploits the human knowledge which is mapped into two modules based on image processing techniques. The first one is intended for separating green plants (crops and weeds) from the rest (soil, stones and others). The second one is based on the system geometry where the expected crop lines are mapped onto the image and then a correction is applied through the well-tested and robust Theil-Sen estimator in order to adjust them to the real ones. Its performance is favorably compared against the classical Pearson product-moment correlation coefficient. © 2012 Elsevier Ltd. All rights reserved., The research leading to these results has been funded by the European Union’s Seventh Framework Programme [FP7/2007-2013] under Grant Agreement no. 245986 in the Theme NMP-2009-3.4-1 (automation and robotics for sustainable crop and forestry management). The authors wish also to acknowledge the project the AGL2011-30442-C02-02, supported by the Ministerio de Economía y Competitividad of Spain within the Plan Nacional of I+D+i., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Automatic expert system for weeds/crops identification in images from maize fields

  • Montalvo, Martín
  • Guerrero, José Miguel
  • Romeo, Juan
  • Emmi, Luis Alfredo
  • Guijarro, María
  • Pajares, Gonzalo
Automation for the identification of plants, based on imaging sensors, in agricultural crops represents an important challenge. In maize fields, site-specific treatments, with chemical products or mechanical manipulations, can be applied for weeds elimination. This requires the identification of weeds and crop plants. Sometimes these plants appear impregnated by materials coming from the soil (particularly clays). This appears when the field is irrigated or after rain, particularly when the water falls with some force. This makes traditional approaches based on images greenness identification fail under such situations. Indeed, most pixels belonging to plants, but impregnated, are misidentified as soil pixels because they have lost their natural greenness. This loss of greenness also occurs after treatment when weeds have begun the process of death. To correctly identify all plants, independently of the loss of greenness, we design an automatic expert system based on image segmentation procedures. The performance of this method is verified favorably. © 2012 Elsevier Ltd. All rights reserved., The research leading to these results has been funded by the European Union’s Seventh Framework Programme [FP7/2007-2013] under Grant Agreement No. 245986 in the Theme NMP-2009-3.4-1 (Automation and robotics for sustainable crop and forestry management). The authors wish also to acknowledge to the project AGL2011-30442-C02-02, supported by the Ministerio de Economía y Competitividad of Spain within the Plan Nacional de I+D+i., Peer reviewed
Archivo Digital UPM
Publicación Artículo científico (JournalArticle)

Mapping wide row crops with video sequences acquired from a tractor moving at treatment speed

  • Sainz Costa, Nadir
  • Ribeiro Seijas, Ángela Mª|||0000-0001-5807-8132
  • Burgos Artizzu, Xavier
  • Guijarro, Maria
  • Pajares, Gonzalo
Archivo Digital UPM
Publicación Artículo científico (JournalArticle)

Automatic detection of crop rows in maize fields with high weeds pressure

  • Montalvo Martínez, Martín
  • Pajares Martinsanz, Gonzalo
  • Guerrero Hernández, José Miguel
  • Romeo Granados, Juan
  • Guijarro Mata-García, María
  • Ribeiro Seijas, Ángela Mª|||0000-0001-5807-8132
  • Ruz Ortiz, José Jaime
  • Cruz García, Jesús Manuel de la
Archivo Digital UPM
Publicación Artículo científico (JournalArticle)

Active Optical Sensors for Tree Stem Detection and Classification in Nurseries.

  • Garrido Izard, Miguel|||0000-0002-7880-6499
  • Pérez Ruiz, Manuel
  • Valero Ubierna, Constantino|||0000-0003-4473-3209
  • Gliever, Chris J.
  • Hanson, Bradley D.
  • Slaugther, David
Archivo Digital UPM
Publicación Artículo científico (JournalArticle)

Short-term effects of four tillage practices on soil physical properties, soil water potential, and maize yield

  • Salem, Haytham M.
  • Valero Ubierna, Constantino|||0000-0003-4473-3209
  • Muñoz García, Miguel Angel|||0000-0002-3670-8989
  • Gil Rodríguez, María|||0000-0002-4222-6433
  • Silva, Luis Leopoldo
Archivo Digital UPM
Publicación Contribución de congreso (ConferenceOutput)

On the acquisition of high-resolution maps with open source software and commercials off-the-shelf quad-rotors

  • Pereira Valente, Joao Ricardo
  • Guillén, Adrián
  • Manrique, Óscar
  • Arenal, Mercedes
  • Barrientos Cruz, Antonio|||0000-0003-1691-3907
Archivo Digital UPM
Publicación Contribución de congreso (ConferenceOutput)

What is the optimal stitching orientation from an aerial survey perspective?

  • Valente, Joao
  • Cerro Giner, Jaime del|||0000-0003-4893-2571
  • Barrientos Cruz, Antonio|||0000-0003-1691-3907
Archivo Digital UPM
Publicación Contribución de congreso (ConferenceOutput)

Flota de vehículos aéreos para fotografía de alta resolución en aplicaciones de agricultura de precisión. Proyecto RHEA.

  • Cerro Giner, Jaime del|||0000-0003-4893-2571
  • Sanz Muñoz, David
  • Valente, João
  • Rossi, Claudio|||0000-0002-8740-2453
  • Cancar, Leandro
  • Barrientos Cruz, Antonio|||0000-0003-1691-3907
Archivo Digital UPM
Publicación Artículo científico (JournalArticle)

3D Maize Plant Reconstruction Based on Georeferenced Overlapping LiDAR Point Clouds

  • Garrido Izard, Miguel|||0000-0002-7880-6499
  • Paraforos, Dimitris S.
  • Reiser, David
  • Vázquez Arellano, Manuel
  • Griepentrog, Hans W.
  • Valero Ubierna, Constantino|||0000-0003-4473-3209
Archivo Digital UPM
Publicación Contribución de congreso (ConferenceOutput)

Integrating Autonomous Aerial Scouting with Autonomous Ground Actuation to Reduce Chemical Pollution on Crop Soil

  • Conesa Muñoz, Jesús
  • Pereira Valente, Joao Ricardo
  • Cerro Giner, Jaime Del|||0000-0003-4893-2571
  • Barrientos Cruz, Antonio|||0000-0003-1691-3907
  • Ribeiro Seijas, Ángela Mª|||0000-0001-5807-8132
Archivo Digital UPM
Publicación Artículo científico (JournalArticle)

Fleets of robots for environmentally-safe pest control in agriculture

  • González de Santos, Pablo
  • Ribeiro Seijas, Ángela Mª|||0000-0001-5807-8132
  • Fernández Quintanilla, Cesar
  • López Granados, Francisca
  • Brandstoetter, Michael
  • Tomic, Slobodanka
  • Pedrazzi, Stefania
  • Peruzzi, Andrea
  • Pajares, Gonzalo
  • Kaplanis, George
  • Pérez Ruiz, Manuel
  • Valero Ubierna, Constantino|||0000-0003-4473-3209
  • Cerro Giner, Jaime del|||0000-0003-4893-2571
  • Vieri, Marco
  • Rabatel, Gilles
  • Debilde, Benoit