Skip to main content

ROBOT AUTONOMO SUBMARINO PARA LA INSPECCION Y MONITORIZACION DE EXPLOTACIONES DE ACUICULTURA MARINA

CTM2011-29691-C02-02

•
Funding agency name Ministerio de Ciencia e Innovación
Funding agency acronym MICINN
Program Programa Nacional de Proyectos de Investigación Fundamental
Subprogram Subprograma de Proyectos de Investigación Fundamental no Orientada
Call Proyectos I+D
Call year 2011
State Plan 2008-2011 Plan Nacional de Investigación Científica, Desarrollo e Innovación Tecnológica
Management unit Subdirección General de Proyectos de Investigación
Beneficiary centre UNIVERSITAT DE GIRONA

Resultados relacionados

Resultados totales (Incluyendo duplicados): 15
Encontrada(s) 1 página(s)

Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Sonar-based chain following using an autonomous underwater vehicle

  • Hurtós Vilarnau, Natàlia
  • Palomeras Rovira, Narcís
  • Carrera Viñas, Arnau
  • Carreras Pérez, Marc
  • Bechlioulis, Charalampos P.
  • Karras, George C.
  • Hesmati-Alamdari, Shahab
  • Kyriakopoulos, Kostas
Tracking an underwater chain using an autonomous vehicle can be a first step towards more efficient solutions for cleaning and inspecting mooring chains. We propose to use a forward looking sonar as a primary perception sensor to enable the vehicle operation in limited visibility conditions and overcome the turbidity arisen during marine growth removal. Despite its advantages, working with acoustic imagery raises additional challenges to the involved image processing and control methodologies. In this paper we present a robust framework to perform chain following, combining perception, planning and control disciplines. We first introduce a detection system that exploits the sonar's high frame rate and applies local pattern matching to handle the complexity of detecting link chains in acoustic images. Then, a planning system deals with the dispersed detections and determines the link waypoints that the vehicle should reach. Finally, the vehicle is guided through these waypoints using a high level controller that has been tailored to simultaneously traverse the chain and keep track of upcoming links. Experiments on real data demonstrate the capability of autonomously follow a chain with sufficient accuracy to perform subsequent cleaning or inspection tasks, This work was supported by the EU funded project PANDORA: Persistent Autonomy through learNing, aDaptation, Observation and ReplAnning”, FP7-288273, and the Spanish Project ANDREA/RAIMON (Ref CTM2011-29691-C02-02) funded by the Ministry of Science and Innovation
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Hierarchical Normal Space Sampling to speed up point cloud coarse matching

  • Diez, Yago
  • Martí Bonmatí, Joan
  • Salvi, Joaquim
Point cloud matching is a central problem in Object Modeling with applications in Computer Vision and Computer Graphics. Although the problem is well studied in the case when an initial estimate of the relative pose is known (fine matching), the problem becomes much more difficult when this a priori knowledge is not available (coarse matching). In this paper we introduce a novel technique to speed up coarse matching algorithms for point clouds. This new technique, called Hierarchical Normal Space Sampling (HNSS), extends Normal Space Sampling by grouping points hierarchically according to the distribution of their normal vectors. This hierarchy guides the search for corresponding points while staying free of user intervention. This permits to navigate through the huge search space taking advantage of geometric information and to stop when a sufficiently good initial pose is found. This initial pose can then be used as the starting point for any fine matching algorithm. Hierarchical Normal Space Sampling is adaptable to different searching strategies and shape descriptors. To illustrate HNSS, we present experiments using both synthetic and real data that show the computational complexity of the problem, the computation time reduction obtained by HNSS and the application potentials in combination with ICP, This work has been supported by FP7-ICT-2011-7 projects: PANDORA Persistent Autonomy through Learning, Adaptation, Observation and Re-planning (Ref 288273) funded by the European Commission and RAIMON Autonomous Underwater Robot for Marine Fish Farms Inspection and Monitoring (Ref CTM2011-29691-C02-02) funded by the Spanish Ministry of Science and Innovation
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Joint estimation of segmentation and structure from motion

  • Zappella, Luca
  • Del Bue, Alessio
  • Lladó Bardera, Xavier
  • Salvi, Joaquim
We present a novel optimisation framework for the estimation of the multi-body motion segmentation and 3D reconstruction of a set of point trajectories in the presence of missing data. The proposed solution not only assigns the trajectories to the correct motion but it also solves for the 3D location of multi-body shape and it fills the missing entries in the measurement matrix. Such a solution is based on two fundamental principles: each of the multi-body motions is controlled by a set of metric constraints that are given by the specific camera model, and the shape matrix that describes the multi-body 3D shape is generally sparse. We jointly include such constraints in a unique optimisation framework which, starting from an initial segmentation, iteratively enforces these set of constraints in three stages. First, metric constraints are used to estimate the 3D metric shape and to fill the missing entries according to an orthographic camera model. Then, wrongly segmented trajectories are detected by using sparse optimisation of the shape matrix. A final reclassification strategy assigns the detected points to the right motion or discards them as outliers. We provide experiments that show consistent improvements to previous approaches both on synthetic and real data, This work has been supported by the Spanish Ministry of Science and Innovation projects CTM2011-29691-C02-02. L. Zappella was supported by the Catalan government scholarship 2009FI B1 00068
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

A collection of challenging motion segmentation benchmark datasets

  • Mahmood, Muhammad Habib
  • Diez, Yago
  • Salvi, Joaquim
  • Lladó Bardera, Xavier
An in-depth analysis of computer vision methodologies is greatly dependent on the benchmarks they are tested upon. Any dataset is as good as the diversity of the true nature of the problem enclosed in it. Motion segmentation is a preprocessing step in computer vision whose publicly available datasets have certain limitations. Some databases are not up-to-date with modern requirements of frame length and number of motions, and others do not have ample ground truth in them. In this paper, we present a collection of diverse multifaceted motion segmentation benchmarks containing trajectory- and region-based ground truth. These datasets enclose real-life long and short sequences, with increased number of motions and frames per sequence, and also real distortions with missing data. The ground truth is provided on all the frames of all the sequences. A comprehensive benchmark evaluation of the state-of-the-art motion segmentation algorithms is provided to establish the difficulty of the problem and to also contribute a starting point. All the resources of the datasets have been made publicly available at http://dixie.udg.edu/udgms/, This work is supported by the FP7-ICT-2011 7project PANDORA (Ref 288273) funded by the European Commission, two projects funded by the Ministry of Economy and Competitiveness of the Spanish Government. RAIMON (Ref CTM2011-29691-C02-02) and NICOLE (Ref TIN2014-55710-R)
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Semi-automatic tool for motion annotation on complex video sequences

  • Mahmood, Muhammad Habib
  • Salvi, Joaquim
  • Lladó Bardera, Xavier
Ground truth annotation on motion segmentation (MS) datasets of arbitrary real-life videos is a difficult and challenging task. The research community lacks a standard annotation tool for such datasets, which makes it an open research field. Here an annotation tool is proposed for trajectories in complex videos, which provides a publicly available platform to create and reinforce MS datasets. The user friendly interface allows to refine an initial automatic segmentation result to produce ground truth annotation on all the motions of all the frames of a given sequence. In long videos with multiple rigid/non-rigid motions containing complete occlusion and real distortions, the tool facilitates rapid annotation of motion in a semi-automatic way, This work was supported by the FP7-ICT-2011-7 project PANDORA (Ref 288273), RAIMON (Ref CTM2011-29691- C02-02) and NICOLE (Ref TIN2014-55710-R)
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

SLAM With Dynamic Targets via Single-Cluster PHD Filtering

  • Lee, Chee Sing
  • Clark, Daniel E.
  • Salvi, Joaquim
This paper presents the first algorithm for simultaneous localization and mapping (SLAM) that can estimate the locations of both dynamic and static features in addition to the vehicle trajectory. We model the feature-based SLAM problem as a single-cluster process, where the vehicle motion defines the parent, and the map features define the daughter. Based on this assumption, we obtain tractable formulae that define a Bayesian filter recursion. The novelty in this filter is that it provides a robust multi-object likelihood which is easily understood in the context of our starting assumptions. We present a particle/Gaussian mixture implementation of the filter, taking into consideration the challenges that SLAM presents over target tracking with stationary sensors, such as changing fields of view and a mixture of static and dynamic map features. Monte Carlo simulation results are given which demonstrate the filter's effectiveness with high measurement clutter and non-linear vehicle motion, Manuscript received September 09, 2012; revised December 09, 2012; accepted February 19, 2013. Date of publication March 06, 2013; date of current version May 13, 2013. This work was supported by an EPSRC grant EP/J012432/1, EU grant FP7-ICT-2011-7 project PANDORA Ref 288273, Spanish Ministry of Science and Innovation project RAIMON ref. CTM2011-29691-C02-02) and the Catalan Government (FI and BE-DGR grants).. The work of C. S. Lee was supported by a Ph.D. FI Scholarship of the Catalan Government. The work of D. E. Clark was supported by an RAEng/EPSRC Fellowship. The associate editor coordinating the review of this manuscript and approving it for publication was Prof. Ba-Ngu Vo
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Automatic Detection of Underwater Chain Links using a Forward-Looking Sonar

  • Hurtós Vilarnau, Natàlia
  • Palomeras Rovira, Narcís
  • Nagappa, Sharad
  • Salvi, Joaquim
Underwater chain cleaning and inspection tasks are costly and time consuming operations that must be performed periodically to guarantee the safety of the moorings. We propose a framework towards an efficient and costeffective solution by using an autonomous underwater vehicle equipped with a forward-looking sonar. As a first step, we tackle the problem of individual chain link detection from the challenging forward-looking sonar data. To cope with occlusions and intensity variations due to viewpoint changes, the recognition problem is addressed as local pattern matching of the different link parts. We exploit the high frame-rate of the sonar to improve, by registration, the signal-to-noise ratio of the individual sonar frames and to cluster the local detections over time to increase robustness. Experiments with sonar images of a real chain are reported, showing a high percentage of correct link detections with good accuracy while potentially keeping real-time capabilities, This work has been supported by the FP7-ICT-2011-7 project PANDORA-Persistent Autonomy through Learning, Adaptation, Observation and Re-planning (Ref 288273) funded by the European Commission and the Spanish Project ANDREA/RAIMON (Ref CTM2011-29691-C02-02) funded by the Ministry of Science and Innovation
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Long-term mapping and localization using feature stability histograms

  • Bacca Cortés, Eval Bladimir
  • Salvi, Joaquim
  • Cufí i Solé, Xavier
This work proposes a system for long-term mapping and localization based on the Feature Stability Histogram (FSH) model which is an innovative feature management approach able to cope with changing environments. FSH is built using a voting schema, where re-observed features are promoted; otherwise the feature progressively decreases its corresponding FSH value. FSH is inspired by the human memory model. This model introduces concepts of Short-Term Memory (STM), which retains information long enough to use it, and Long-Term Memory (LTM), which retains information for longer periods of time. If the entries in STM are continuously rehearsed, they become part of LTM. However, this work proposes a change in the pipeline of this model, allowing any feature to be part of STM or LTM depending on the feature strength. FSH stores the stability values of local features, stable features are only used for localization and mapping. Experimental validation of the FSH model was conducted using the FastSLAM framework and a long-term dataset collected during a period of one year at different environmental conditions. The experiments carried out include qualitative and quantitative results such as: filtering out dynamic objects, increasing map accuracy, scalability, and reducing the data association effort in long-term run, This work has been partially supported by the project RAIMON—Autonomous Underwater Robot for Marine Fish Farms Inspection and Monitoring (Ref. CTM2011-29691-C02-02) funded by the Spanish Ministry of Science and Innovation, the LASPAUCOLCIENCIAS grant 136-2008, the University of Valle contract 644-19-04-95, and the consolidated research group’s grant SGR2009-00380
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

A Study on the Robustness of Shape Descriptors to common scanning artifacts

  • Roure Garcia, Ferran
  • Diez, Yago
  • Lladó Bardera, Xavier
  • Forest Collado, Josep
  • Pribanic, Tomislav
  • Salvi, Joaquim
Registration is a fundamental problem in a myriad of applications ranging from heritage reconstruction to industrial applications. Descriptors are an important part of the registration pipeline as well as a very active research field. However, the sets used to illustrate descriptor performance have often undergone several preprocessing steps such as noise filtering, hole filling or outlier removal. These steps simplify the problem but are not readily available in many applications. In this paper we compare the performances of 4 state of the art shape descriptors: SHOT [1], Spin Image [2], FPFH [3] and 3DSC [4]. Experiments were carried out with real as well as synthetic data paying special attention to issues commonly present in real data (noise, outliers and low overlap). The method obtaining a best result overall is SHOT, based mostly on the results with synthetic data. Experiments with real data showed how state of the art descriptors are not yet able to produce optimal results in the most challenging scenarios, This work has been supported by the FP7-ICT-2011-7 project PANDORA-Persistent Autonomy through Learning, Adaptation, Observation and Replanning (Ref 288273) funded by the European Commission and the project RAIMON-Autonomous Underwater Robot for Marine Fish Farms Inspection and Monitoring (Ref CTM2011-29691-C02-02) funded by the Ministry of Economy and Competitiveness of the Spanish Government
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Fourier-based registration for robust forward-looking sonar mosaicing in low-visibility underwater environments

  • Hurtós Vilarnau, Natàlia
  • Ribas Romagós, David
  • Cufí i Solé, Xavier
  • Petillot, Yvan R.
  • Salvi, Joaquim
Vehicle operations in underwater environments are often compromised by poor visibility conditions. For instance, the perception range of optical devices is heavily constrained in turbid waters, thus complicating navigation and mapping tasks in environments such as harbors, bays, or rivers. A new generation of high-definition forward-looking sonars providing acoustic imagery at high frame rates has recently emerged as a promising alternative for working under these challenging conditions. However, the characteristics of the sonar data introduce difficulties in image registration, a key step in mosaicing and motion estimation applications. In this work, we propose the use of a Fourier-based registration technique capable of handling the low resolution, noise, and artifacts associated with sonar image formation. When compared to a state-of-the art region-based technique, our approach shows superior performance in the alignment of both consecutive and nonconsecutive views as well as higher robustness in featureless environments. The method is used to compute pose constraints between sonar frames that, integrated inside a global alignment framework, enable the rendering of consistent acoustic mosaics with high detail and increased resolution. An extensive experimental section is reported showing results in relevant field applications, such as ship hull inspection and harbor mapping, This work has been supported by the FP7-ICT-2011-7 project PANDORA-Persistent Autonomy through Learning, Adaptation, Observation and Re-planning (Ref. 288273) funded by the European Commission, and the Spanish Project ANDREA/RAIMON (Ref. CTM2011-29691-C02-02) funded by the Ministry of Science and Innovation. The authors would like to thank Soundmetrics Corp., Bluefin Robotics Corp. and the Centre for Maritime Research and Experimentation (CMRE) for providing some of the sonar data
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Evaluation of Registration Methods on Two-Dimensional Forward-Looking Sonar Imagery

  • Hurtós Vilarnau, Natàlia
  • Nagappa, Sharad
  • Cufí i Solé, Xavier
  • Petillot, Yvan R.
  • Salvi, Joaquim
Two-dimensional forward-looking sonars such as Blueview or DIDSON are becoming a standard sensor in both remotely-operated and autonomous underwater vehicles. Registration of imagery obtained from this sensors is of great interest since it constitutes a key step in several applications like the generation of acoustic mosaics or the extraction of vehicle motion estimates from sonar imagery, specially on poor visibility conditions. However, the characteristics of these sonar images, such as low signal-to-noise ratio, low resolution and intensity alterations due to viewpoint changes pose a challenge to the traditional registration techniques applied on optical images. In this paper, the performance of popular registration methods commonly used in photomosaicing are evaluated on real sonar data, including feature-based methods and an areabased approach. Experiments are carried out on different environments, from man-made structured scenarios to more natural and featureless areas, and under challenging conditions such as viewpoint changes and the presence of different sonarspecific artifacts. After assessing the impact of all these factors on the different registration techniques, we show that Fourierbased registration method stands as the more robust option to register acoustic imagery, This work has been supported by the FP7-ICT-2011-7 project PANDORA-Persistent Autonomy through Learning, Adaptation, Observation and Re-planning (Ref 288273) funded by the European Commission and the Spanish Project ANDREA/RAIMON (Ref CTM2011-29691-C02-02) funded by the Ministry of Science and Innovation
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Fourier-based registrations for two-dimensional forward-looking sonar image mosaicing

  • Hurtós Vilarnau, Natàlia
  • Cufí i Solé, Xavier
  • Petillot, Yvan R.
  • Salvi, Joaquim
This paper presents a method to build large-scale mosaics adapted to underwater sonar imagery. By assuming a simplified imaging model, we propose to address the registrations between images using Fourier-based methods which, unlike feature-based methods, prove well suited to handle the characteristics of forward-looking sonar images, such as low resolution, noise, occlusions and moving shadows. The registration between spatially and temporally distant images resulting from loop-closing situations or registrations in featureless areas are feasible, overcoming the main difficulties of feature-based methods. The problem is cast as a pose-based graph optimization, taking into account the uncertainties of the pairwise registrations and being able to incorporate navigation information. After the optimization, a consistent mosaic from different tracklines is generated with increased resolution and higher signal-to-noise ratio than the original images, while the vehicle motion in x,y and heading is also estimated. © 2012 IEEE., This work has been partially supported by the FP7-ICT-2011-7 project PANDORA (Ref 288273) funded by the European Commission, the Raimon project CTM2011-29691-C02-02 and the grant BES-2008-006095
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

A qualitative review on 3D coarse registration methods

  • Diez, Yago
  • Roure Garcia, Ferran
  • Lladó Bardera, Xavier
  • Salvi, Joaquim
3D registration or matching is a crucial step in 3D model reconstruction. Registration applications span along a variety of research fields, including computational geometry, computer vision, and geometric modeling. This variety of applications produces many diverse approaches to the problem but at the same time yields divergent notations and a lack of standardized algorithms and guidelines to classify existing methods. In this article, we review the state of the art of the 3D rigid registration topic (focused on Coarse Matching) and offer qualitative comparison between the most relevant approaches. Furthermore, we propose a pipeline to classify the existing methods and define a standard formal notation, offering a global point of view of the literature. Our discussion, based on the results presented in the analyzed papers, shows how, although certain aspects of the registration process still need to be tested further in real application situations, the registration pipeline as a whole has progressed steadily. As a result of this progress in all registration aspects, it is now possible to put together algorithms that are able to tackle new and challenging problems with unprecedented data sizes and meeting strict precision criteria, This work has been supported by the FP7-ICT-2011-7 project PANDORA-Persistent Autonomy through Learning, Adaptation, Observation and Re-planning (Ref 288273) funded by the European Commission and the project RAIMON-Autonomous Underwater Robot for Marine Fish Farms Inspection and Monitoring (Ref CTM2011-29691-C02-02) funded by the Ministry of Economy and Competitiveness of the Spanish government. Ferran Roure is supported by an FPI scholarship associated with the RAIMON project
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Vertical edge-based mapping using range-augmented omnidirectional vision sensor

  • Bacca Cortés, Eval Bladimir
  • Cufí i Solé, Xavier
  • Salvi, Joaquim
Laser range finder and omnidirectional cameras are becoming a promising combination of sensors to extract rich environmental information. This information includes textured plane extraction, vanishing points, catadioptric projection of vertical and horizontal lines, or invariant image features. However, many indoor scenes do not have enough texture information to describe the environment. In these situations, vertical edges could be used instead. This study presents a sensor model that is able to extract three-dimensional position of vertical edges from a range-augmented omnidirectional vision sensor. Using the unified spherical model for central catadioptric sensors and the proposed sensor model, the vertical edges are locally projected, improving the data association for mapping and localisation. The proposed sensor model was tested using the FastSLAM algorithm to solve the simultaneous localisation and mapping problem in indoor environments. Real-world qualitative and quantitative experiments are presented to validate the proposed approach using a Pioneer-3DX mobile robot equipped with a URG-04LX laser range finder and an omnidirectional camera with parabolic mirror, This work has been partially supported by the project RAIMON - Autonomous Underwater Robot for Marine Fish Farms Inspection and Monitoring (Ref. CTM2011-29691-C02-02)funded by the Spanish Ministry of Science and Innovation, the LASPAU-COLCIENCIAS grant no. 136-2008, the University of Valle contract no. 644-19-04-95, and the consolidated research group's grant no. SGR2009-00380
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

One-shot absolute pattern for dense reconstruction using DeBruijn coding and Windowed Fourier Transform

  • Fernández Navarro, Sergio
  • Salvi, Joaquim
Shape reconstruction using coded structured light (SL) is considered one of the most reliable techniques to recover object surfaces. Among SL techniques, the achievement of dense acquisition for moving scenarios constitutes an active field of research. A common solution is to project a single one-shot fringe pattern, extracting depth from the phase deviation of the imaged pattern. However, the algorithms employed to unwrap the phase are computationally slow and can fail in the presence of depth discontinuities and occlusions. In this work, a proposal for a new one-shot dense pattern that combines DeBruijn and Windowed Fourier Transform to obtain a dense, absolute, accurate and computationally fast 3D reconstruction is presented and compared with other existing techniques, This work has been partly supported by the FP7-ICT-2011-7 project PANDORA-Persistent Autonomy through Learning, Adaptation, Observation and Re-planning (Ref 288273) funded by the European Commission and the project RAIMON-Autonomous Underwater Robot for Marine Fish Farms Inspection and Monitoring (Ref CTM2011-29691-C02-02) funded by the Spanish Ministry of Science and Innovation. S. Fernandez is supported by the Spanish government scholarship FPU