Skip to main content

Resultados relacionados

Resultados totales (Incluyendo duplicados): 85
Encontrada(s) 1 página(s)

RUC. Repositorio da Universidade da Coruña
Publication Contribución de congreso (ConferenceOutput)

Los primeros robots manipuladores aéreos

  • Ollero Baturone, Aníbal
  • Viguria, Antidio
  • Maza, Ivan
  • Trujillo Soto, Miguel Ángel
  • Heredia, Guillermo
  • Cano, Raúl
  • Caballero, Fernando
  • Lasagni, Fernando
  • Acosta, J. Á.
  • Santos, Silvia de los
  • Cobano-Suárez, José-Antonio
[Resumen] En este artículo se describen los primeros robots manipuladores aéreos dotados con brazos robóticos de seis grados de libertad y capacidades de percepción y planificación que se han desarrollado en el mundo. Estos robots son el resultado del proyecto ARCAS (Aerial Robotics Cooperative Assembly System) coordinado por el primero de los autores y financiado por el Séptimo Programa Marco de la Unión Europea. Los resultados de este proyecto han comenzado a emplearse, entre otros, en el proyecto H2020 AEROARMS y en el español AEROMAIN. El artículo introduce las diferentes plataformas utilizadas en el proyecto y a continuación resume las principales características de los sistemas de control, percepción y planificación desarrollados. Se resume también la integración y validación del sistema., Este trabajo ha sido financiado parcialmente por el Proyecto Europeo del FP7 ARCAS (ICT-2011-287617) y por el H2020 AEROARMS (ICT-23-2014-644271), así como por el proyecto nacional AEROMAIN DPI2014-59383-C2-1-R del Ministerio de Economía y Competitividad, https://doi.org/10.17979/spudc.9788497498081
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Contribución de congreso (ConferenceOutput)

Active Pose SLAM

  • Valencia, Rafael
  • Valls Miró, Jaime
  • Dissanayake, Gamini
  • Andrade-Cetto, Juan
Trabajo presentado al IROS celebrado en Vilamoura (Portugal) del 7 al 12 de octubre de 2012., We present an active exploration strategy that complements Pose SLAM and optimal navigation in Pose SLAM. The method evaluates the utility of exploratory and place revisiting sequences and chooses the one that minimizes overall map and path entropies. The technique considers trajectories of similar path length taking marginal pose uncertainties into account. An advantage of the proposed strategy with respect to competing approaches is that to evaluate information gain over the map, only a very coarse prior map estimate needs to be computed. Its coarseness is independent and does not jeopardize the Pose SLAM estimate. Moreover, a replanning scheme is devised to detect significant localization improvement during path execution. The approach is tested in simulations in a common publicly available dataset comparing favorably against frontier based exploration., This work has been partially funded by the Spanish Ministry of Economy and Competitiveness under projects PAU+ DPI2011-27510 and MIPRCV Consolider Ingenio 2010 CSD2007-00018, and by the EU project ARCAS FP7-287617. R. Valencia was supported by a grant from the Agència de Gestió d’Ajuts Universitaris i de Recerca of The Generalitat of Catalonia (2010 BE1 00967) and a PhD scholarship from the Mexican Council of Science and Technology., Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Contribución de congreso (ConferenceOutput)

Dense segmentation-aware descriptors

  • Trulls, Eduard
  • Kokkinos, Iasonas
  • Sanfeliu, Alberto
  • Moreno-Noguer, Francesc
Trabajo presentado al CVPR celebrado en Portland del 23 al 28 de junio de 2013., In this work we exploit segmentation to construct appearance descriptors that can robustly deal with occlusion and background changes. For this, we downplay measurements coming from areas that are unlikely to belong to the same region as the descriptor¿s center, as suggested by soft segmentation masks. Our treatment is applicable to any image point, i.e. dense, and its computational overhead is in the order of a few seconds. We integrate this idea with Dense SIFT, and also with Dense Scale and Rotation Invariant Descriptors (SID), delivering descriptors that are densely computable, invariant to scaling and rotation, and robust to background changes. We apply our approach to standard benchmarks on large displacement motion estimation using SIFT-flow and widebaseline stereo, systematically demonstrating that the introduction of segmentation yields clear improvements., This work has been partially funded by Spanish Ministry of Economy and Competitiveness under projects PAU+ DPI2011-27510, TaskCoop DPI2010-17112, and ERA-Net Chistera project ViSen PCIN-2013-047; by the EU project ARCAS FP7-ICT-2011-28761; by grant ANR-10-JCJC-0205; and by the EU Project MOBOT FP7-ICT-2011-600796. E. Trulls is supported by Universitat Politècnica de Catalunya., Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Contribución de congreso (ConferenceOutput)

HRA*: Hybrid randomized path planning for complex 3D environments

  • Teniente, Ernesto H.
  • Andrade-Cetto, Juan
Trabajo presentado al IROS celebrado en Tokyo del 3 al 7 de noviembre de 2013., We propose HRA*, a new randomized path planner for complex 3D environments. The method is a modified A* algorithm that uses a hybrid node expansion technique that combines a random exploration of the action space meeting vehicle kinematic constraints with a cost to goal metric that considers only kinematically feasible paths to the goal. The method includes also a series of heuristics to accelerate the search time. These include a cost penalty near obstacles, and a filter to prevent revisiting configurations. The performance of the method is compared against A*, RRT and RRT* in a series of challenging 3D outdoor datasets. HRA* is shown to outperform all of them in computation time, and delivering shorter paths than A* and RRT., This work has been partially supported by the Mexican Council of Science and Technology with a PhD Scholarship to Ernesto Teniente, by the Spanish Ministry of Science and Innovation under project DPI-2011-27510 and by the EU project ARCAS FP7-287617., Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Contribución de congreso (ConferenceOutput)

Uncalibrated image-based visual servoing

  • Santamaria-Navarro, Àngel
  • Andrade-Cetto, Juan
Trabajo presentado al ICRA celebrado en Karlsruhe del 6 al 10 de mayo de 2013., This paper develops a new method for uncalibrated image-based visual servoing. In contrast to traditional image-based visual servo, the proposed solution does not require a known value of camera focal length for the computation of the image Jacobian. Instead, it is estimated at run time from the observation of the tracked target. The technique is shown to outperform classical visual servoing schemes in situations with noisy calibration parameters and for unexpected changes in the camera zoom. The method¿s performance is demonstrated both in simulation experiments and in a ROS implementation of a quadrotor servoing task. The developed solution is tightly integrated with ROS and is made available as part of the IRI ROS stack., This work has been partially funded by the Spanish Ministry of Economy and Competitiveness under project PAU+ DPI2011-27510 and by the EU project ARCAS FP7-287617., Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Contribución de congreso (ConferenceOutput)

Spatiotemporal descriptor for wide-baseline stereo reconstruction of non-rigid and ambiguous scenes

  • Trulls, Eduard
  • Sanfeliu, Alberto
  • Moreno-Noguer, Francesc
Trabajo presentado a la 12th European Conference on Computer Vision celebrado en Florencia del 7 al 13 de octubre de 2012., This paper studies the use of temporal consistency to match appear- ance descriptors and handle complex ambiguities when computing dynamic depth maps from stereo. Previous attempts have designed 3D descriptors over the space- time volume and have been mostly used for monocular action recognition, as they cannot deal with perspective changes. Our approach is based on a state-of-the-art 2D dense appearance descriptor which we extend in time by means of optical flow priors, and can be applied to wide-baseline stereo setups. The basic idea behind our approach is to capture the changes around a feature point in time instead of trying to describe the spatiotemporal volume. We demonstrate its effectiveness on very ambiguous synthetic video sequences with ground truth data, as well as real sequences., Work supported by the Spanish Ministry of Science and Innovation under projects Rob- TaskCoop (DPI2010-17112), PAU+ (DPI2011-27510) and MIPRCV (Consolider-Ingenio 2010)(CSD2007-00018), and the EU ARCAS Project FP7-ICT-2011-287617. E. Trulls is supported by scholarship from Universitat Politècnica de Catalunya., Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Contribución de congreso (ConferenceOutput)

Exploration using an information-based reaction-diffusion process

  • Jadidi, Maani Ghaffari
  • Valls Miró, Jaime
  • Valencia, Rafael
  • Andrade-Cetto, Juan
  • Dissanayake, Gamini
Trabajo presentado al ACRA 2013 celebrado en Sidney del 2 al 4 de diciembre., In this paper, a novel solution for autonomous robotic exploration is proposed. We model the distribution of information in an unknown environment as an unsteady diffusion process, which can be an appropriate mathematical formulation and analogy for expanding, time-varying, and dynamic environments. This information distribution map is the solution of the diffusion process partial differential equation, and is regressed from sensor data as a Gaussian Process. Optimization of the process parameters leads to an optimal frontier map which describes regions of interest for further exploration. Since the presented approach considers a continuous model of the environment, it can be used to plan smooth exploration paths exploiting the structural dependencies of the environment whilst handling sparse sensor measurements. The performance of the approach is evaluated through simulation results in the well-known Freiburg and Cave maps., J. Andrade acknowledges support from the Spanish Ministry of Economy and Competitiveness project PAU+ DPI 2011-27510 and the EU FP7 project ARCAS ICT-287617. R. Valencia acknowledges support from the EU FP7 project SPENCER ICT-600877., Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Contribución de congreso (ConferenceOutput)

Simultaneous pose, focal length and 2D-to-3D correspondences from noisy observations

  • Peñate-Sánchez, Adrián
  • Serradell, Eduard
  • Andrade-Cetto, Juan
  • Moreno-Noguer, Francesc
Presentado al 24th BMVC celebrado en Bristol (UK) del 9 al 13 de septiembre 2013.-- The copyright of this document resides with its authors., Simultaneously recovering the camera pose and correspondences between a set of 2D-image and 3D-model points is a difficult problem, especially when the 2D-3D matches cannot be established based on appearance only. The problem becomes even more challenging when input images are acquired with an uncalibrated camera with varying zoom, which yields strong ambiguities between translation and focal length. We present a solution to this problem using only geometrical information. Our approach owes its robustness to an initial stage in which the joint pose and focal length solution space is split into several Gaussian regions. At runtime, each of these regions is explored using an hypothesize-and-test approach, in which the potential number of 2D-3D matches is progressively reduced using informed search through Kalman updates, iteratively refining the pose and focal length parameters. The technique is exhaustive but efficient, significantly improving previous methods in terms of robustness to outliers and noise., This work has been partially funded by Spanish Ministry of Economy and Competitiveness under project PAU+DPI2011-27510; by the EU project ARCAS FP7-ICT-2011-28761 and by the ERA-Net CHISTERA project VISEN PCIN-2013-047, Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Contribución de congreso (ConferenceOutput)

Exploration in information distribution maps

  • Jadidi, Maani Ghaffari
  • Valls Miró, Jaime
  • Valencia, Rafael
  • Andrade-Cetto, Juan
  • Dissanayake, Gamini
Presentado al Robotics: Science and Systems: Workshop on Robotic Exploration, Monitoring, and Information Collection celebrado en Berlin del 24 al 28 de junio de 2013., In this paper, a novel solution for autonomous robotic exploration is proposed. The distribution of information in an unknown environment is modeled as an unsteady diffusion process, which can be an appropriate mathematical formulation and analogy for expanding, time-varying, and dynamic environments. This information distribution map is the solution of the diffusion process partial differential equation, and is regressed from sensor data as a Gaussian Process. Optimization of the process parameters leads to an optimal frontier map which describes regions of interest for further exploration. Since the presented approach considers a continuous model of the environment, it can be used to plan smooth exploration paths exploiting the structural dependencies of the environment whilst handling sparse sensors measurements. The performance of the proposed approach is evaluated through simulation results in the well-known Freiburg and Cave maps., J. Andrade acknowledges support from the Spanish Ministry of Economy and Competitiveness project PAU+ DPI 2011-27510 and the EU FP7 project ARCAS ICT-287617. R. Valencia acknowledges support from the EU FP7 project SPENCER ICT-600877., Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Contribución de congreso (ConferenceOutput)

Estimation of camera calibration uncertainty using LIDAR data

  • Ortega, Agustín
  • Galego, Ricardo
  • Ferreira, Ricardo
  • Bernardino, Alexandre
  • Gaspar, José
  • Andrade-Cetto, Juan
Presentado al 6th ECMR celebrado en Barcelona del 25 al 27 de septiembre de 2013., This paper presents an analysis of uncertainty in the calibration of a network of cameras. A global 3D scene model, acquired with a LIDAR scanner, allows calibrating cameras with non overlapping ¿elds of view by means of the DLT-Lines algorithm. Once the projection matrix is computed for each camera, error sources are propagated to compute estimates of each camera position uncertainty. We validate the consistency of the uncertainty analysis with Monte-Carlo simulations, and apply the technique in a real camera network. This allows to evaluate the accuracy of DLT-Lines in real settings., A. Ortega acknowledges support from a PhD scholarship from the Mexican Council of Science and Technology (CONACYT) and a Research Stay Grant from the Agència de Gestiò d’Ajuts Universitaris i de Recerca (AGAUR) of The Generalitat of Catalonia (2012 CTP00013). The work is also funded by the Portuguese Science Foundation (FCT) project PEst-OE / EEI / LA0009 / 2011, by the FCT project PTDC / EEACRO / 105413 / 2008 DCCAL, and by the project High Definition Analytics (HDA), QREN - I&D em Co-Promoçao 13750; as well as the the Spanish Ministry of Economy and Competitiveness Project PAU+ (DPI-2011-27510) and the EU Project ARCAS (FP7-287617)., Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Contribución de congreso (ConferenceOutput)

Mobile robot exploration with potential information fields

  • Vallvé, Joan
  • Andrade-Cetto, Juan
Presentado al 6th ECMR celebrado en Barcelona del 25 al 27 de septiembre de 2013., We present a mobile robot exploration strategy that computes trajectories that minimize both path and map entropies. The method evaluates joint entropy reduction and computes a potential field in robot configuration space using these joint entropy reduction estimates. The exploration trajectory is computed descending on the gradient of these field. The technique uses Pose SLAM as its estimation backbone. Very efficient kernel convolution mechanisms are used to evaluate entropy reduction for each sensor ray, and for each possible robot orientation, taking frontiers and obstacles into account. In the end, the computation of this field on the entire C-space is shown to be very efficient computationally. The approach is tested in simulations in a common publicly available dataset comparing favorably both in quality of estimates and execution time against another entropy reduction strategy that uses occupancy maps., This work has been supported by the Spanish Ministry of Economy and Competitiveness under Project DPI-2011-27510 and by the EU Project ARCAS FP7-287617., Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Contribución de congreso (ConferenceOutput)

A motion planning approach to 6-D manipulation with aerial towed-cable systems

  • Manubens, Montserrat
  • Devaurs, Didier
  • Ros, Lluís
  • Cortés, Juan
Presentado al International Micro Air Vehicle Conference and Flight Competition celebrado en Toulouse (Francia) del 17 al 20 de septiembre de 2013., We propose a new approach for the reliable 6-dimensional quasi-static manipulation with aerial towed- cable systems. The novelty of this approach lies in the combination of results deriving from the static analysis of cable-driven manipulators with a cost-based motion-planning algorithm to solve manipulation queries. Such a combination of methods is able to produce feasible paths that do not approach dangerous/uncontrollable configurations of the system. As part of our approach, we also propose an original system that we name the FlyCrane. It consists of a platform attached to three flying robots using six fixed-length cables. Results of simulations on 6-D quasi-static manipulation problems show the interest of the method., This work has been partially supported by the Spanish Ministry of Economy and Competitiveness under contract DPI2010-18449, by the European Community under contract ICT 287617 “ARCAS”, and by a Juan de la Cierva contract supporting the first author., Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Contribución de congreso (ConferenceOutput)

Motion planning for 6D manipulation with aerial towed-cable systems

  • Manubens, Montserrat
  • Devaurs, Didier
  • Ros, Lluís
  • Cortés, Juan
Trabajo presentado al IX Robotics: Science and Systems celebrado en Berlín del 24 al 28 de junio de 2013., Performing aerial 6-dimensional manipulation using flying robots is a challenging problem, to which only little work has been devoted. This paper proposes a motion planning approach for the reliable 6-dimensional quasi-static manipulation with an aerial towed-cable system. The novelty of this approach lies in the use of a cost-based motion-planning algorithm together with some results deriving from the static analysis of cable- driven manipulators. Based on the so-called wrench-feasibility constraints applied to the cable tensions, as well as thrust constraints applied to the flying robots, we formally characterize the set of feasible configurations of the system. Besides, the expression of these constraints leads to a criterion to evaluate the quality of a configuration. This allows us to define a cost function over the configuration space, which we exploit to compute good-quality paths using the T-RRT algorithm. As part of our approach, we also propose an aerial towed-cable system that we name the FlyCrane. It consists of a platform attached to three flying robots using six fixed-length cables. We validate the proposed approach on two simulated 6-D quasi-static manipulation problems involving such a system, and show the benefit of taking the cost function into account for such motion planning tasks., This work has been partially supported and by the Spanish Ministry of Economy and Competitiveness under contract DPI2010-18449, by the European Community under contract ICT 287617 “ARCAS”, and by a Juan de la Cierva contract supporting the first author., Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Contribución de congreso (ConferenceOutput)

Proactive behavior of an autonomous mobile robot for human-assisted learning

  • Garrell, Anaís
  • Villamizar, Michael
  • Moreno-Noguer, Francesc
  • Moreno-Noguer, Francesc
  • Sanfeliu, Alberto
Presentado al 22nd IEEE International Symposium on Robot and Human Interactive Communication celebrado en Gyeongju (Korea) del 26 al 29 de agosto de 2013., During the last decade, there has been a growing interest in making autonomous social robots able to interact with people. However, there are still many open issues regarding the social capabilities that robots should have in order to perform these interactions more naturally. In this paper we present the results of several experiments conducted at the Barcelona Robot Lab in the campus of the “Universitat Politècnica de Catalunya” in which we have analyzed different important aspects of the interaction between a mobile robot and nontrained human volunteers. First, we have proposed different robot behaviors to approach a person and create an engagement with him/her. In order to perform this task we have provided the robot with several perception and action capabilities, such as that of detecting people, planning an approach and verbally communicating its intention to initiate a conversation. Once the initial engagement has been created, we have developed further communication skills in order to let people assist the robot and improve its face recognition system. After this assisted and online learning stage, the robot becomes able to detect people under severe changing conditions, which, in turn enhances the number and the manner that subsequent human-robot interactions are performed., Work supported by the Spanish Ministry of Science and Innovation under projects RobTaskCoop(DPI2010-17112) and the EU ARCAS Project FP7-ICT-2011-287617., Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Contribución de congreso (ConferenceOutput)

6-D manipulation with aerial towed-cable system

  • Manubens, Montserrat
  • Devaurs, Didier
  • Cortés, Juan
  • Ros, Lluís
Presentado al Robotics: Science and Systems: Workshop on Aerial Mobile Manipulation celebrado en Berlin del 24 al 28 de junio de 2013., We propose a new approach for the reliable 6- dimensional quasi-static manipulation of an aerial towed-cable system. The novelty of this approach lies in the combination of results deriving from the static analysis of cable-driven manipulators with the application of a cost-based motion-planning algorithm to solve manipulation queries. Using this approach, we can ensure that the produced paths are feasible and do not approach dangerous configurations that could provoque the malfunction of the system. The approach has been simulated on the FlyCrane, consisting of a platform attached to three flying robots using six fixed-length cables. The obtained results show the success and the suitability of the approach., This work has been partially supported by the European Community under contract ICT 287617 ”ARCAS“, by the Spanish Ministry of Economy and Competitiveness under contract DPI2010-18449, and by a Juan de la Cierva contract supporting the first author., Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Contribución de congreso (ConferenceOutput)

Task priority control for aerial manipulation

  • Santamaria-Navarro, Àngel
  • Lippiello, Vincenzo
  • Andrade-Cetto, Juan
Trabajo presentado al IEEE International Symposium on Safety, Security and Rescue Robotics (SSRR) celebrado en Hokkaido (Japón) del 27 al 30 de octubre de 2014., This paper presents a task oriented control strategy for aerial vehicles equipped with a manipulator. A camera is attached to the end-effector of the manipulator to perform a primary task consisting on visual servoing towards a desired target. Over-actuation of the whole quadrotor-arm system is exploited to achieve secondary velocity tasks. One subtask is proposed to horizontally stabilize the platform during flight by aligning the arm center of gravity with the quadrotor gravitational vector. The arm singularities and manipulability are addressed by another subtask that leads the arm to a preferable configuration, and also takes into account the arm joint limits. The performance of the whole visual servo and secondary tasks control scheme is shown in a Robot Operating System (ROS) implementation., This work has been partially funded by the EU project ARCAS FP7-ICT-287617., Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Contribución de congreso (ConferenceOutput)

Estimación monocular y eficiente de la pose usando modelos 3D complejos

  • Rubio Romano, Antonio
  • Villamizar, Michael
  • Ferraz, Luis
  • Peñate-Sánchez, Adrián
  • Sanfeliu, Alberto
  • Moreno-Noguer, Francesc
Trabajo presentado a las XXXV Jornadas de Automática celebradas en Valencia del 3 al 5 de septiembre de 2014.-- Premio Infaimon a mejor artículo de visión., El siguiente documento presenta un método robusto y eficiente para estimar la pose de una cámara. El método propuesto asume el conocimiento previo de un modelo 3D del entorno, y compara una nueva imagen de entrada únicamente con un conjunto pequeño de imágenes similares seleccionadas previamente por un algoritmo de >Bag of Visual Words>. De esta forma se evita el alto coste computacional de calcular la correspondencia de los puntos 2D de la imagen de entrada contra todos los puntos 3D de un modelo complejo, que en nuestro caso contiene más de 100,000 puntos. La estimación de la pose se lleva a cabo a partir de estas correspondencias 2D-3D utilizando un novedoso algoritmo de PnP que realiza la eliminación de valores atípicos (outliers) sin necesidad de utilizar RANSAC, y que es entre 10 y 100 veces más rápido que los métodos que lo utilizan., Este trabajo ha estado financiado en parte por los proyectos RobTaskCoop DPI2010-17112, ERA-Net Chistera ViSen PCIN-2013-047, y por el proyecto EU ARCAS FP7-ICT-2011-287617., Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Contribución de congreso (ConferenceOutput)

Hierarchical task control for aerial inspection

  • Santamaria-Navarro, Àngel
  • Andrade-Cetto, Juan
Trabajo presentado al Workshop and Summer School on Field Robotics (euRathlon/ARCAS), celebrado en Sevilla (España) del 15 al 18 de junio de 2014., This paper presents a task oriented control strategy for aerial vehicles equipped with a robotic arm and a camera attached to its end-effector. With this setting the camera can reach a new set of orientations previously not feasible for the quadrotor. The over-actuation of the whole system is exploited with a hierarchical control law to achieve a primary task consisting on a visual servoing control, whilst secondary tasks can also be attained to minimize gravitational effects or undesired arm configurations. Results are shown in a Robot Operating System (ROS) simulation., This work has been partially funded by the EU project ARCAS FP7-287617., Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Contribución de congreso (ConferenceOutput)

Leveraging feature uncertainty in the PnP problem

  • Ferraz, Luis
  • Binefa, Xavier
  • Moreno-Noguer, Francesc
Trabajo presentado a la 25th British Machine Vision Conference (BMVC), celebrada en Nottingham (UK) del 1 al 5 de septiembre de 2014.-- Este ítem (excepto textos e imágenes no creados por el autor) está sujeto a una licencia de Creative Commons: Attribution-NonCommercial-NoDerivs 3.0 Spain., We propose a real-time and accurate solution to the Perspective-n-Point (PnP) problem --estimating the pose of a calibrated camera from n 3D-to-2D point correspondences-- that exploits the fact that in practice the 2D position of not all 2D features is estimated with the same accuracy. Assuming a model of such feature uncertainties is known in advance, we reformulate the PnP problem as a maximum likelihood minimization approximated by an unconstrained Sampson error function, which naturally penalizes the most noisy correspondences. The advantages of this approach are clearly demonstrated in synthetic experiments where feature uncertainties are exactly known. Pre-estimating the features uncertainties in real experiments is, though, not easy. In this paper we model feature uncertainty as 2D Gaussian distributions representing the sensitivity of the 2D feature detectors to different camera viewpoints. When using these noise models with our PnP formulation we still obtain promising pose estimation results that outperform the most recent approaches., This work has been partially funded by Spanish government under projects DPI2011-27510, IPT-2012-0630-020000, IPT-2011-1015-430000 and CICYT grant TIN2012-39203; by the EU project ARCAS FP7-ICT-2011-28761; and by the ERA-Net Chistera project ViSen PCIN-2013-047., Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Contribución de congreso (ConferenceOutput)

LETHA: Learning from high quality inputs for 3D pose estimation in low quality images

  • Peñate-Sánchez, Adrián
  • Moreno-Noguer, Francesc
  • Andrade-Cetto, Juan
  • Fleuret, François
Trabajo presentado a la 2nd International Conference on 3D Vision (3DV), celebrada en Tokyo (Japón) del 8 al 11 de diciembre de 2014., We introduce LETHA (Learning on Easy data, Test on Hard), a new learning paradigm consisting of building strong priors from high quality training data, and combining them with discriminative machine learning to deal with low- quality test data. Our main contribution is an implementation of that concept for pose estimation. We first automatically build a 3D model of the object of interest from high-definition images, and devise from it a pose-indexed feature extraction scheme. We then train a single classifier to process these feature vectors. Given a low quality test image, we visit many hypothetical poses, extract features consistently and evaluate the response of the classifier. Since this process uses locations recorded during learning, it does not require matching points anymore. We use a boosting procedure to train this classifier common to all poses, which is able to deal with missing features, due in this context to self-occlusion. Our results demonstrate that the method combines the strengths of global image representations, discriminative even for very tiny images, and the robustness to occlusions of approaches based on local feature point descriptors., This work has been partially funded by Spanish Ministry of Economy and Competitiveness under project PAU+DPI2011-27510 and ERA-Net Chistera project ViSen PCIN-2013-047; and by the EU project ARCAS FP7-ICT-2011-28761; A. Penate-Sanchez is the recipient of a JAE-Predoc scholarship funded by the European Social Fund., Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Contribución de congreso (ConferenceOutput)

Efficient monocular pose estimation for complex 3D models

  • Rubio Romano, Antonio
  • Villamizar, Michael
  • Ferraz, Luis
  • Peñate-Sánchez, Adrián
  • Ramisa, Arnau
  • Simo-Serra, Edgar
  • Sanfeliu, Alberto
  • Moreno-Noguer, Francesc
Trabajo presentado al ICRA celebrado en Seattle (US) del 26 al 30 de mayo de 2015., We propose a robust and efficient method to estimate the pose of a camera with respect to complex 3D textured models of the environment that can potentially contain more than 100, 000 points. To tackle this problem we follow a top down approach where we combine high-level deep network classifiers with low level geometric approaches to come up with a solution that is fast, robust and accurate. Given an input image, we initially use a pre-trained deep network to compute a rough estimation of the camera pose. This initial estimate constrains the number of 3D model points that can be seen from the camera viewpoint. We then establish 3D-to-2D correspondences between these potentially visible points of the model and the 2D detected image features. Accurate pose estimation is finally obtained from the 2D-to-3D correspondences using a novel PnP algorithm that rejects outliers without the need to use a RANSAC strategy, and which is between 10 and 100 times faster than other methods that use it. Two real experimentsdealing with very large and complex 3D models demonstrate the effectiveness of the approach., This work has been partially funded by the Spanish Ministry of Economy and Competitiveness under projects ERANet Chistera project ViSen PCIN-2013-047, PAU+ DPI2011-27510 and ROBOT-INT-COOP DPI2013-42458-P, and by the EU project ARCAS FP7-ICT-2011-28761., Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Contribución de congreso (ConferenceOutput)

Modeling robot's world with minimal effort

  • Villamizar, Michael
  • Garrell, Anaís
  • Sanfeliu, Alberto
  • Sanfeliu, Alberto
  • Moreno-Noguer, Francesc
Trabajo presentado al ICRA celebrado en Seattle (US) del 26 al 30 de mayo de 2015., We propose an efficient Human Robot Interaction approach to efficiently model the appearance of all relevant objects in robot's environment. Given an input video stream recorded while the robot is navigating, the user just needs to annotate a very small number of frames to build specific classifiers for each of the objects of interest. At the core of the method, there are several random ferns classifiers that share the same features and are updated online. The resulting methodology is fast (runs at 8 fps), versatile (it can be applied to unconstrained scenarios), scalable (real experiments show we can model up to 30 different object classes), and minimizes the amount of human intervention by leveraging the uncertainty measures associated to each classifier. We thoroughly validate the approach on synthetic data and on real sequences acquired with a mobile platform in outdoor and challenging scenarios containing a multitude of different objects. We show that the human can, with minimal effort, provide the robot with a detailed model of the objects in the scene., Work partially supported by the Spanish Ministry of Science and Innovation under project DPI2013-42458-P, ERA-Net Chistera project ViSen PCIN-2013-047, and by the EU project ARCAS FP7-ICT-2011-28761., Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Contribución de congreso (ConferenceOutput)

Multimodal object recognition using random clustering trees

  • Villamizar, Michael
  • Garrell, Anaís
  • Sanfeliu, Alberto
  • Moreno-Noguer, Francesc
Trabajo presentado a la 7th Iberian Conference (IbPRIA) celebrada en Santiago de Compostela (España) del 17 al 19 de junio de 2015., In this paper, we present an object recognition approach that in addition allows to discover intra-class modalities exhibiting highcorrelated visual information. Unlike to more conventional approaches based on computing multiple specialized classifiers, the proposed approach combines a single classifier, Boosted Random Ferns (BRFs), with probabilistic Latent Semantic Analysis (pLSA) in order to recognize an object class and to find automatically the most prominent intra-class appearance modalities (clusters) through tree-structured visual words. The proposed approach has been validated in synthetic and real experiments where we show that the method is able to recognize objects with multiple appearances., Work partially supported by the Spanish ministry of Science and Innovation under project DPI2013-42458-P, ERA-Net Chistera project ViSen PCIN-2013-047, and by the EU project ARCAS FP7-ICT-2011-28761., Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Contribución de congreso (ConferenceOutput)

Neuroaesthetics in fashion: Modeling the perception of fashionability

  • Simo-Serra, Edgar
  • Fidler, Sanja
  • Moreno-Noguer, Francesc
  • Urtasun, Raquel
Trabajo presentado al CVPR celebrado en Boston (US) del 7 al 12 de junio de 2015., In this paper, we analyze the fashion of clothing of a large social website. Our goal is to learn and predict how fashionable a person looks on a photograph and suggest subtle improvements the user could make to improve her/his appeal. We propose a Conditional Random Field model that jointly reasons about several fashionability factors such as the type of outfit and garments the user is wearing, the type of the user, the photograph¿s setting (e.g., the scenery behind the user), and the fashionability score. Importantly, our model is able to give rich feedback back to the user, conveying which garments or even scenery she/he should change in order to improve fashionability. We demonstrate that our joint approach significantly outperforms a variety of intelligent baselines. We additionally collected a novel heterogeneous dataset with 144,169 user posts containing diverse image, textual and meta information which can be exploited for our task. We also provide a detailed analysis of the data, showing different outfit trends and fashionability scores across the globe and across a span of 6 years., This work has been partially funded by the Spanish MINECO under project PAU+ DPI2011-27510 and ERA-Net Chistera project ViSen PCIN-2013-047; and by the EU project ARCAS FP7-ICT-2011-287617., Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Contribución de congreso (ConferenceOutput)

High-frequency MAV state estimation using low-cost inertial and optical flow measurement units

  • Santamaria-Navarro, Àngel
  • Solà, Joan
  • Andrade-Cetto, Juan
Trabajo presentado a la International Conference on Intelligent Robots and Systems celebrada en Hamburgo (Alemania) del 28 de septiembre al 2 de octubre de 2015., This paper develops a simple and low-cost method for 3D, high-rate vehicle state estimation, specially designed for free-flying Micro Aerial Vehicles (MAVs). We fuse observations from inertial measurement units and the recently appeared low-cost optical flow smart cameras. These smart cameras integrate a sonar altimeter, a triaxial gyrometer and an optical flow sensor, and directly provide metric ego-motion information in the form of body velocities and altitude. Compared to state-of-the-art visual-inertial odometry methods, we are able to drastically reduce the computational load in the main processor unit, and obtain an accurate estimation of the vehicle state at a high update rate of 100Hz. We thus extend the current use of these smart cameras from hovering purposes to odometry estimation. In order to propose a simple algorithmic solution, we investigate the performances of two Kalman filters, in the extended and error-state flavors, alongside a large number of algorithm variations, using simulations and real experiments with precise ground-truth. We observe that the marginal performance gain attained with these algorithm improvements does not pay for the effort of implementing them. We conclude that a classical EKF in its simplest form is sufficient for providing motion estimates that coherently exploit the available measurements., This work has been partially funded by the EU project ARCAS FP7-287617. and by the Spanish Ministry of Economy and Competitiveness projects PAU+ DPI-2011-27510 and ROBINSTRUCT TIN2014-58178-R., Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Contribución de congreso (ConferenceOutput)

Simultaneous pose and non-rigid shape with particle dynamics

  • Agudo Martínez, Antonio
  • Moreno-Noguer, Francesc
In this paper, we propose a sequential solution to simultaneously estimate camera pose and non-rigid 3D shape from a monocular video. In contrast to most existing approaches that rely on global representations of the shape, we model the object at a local level, as an ensemble of particles, each ruled by the linear equation of the Newton's second law of motion. This dynamic model is incorporated into a bundle adjustment framework, in combination with simple regularization components that ensure temporal and spatial consistency of the estimated shape and camera poses. The resulting approach is both efficient and robust to several artifacts such as noisy and missing data or sudden camera motions, while it does not require any training data at all. Validation is done in a variety of real video sequences, including articulated and non-rigid motion, both for continuous and discontinuous shapes. Our system is shown to perform comparable to competing batch, computationally expensive, methods and shows remarkable improvement with respect to the sequential ones., This work was partly funded by the MINECO projects DIP2012-32168 and DPI2011-27510; by the ERA-net CHISTERA project VISEN PCIN-2013-047; by the EU Projects PopCorn FP7-SME-2013 606634 and ARCAS FP7-ICT-2011-287617; and by a scholarship FPU12/04886 of the Spanish MECD., Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Contribución de congreso (ConferenceOutput)

Segmentation-aware deformable part models

  • Trulls, Eduard
  • Tsogkas, Stavros
  • Kokkinos, Iasonas
  • Sanfeliu, Alberto
  • Moreno-Noguer, Francesc
Trabajo presentado a la IEEE Conference on Computer Vision and Pattern Recognition (CVPR), celebrada del 23 al 28 de junio de 2014 en Columbus, Ohio (US)., In this work we propose a technique to combine bottom-up segmentation, coming in the form of SLIC superpixels, with sliding window detectors, such as Deformable Part Models (DPMs). The merit of our approach lies in >cleaning up> the low-level HOG features by exploiting the spatial support of SLIC superpixels, this can be understood as using segmentation to split the feature variation into object-specific and background changes. Rather than committing to a single segmentation we use a large pool of SLIC superpixels and combine them in a scale-, position- and object-dependent manner to build soft segmentation masks. The segmentation masks can be computed fast enough to repeat this process over every candidate window, during training and detection, for both the root and part filters of DPMs. We use these masks to construct enhanced, background-invariant features to train DPMs. We test our approach on the PASCAL VOC 2007, outperforming the standard DPM in 17 out of 20 classes, yielding an average increase of 1.7% AP. Additionally, we demonstrate the robustness of this approach, extending it to dense SIFT descriptors for large displacement optical flow., This work has been partially funded by Spanish Ministry of Economy and Competitiveness under projects PAU+ DPI2011-27510, TaskCoop DPI2010-17112, and ERA-Net Chistera project ViSen PCIN-2013-047; by the EU project ARCAS FP7-ICT-2011-28761; by grant ANR-10-JCJC-0205; and by the EU Project MOBOT FP7-ICT-2011-600796., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

Motion planning for 6D manipulation with aerial towed-cable systems

  • Manubens Ferriol, Montserrat
  • Devaurs, Didier
  • Ros Giralt, Lluís|||0000-0002-8338-6062
  • Cortés, Juan
Performing aerial 6-dimensional manipulation using flying robots is a challenging problem, to which only little work has been devoted. This paper proposes a motion planning approach for the reliable 6-dimensional quasi-static manipulation with an aerial towed-cable system. The novelty of this approach lies in the use of a cost-based motion-planning algorithm together with some results deriving from the static analysis of cable-driven manipulators. Based on the so-called wrench-feasibility constraints applied to the cable tensions, as well as thrust constraints applied to the flying robots, we formally characterize the set of feasible configurations of the system. Besides, the expression of these constraints leads to a criterion to evaluate the quality of a configuration. This allows us to define a cost function over the configuration space, which we exploit to compute good-quality paths using the T-RRT algorithm. As part of our approach, we also propose an aerial towed-cable system that we name the FlyCrane. It consists of a platform attached to three flying robots using six fixed-length cables. We validate the proposed approach on two simulated 6-D quasi-static manipulation problems involving such a system, and show the benefit of taking the cost function into account for such motion planning tasks., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

LETHA: learning from high quality inputs for 3D pose estimation in low quality images

  • Peñate Sánchez, Adrián
  • Moreno-Noguer, Francesc
  • Andrade-Cetto, Juan|||0000-0002-6354-8941
  • Fleuret, François
We introduce LETHA (Learning on Easy data, Test on Hard), a new learning paradigm consisting of building strong priors from high quality training data, and combining them with discriminative machine learning to deal with low- quality test data. Our main contribution is an implementation of that concept for pose estimation. We first automatically build a 3D model of the object of interest from high-definition images, and devise from it a pose-indexed feature extraction scheme. We then train a single classifier to process these feature vectors. Given a low quality test image, we visit many hypothetical poses, extract features consistently and evaluate the response of the classifier. Since this process uses locations recorded during learning, it does not require matching points anymore. We use a boosting procedure to train this classifier common to all poses, which is able to deal with missing features, due in this context to self-occlusion. Our results demonstrate that the method combines the strengths of global image representations, discriminative even for very tiny images, and the robustness to occlusions of approaches based on local feature point descriptors., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

Multimodal object recognition using random clustering trees

  • Villamizar Vergel, Michael Alejandro
  • Garrell Zulueta, Anais|||0000-0002-4629-0723
  • Sanfeliu Cortés, Alberto|||0000-0003-3868-9678
  • Moreno-Noguer, Francesc
In this paper, we present an object recognition approach that in addition allows to discover intra-class mo dalities exhibiting high-correlated visual information. Unlike to more conventional approaches based on computing multiple sp ecialized classiers, the proposed approach combines a single classier, Boosted Random Ferns (BRFs), with probabilistic Latent Semantic Analysis (pLSA) in order to recognize an object class and to find automatically the most prominent intra-class appearance mo dalities (clusters) through tree-structured visual words. The proposed approach has b een validated in synthetic and real experiments where we show that the method is able to recognize objects with multiple appearance, Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

HRA*: hybrid randomized path planning for complex 3D environments

  • Teniente Avilés, Ernesto Homar
  • Andrade-Cetto, Juan|||0000-0002-6354-8941
We propose HRA*, a new randomized path planner for complex 3D environments. The method is a modified A* algorithm that uses a hybrid node expansion technique that combines a random exploration of the action space meeting vehicle kinematic constraints with a cost to goal metric that considers only kinematically feasible paths to the goal. The method includes also a series of heuristics to accelerate the search time. These include a cost penalty near obstacles, and a filter to prevent revisiting configurations. The performance of the method is compared against A*, RRT and RRT* in a series of challenging 3D outdoor datasets. HRA* is shown to outperform all of them in computation time, and delivering shorter paths than A* and RR
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

A motion planning approach to 6-D manipulation with aerial towed-cable systems

  • Manubens Ferriol, Montserrat
  • Devaurs, Didier
  • Ros Giralt, Lluís|||0000-0002-8338-6062
  • Cortés, Juan
We propose a new approach for the reliable 6-dimensional quasi-static manipulation with aerial towed- cable systems. The novelty of this approach lies in the combination of results deriving from the static analysis of cable-driven manipulators with a cost-based motion-planning algorithm to solve manipulation queries. Such a combination of methods is able to produce feasible paths that do not approach dangerous/uncontrollable configurations of the system. As part of our approach, we also propose an original system that we name the FlyCrane. It consists of a platform attached to three flying robots using six fixed-length cables. Results of simulations on 6-D quasi-static manipulation problems show the interest of the method., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

Hierarchical task control for aerial inspection

  • Santamaria Navarro, Àngel|||0000-0002-6328-1423
  • Andrade-Cetto, Juan|||0000-0002-6354-8941
This paper presents a task oriented control strategy for aerial vehicles equipped with a robotic arm and a camera attached to its end-effector. With this setting the camera can reach a new set of orientations previously not feasible for the quadrotor. The over-actuation of the whole system is exploited with a hierarchical control law to achieve a primary task consisting on a visual servoing control, whilst secondary tasks can also be attained to minimize gravitational effects or undesired arm configurations. Results are shown in a Robot Operating System (ROS) simulation., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

High-frequency MAV state estimation using low-cost inertial and optical flow measurement units

  • Santamaria Navarro, Àngel|||0000-0002-6328-1423
  • Solà Ortega, Joan|||0000-0002-2933-3381
  • Andrade-Cetto, Juan|||0000-0002-6354-8941
The paper has supplementary downloadable material available at http://ieeexplore.ieee.org, provided by the authors. The material includes a video of the state estimation presented in the paper., This paper develops a new method for 3D, high rate vehicle state estimation, specially designed for free-flying Micro Aerial Vehicles (MAVs). We fuse observations from inertial and optical flow low-cost measurement units, and extend the current use of this optical sensors from hovering purposes to odometry estimation. Two Kalman filters, with its extended and error-state versions, are developed, and benchmarked alongside a large number of algorithm variations, using both simulations and real experiments with precise ground-truth. In contrast to state-of-the-art visual-inertial odometry methods, the proposed solution does not require image processing in the main CPU. Instead, the data correction is done taking advantage of the recently appeared optical flow sensors, which directly provide metric information about the MAV motion. We hence reduce the computational load of the main processor unit, and obtain an accurate estimation of the vehicle state at a high update rate., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

Efficient monocular pose estimation for complex 3D models

  • Rubio Romano, Antonio
  • Villamizar Vergel, Michael Alejandro
  • Ferraz Colomina, Luis
  • Peñate Sánchez, Adrián
  • Ramisa Ayats, Arnau
  • Simó Serra, Edgar
  • Sanfeliu Cortés, Alberto|||0000-0003-3868-9678
  • Moreno-Noguer, Francesc
We propose a robust and efficient method to estimate the pose of a camera with respect to complex 3D textured models of the environment that can potentially contain more than 100, 000 points. To tackle this problem we follow a top down approach where we combine high-level deep network classifiers with low level geometric approaches to come up with a solution that is fast, robust and accurate. Given an input image, we initially use a pre-trained deep network to compute a rough estimation of the camera pose. This initial estimate constrains the number of 3D model points that can be seen from the camera viewpoint. We then establish 3D-to-2D correspondences between these potentially visible points of the model and the 2D detected image features. Accurate pose estimation is finally obtained from the 2D-to-3D correspondences using a novel PnP algorithm that rejects outliers without the need to use a RANSAC strategy, and which is between 10 and 100 times faster than other methods that use it. Two real experimentsdealing with very large and complex 3D models demonstrate the effectiveness of the approach., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

Estimation of camera calibration uncertainty using LIDAR data

  • Ortega Jimenez, Agustin Alberto
  • Galego, Ricardo
  • Ferreira, Ricardo
  • Bernardino Bernardino Malheiro, Alexandre José
  • Gaspar, José
  • Andrade-Cetto, Juan|||0000-0002-6354-8941
This paper presents an analysis of uncertainty in the calibration of a network of cameras. A global 3D scene model, acquired with a LIDAR scanner, allows calibrating cameras with non overlapping ¿elds of view by means of the DLT-Lines algorithm. Once the projection matrix is computed for each camera, error sources are propagated to compute estimates of each camera position uncertainty. We validate the consistency of the uncertainty analysis with Monte-Carlo simulations, and apply the technique in a real camera network. This allows to evaluate the accuracy of DLT-Lines in real settings., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

Simultaneous pose and non-rigid shape with particle dynamics

  • Agudo Martínez, Antonio|||0000-0001-6845-4998
  • Moreno-Noguer, Francesc
In this paper, we propose a sequential solution to simultaneously estimate camera pose and non-rigid 3D shape from a monocular video. In contrast to most existing approaches that rely on global representations of the shape, we model the object at a local level, as an ensemble of particles, each ruled by the linear equation of the Newton's second law of motion. This dynamic model is incorporated into a bundle adjustment framework, in combination with simple regularization components that ensure temporal and spatial consistency of the estimated shape and camera poses. The resulting approach is both efficient and robust to several artifacts such as noisy and missing data or sudden camera motions, while it does not require any training data at all. Validation is done in a variety of real video sequences, including articulated and non-rigid motion, both for continuous and discontinuous shapes. Our system is shown to perform comparable to competing batch, computationally expensive, methods and shows remarkable improvement with respect to the sequential ones., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

Leveraging feature uncertainty in the PnP problem

  • Ferraz Colomina, Luis
  • Binefa, Xavier
  • Moreno-Noguer, Francesc
We propose a real-time and accurate solution to the Perspective-n-Point (PnP) problem –estimating the pose of a calibrated camera from n 3D-to-2D point correspondences– that exploits the fact that in practice the 2D position of not all 2D features is estimated with the same accuracy. Assuming a model of such feature uncertainties is known in advance, we reformulate the PnP problem as a maximum likelihood minimization approximated by an unconstrained Sampson error function, which naturally penalizes the most noisy correspondences. The advantages of this approach are thoroughly demonstrated in synthetic experiments where feature uncertainties are exactly known. Pre-estimating the features uncertainties in real experiments is, though, not easy. In this paper we model feature uncertainty as 2D Gaussian distributions representing the sensitivity of the 2D feature detectors to different camera viewpoints. When using these noise models with our PnP formulation we still obtain promising pose estimation results that outperform the most recent approaches., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

Neuroaesthetics in fashion: modeling the perception of fashionability

  • Simó Serra, Edgar
  • Fidler, Sanja
  • Moreno-Noguer, Francesc
  • Urtasun, Raquel
In this paper, we analyze the fashion of clothing of a large social website. Our goal is to learn and predict how fashionable a person looks on a photograph and suggest subtle improvements the user could make to improve her/his appeal. We propose a Conditional Random Field model that jointly reasons about several fashionability factors such as the type of outfit and garments the user is wearing, the type of the user, the photograph’s setting (e.g., the scenery behind the user), and the fashionability score. Importantly, our model is able to give rich feedback back to the user, conveying which garments or even scenery she/he should change in order to improve fashionability. We demonstrate that our joint approach significantly outperforms a variety of intelligent baselines. We additionally collected a novel heterogeneous dataset with 144,169 user posts containing diverse image, textual and meta information which can be exploited for our task. We also provide a detailed analysis of the data, showing different outfit trends and fashionability scores across the globe and across a span of 6 years., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

Uncalibrated image-based visual servoing

  • Santamaria Navarro, Àngel|||0000-0002-6328-1423
  • Andrade-Cetto, Juan|||0000-0002-6354-8941
This paper develops a new method for uncalibrated image-based visual servoing. In contrast to traditional image-based visual servo, the proposed solution does not require a known value of camera focal length for the computation of the image Jacobian. Instead, it is estimated at run time from the observation of the tracked target. The technique is shown to outperform classical visual servoing schemes in situations with noisy calibration parameters and for unexpected changes in the camera zoom. The method’s performance is demonstrated both in simulation experiments and in a ROS implementation of a quadrotor servoing task. The developed solution is tightly integrated with ROS and is made available as part of the IRI ROS stack., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

Dense segmentation-aware descriptors

  • Trulls Fortuny, Eduard
  • Kokkinos, Iasonas
  • Sanfeliu Cortés, Alberto|||0000-0003-3868-9678
  • Moreno-Noguer, Francesc
In this work we exploit segmentation to construct appearance descriptors that can robustly deal with occlusion and background changes. For this, we downplay measurements coming from areas that are unlikely to belong to the same region as the descriptor’s center, as suggested by soft segmentation masks. Our treatment is applicable to any image point, i.e. dense, and its computational overhead is in the order of a few seconds. We integrate this idea with Dense SIFT, and also with Dense Scale and Rotation Invariant Descriptors (SID), delivering descriptors that are densely computable, invariant to scaling and rotation, and robust to background changes. We apply our approach to standard benchmarks on large displacement motion estimation using SIFT-flow and widebaseline stereo, systematically demonstrating that the introduction of segmentation yields clear improvements.
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

Proactive behavior of an autonomous mobile robot for human-assisted learning

  • Garrell Zulueta, Anais|||0000-0002-4629-0723
  • Villamizar Vergel, Michael Alejandro
  • Moreno-Noguer, Francesc
  • Sanfeliu Cortés, Alberto|||0000-0003-3868-9678
During the last decade, there has been a growing interest in making autonomous social robots able to interact with people. However, there are still many open issues regarding the social capabilities that robots should have in order to perform these interactions more naturally. In this paper we present the results of several experiments conducted at the Barcelona Robot Lab in the campus of the “Universitat Politècnica de Catalunya” in which we have analyzed different important aspects of the interaction between a mobile robot and non-trained human volunteers. First, we have proposed different robot behaviors to approach a person and create an engagement with him/her. In order to perform this task we have provided the robot with several perception and action capabilities, such as that of detecting people, planning an approach and verbally communicating its intention to initiate a conversation. Once the initial engagement has been created, we have developed further communication skills in order to let people assist the robot and improve its face recognition system. After this assisted and online learning stage, the robot becomes able to detect people under severe changing conditions, which, in turn enhances the number and the manner that subsequent human-robot interactions are performed., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

Exploration in information distribution maps

  • Jadidi, Maani Ghaffari
  • Valls Miró, Jaime
  • Valencia Carreño, Rafael
  • Andrade-Cetto, Juan|||0000-0002-6354-8941
  • Dissanayake, Gamini
In this paper, a novel solution for autonomous robotic exploration is proposed. We model the distribution of information in an unknown environment as an unsteady diffusion process, which can be an appropriate mathematical formulation and analogy for expanding, time-varying, and dynamic envi- ronments. This information distribution map is the solution of the diffusion process partial differential equation, and is regressed from sensor data as a Gaussian Process. Optimization of the process parameters leads to an optimal frontier map which describes regions of interest for further exploration. Since the presented approach considers a continuous model of the environment, it can be used to plan smooth exploration paths exploiting the structural dependencies of the environment whilst handling sparse sensor measurements. The performance of the approach is evaluated through simulation results in the well- known Freiburg and Cave maps., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

Segmentation-aware deformable part models

  • Tsogkas, Stavros
  • Kokkinos, Iasonas
  • Trulls Fortuny, Eduard
  • Sanfeliu Cortés, Alberto|||0000-0003-3868-9678
  • Moreno-Noguer, Francesc
In this work we propose a technique to combine bottom- up segmentation, coming in the form of SLIC superpixels, with sliding window detectors, such as Deformable Part Models (DPMs). The merit of our approach lies in ‘cleaning up’ the low-level HOG features by exploiting the spatial support of SLIC superpixels; this can be understood as using segmentation to split the feature variation into object-specific and background changes. Rather than committing to a single segmentation we use a large pool of SLIC superpixels and combine them in a scale-, position- and object-dependent manner to build soft segmentation masks. The segmentation masks can be computed fast enough to repeat this process over every candidate window, during training and detection, for both the root and part filters of DPMs. We use these masks to construct enhanced, background-invariant features to train DPMs. We test our approach on the PASCAL VOC 2007, outperforming the standard DPM in 17 out of 20 classes, yielding an average increase of 1.7% AP. Additionally, we demonstrate the robustness of this approach, extending it to dense SIFT descriptors for large displacement optical flow.
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

Very fast solution to the PnP problem with algebraic outlier rejection

  • Ferraz Colomina, Luis
  • Binefa, Xavier
  • Moreno-Noguer, Francesc
We propose a real-time, robust to outliers and accurate solution to the Perspective-n-Point (PnP) problem. The main advantages of our solution are twofold: first, it integrates the outlier rejection within the pose estimation pipeline with a negligible computational overhead; and second, its scalability to arbitrarily large number of correspondences. Given a set of 3D-to-2D matches, we formulate pose estimation problem as a low-rank homogeneous system where the solution lies on its 1D null space. Outlier correspondences are those rows of the linear system which perturb the null space and are progressively detected by projecting them on an iteratively estimated solution of the null space. Since our outlier removal process is based on an algebraic criterion which does not require computing the full-pose and reprojecting back all 3D points on the image plane at each step, we achieve speed gains of more than 100× compared to RANSAC strategies. An extensive experimental evaluation will show that our solution yields accu- rate results in situations with up to 50% of outliers, and can process more than 1000 correspondences in less than 5ms., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

Active pose SLAM

  • Valencia Carreño, Rafael
  • Valls Miró, Jaime
  • Dissanayake, Gamini
  • Andrade-Cetto, Juan|||0000-0002-6354-8941
We present an active exploration strategy that complements Pose SLAM [1] and optimal navigation in Pose SLAM [2]. The method evaluates the utility of exploratory and place revisiting sequences and chooses the one that minimizes overall map and path entropies. The technique considers trajectories of similar path length taking marginal pose uncertainties into account. An advantage of the proposed strategy with respect to competing approaches is that to evaluate information gain over the map, only a very coarse prior map estimate needs to be computed. Its coarseness is independent and does not jeopardize the Pose SLAM estimate. Moreover, a replanning scheme is devised to detect significant localization improvement during path execution. The approach is tested in simulations in a common publicly available dataset comparing favorably against frontier based exploration.
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

Spatiotemporal descriptor for wide-baseline stereo reconstruction of non-rigid and ambiguous scenes

  • Trulls Fortuny, Eduard
  • Sanfeliu Cortés, Alberto|||0000-0003-3868-9678
  • Moreno-Noguer, Francesc
This paper studies the use of temporal consistency to match appearance descriptors and handle complex ambiguities when computing dynamic depth maps from stereo. Previous attempts have designed 3D descriptors over the spacetime volume and have been mostly used for monocular action recognition, as they cannot deal with perspective changes. Our approach is based on a state-of-the-art 2D dense appearance descriptor which we extend in time by means of optical flow priors, and can be applied to wide-baseline stereo setups. The basic idea behind our approach is to capture the changes around a feature point in time instead of trying to describe the spatiotemporal volume. We demonstrate its effectiveness on very ambiguous synthetic video sequences with ground truth data, as well as real sequences., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

Fast online learning and detection of natural landmarks for autonomous aerial robots

  • Villamizar Vergel, Michael Alejandro
  • Sanfeliu Cortés, Alberto|||0000-0003-3868-9678
  • Moreno-Noguer, Francesc
We present a method for efficiently detecting natural landmarks that can handle scenes with highly repetitive patterns and targets progressively changing its appearance. At the core of our approach lies a Random Ferns classifier, that models the posterior probabilities of different views of the target using multiple and independent Ferns, each containing features at particular positions of the target. A Shannon entropy measure is used to pick the most informative locations of these features. This minimizes the number of Ferns while maximizing its discriminative power, allowing thus, for robust detections at low computational costs. In addition, after offline initialization, the new incoming detections are used to update the posterior probabilities on the fly, and adapt to changing appearances that can occur due to the presence of shadows or occluding objects. All these virtues, make the proposed detector appropriate for UAV navigation. Besides the synthetic experiments that will demonstrate the theoretical benefits of our formulation, we will show applications for detecting landing areas in regions with highly repetitive patterns, and specific objects under the presence of cast shadows or sudden camera motions.
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

Estimación monocular y eficiente de la pose usando modelos 3D complejos

  • Rubio Romano, Antonio
  • Villamizar Vergel, Michael Alejandro
  • Ferraz Colomina, Luis
  • Peñate Sánchez, Adrián
  • Sanfeliu Cortés, Alberto|||0000-0003-3868-9678
  • Moreno-Noguer, Francesc
El siguiente documento presenta un método robusto y eficiente para estimar la pose de una cámara. El método propuesto asume el conocimiento previo de un modelo 3D del entorno, y compara una nueva imagen de entrada únicamente con un conjunto pequeño de imágenes similares seleccionadas previamente por un algoritmo de, Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

Simultaneous pose, focal length and 2D-to-3D correspondences from noisy observations

  • Peñate Sanchez, Adrián
  • Serradell, Eduard
  • Andrade-Cetto, Juan|||0000-0002-6354-8941
  • Moreno-Noguer, Francesc
Simultaneously recovering the camera pose and correspondences between a set of 2D-image and 3D-model points is a difficult problem, especially when the 2D-3D matches cannot be established based on appearance only. The problem becomes even more challenging when input images are acquired with an uncalibrated camera with varying zoom, which yields strong ambiguities between translation and focal length. We present a solution to this problem using only geometrical information. Our approach owes its robustness to an initial stage in which the joint pose and focal length solution space is split into several Gaussian regions. At runtime, each of these regions is explored using an hypothesize-and-test approach, in which the potential number of 2D-3D matches is progressively reduced using informed search through Kalman updates, iteratively refining the pose and focal length parameters. The technique is exhaustive but efficient, significantly improving previous methods in terms of robustness to outliers and noise., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

On-board real-time pose estimation for UAVs using deformable visual contour registration

  • Amor Martínez, Adrián
  • Ruiz, Alberto
  • Moreno-Noguer, Francesc
  • Sanfeliu Cortés, Alberto|||0000-0003-3868-9678
We present a real time method for pose estimation of objects from an UAV, using visual marks placed on non planar surfaces. It is designed to overcome constraints in small aerial robots, such as slow CPUs, low resolution cameras and image deformations due to distortions introduced by the lens or by the viewpoint changes produced during the flight navigation. The method consists of shape registration from extracted contours in an image. Instead of working with dense image patches or corresponding image features, we optimize a geometric alignment cost computed directly from the raw polygonal representations of the observed regions using efficient clipping algorithms. Moreover, instead of doing 2D image processing operations, the optimization is performed in the polygon representation space, allowing real-time projective matching. Deformation modes are easily included in the optimization scheme, allowing an accurate registration of different markers attached to curved surfaces using a single deformable prototype. As a result, the method achieves accurate object pose estimation precision in real-time, which is very important for interactive UAV tasks, for example for short distance surveillance or bar assembly. We describe the main algorithmic components of the method and present experiments where our method yields an average error of less than 5mm in position at a distance of 0.7m, using a visual mark of 19mm x 19mm. Finally, we compare these results with current computer vision state-of-the-art systems., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

Task priority control for aerial manipulation

  • Santamaria Navarro, Àngel|||0000-0002-6328-1423
  • Lippiello, Vincenzo
  • Andrade-Cetto, Juan|||0000-0002-6354-8941
This paper presents a task oriented control strategy for aerial vehicles equipped with a manipulator. A camera is attached to the end-effector of the manipulator to perform a primary task consisting on visual servoing towards a desired target. Over-actuation of the whole quadrotor-arm system is exploited to achieve secondary velocity tasks. One subtask is proposed to horizontally stabilize the platform during flight by aligning the arm center of gravity with the quadrotor gravitational vector. The arm singularities and manipulability are addressed by another subtask that leads the arm to a preferable configuration, and also takes into account the arm joint limits. The performance of the whole visual servo and secondary tasks control scheme is shown in a Robot Operating System (ROS) implementation., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

Exploration using an information-based reaction-diffusion process

  • Jadidi, Maani Ghaffari
  • Valls Miró, Jaime
  • Valencia Carreño, Rafael
  • Andrade-Cetto, Juan|||0000-0002-6354-8941
  • Dissanayake, Gamini
In this paper, a novel solution for autonomous robotic exploration is proposed. We model the distribution of information in an unknown environment as an unsteady diffusion process, which can be an appropriate mathematical formulation and analogy for expanding, time-varying, and dynamic environments. This information distribution map is the solution of the diffusion process partial differential equation, and is regressed from sensor data as a Gaussian Process. Optimization of the process parameters leads to an optimal frontier map which describes regions of interest for further exploration. Since the presented approach considers a continuous model of the environment, it can be used to plan smooth exploration paths exploiting the structural dependencies of the environment whilst handling sparse sensor measurements. The performance of the approach is evaluated through simulation results in the well-known Freiburg and Cave maps., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

6-D manipulation with aerial towed-cable system

  • Manubens Ferriol, Montserrat
  • Devaurs, Didier
  • Cortés, Juan
  • Ros Giralt, Lluís|||0000-0002-8338-6062
We propose a new approach for the reliable 6-dimensional quasi-static manipulation of an aerial towed-cable system. The novelty of this approach lies in the combination of results deriving from the static analysis of cable-driven manipulators with the application of a cost-based motion-planning algorithm to solve manipulation queries. Using this approach, we can ensure that the produced paths are feasible and do not approach dangerous configurations that could provoque the malfunction of the system. The approach has been simulated on the FlyCrane, consisting of a platform attached to three flying robots using six fixed-length cables. The obtained results show the success and the suitability of the approach.
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

Modeling robot's world with minimal effort

  • Villamizar Vergel, Michael Alejandro
  • Garrell Zulueta, Anais|||0000-0002-4629-0723
  • Sanfeliu Cortés, Alberto|||0000-0003-3868-9678
  • Moreno-Noguer, Francesc
© 20xx IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works, We propose an efficient Human Robot Interaction approach to efficiently model the appearance of all relevant objects in robot’s environment. Given an input video stream recorded while the robot is navigating, the user just needs to annotate a very small number of frames to build specific classifiers for each of the objects of interest. At the core of the method, there are several random ferns classifiers that share the same features and are updated online. The resulting methodology is fast (runs at 8 fps), versatile (it can be applied to unconstrained scenarios), scalable (real experiments show we can model up to 30 different object classes), and minimizes the amount of human intervention by leveraging the uncertainty measures associated to each classifier. We thoroughly validate the approach on synthetic data and on real sequences acquired with a mobile platform in outdoor and challenging scenarios containing a multitude of different objects. We show that the human can, with minimal effort, provide the robot with a detailed model of the objects in the scene., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publication Contribución de congreso (ConferenceOutput)

Mobile robot exploration with potential information fields

  • Vallvé Navarro, Joan|||0000-0002-1029-356X
  • Andrade-Cetto, Juan|||0000-0002-6354-8941
We present a mobile robot exploration strategy that computes trajectories that minimize both path and map entropies. The method evaluates joint entropy reduction and computes a potential ¿eld in robot con¿guration space using these joint entropy reduction estimates. The exploration trajectory is computed descending on the gradient of these ¿eld. The technique uses Pose SLAM as its estimation backbone. Very ef¿cient kernel convolution mechanisms are used to evaluate entropy reduction for each sensor ray, and for each possible robot orientation, taking frontiers and obstacles into account. In the end, the computation of this ¿eld on the entire C-space is shown to be very efficient computationally. The approach is tested in simulations in a common publicly available dataset comparing favorably both in quality of estimates and execution time against another entropy reduction strategy that uses occupancy maps, Peer Reviewed
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Dense segmentation-aware descriptors

  • Trulls Fortuny, Eduard
  • Kokkinos, Iasonas
  • Sanfeliu Cortés, Alberto
  • Moreno-Noguer, Francesc
In this work we exploit segmentation to construct appearance descriptors that can robustly deal with occlusion and background changes. For this, we downplay measurements coming from areas that are unlikely to belong to the same region as the descriptor’s center, as suggested by soft segmentation masks. Our treatment is applicable to any image point, i.e. dense, and its computational overhead is in the order of a few seconds. We integrate this idea with Dense SIFT, and also with Dense Scale and Rotation Invariant Descriptors (SID), delivering descriptors that are densely computable, invariant to scaling and rotation, and robust to background changes. We apply our approach to standard benchmarks on large displacement motion estimation using SIFT-flow and widebaseline stereo, systematically demonstrating that the introduction of segmentation yields clear improvements., Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Estimación monocular y eficiente de la pose usando modelos 3D complejos

  • Rubio Romano, Antonio
  • Villamizar Vergel, Michael Alejandro
  • Ferraz Colomina, Luis
  • Peñate Sánchez, Adrián
  • Sanfeliu Cortés, Alberto
  • Moreno-Noguer, Francesc
El siguiente documento presenta un método robusto y eficiente para estimar la pose de una cámara. El método propuesto asume el conocimiento previo de un modelo 3D del entorno, y compara una nueva imagen de entrada únicamente con un conjunto pequeño de imágenes similares seleccionadas previamente por un algoritmo de, Peer Reviewed, Postprint (author’s final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

LETHA: learning from high quality inputs for 3D pose estimation in low quality images

  • Peñate Sánchez, Adrián
  • Moreno-Noguer, Francesc
  • Andrade-Cetto, Juan
  • Fleuret, François
We introduce LETHA (Learning on Easy data, Test on Hard), a new learning paradigm consisting of building strong priors from high quality training data, and combining them with discriminative machine learning to deal with low- quality test data. Our main contribution is an implementation of that concept for pose estimation. We first automatically build a 3D model of the object of interest from high-definition images, and devise from it a pose-indexed feature extraction scheme. We then train a single classifier to process these feature vectors. Given a low quality test image, we visit many hypothetical poses, extract features consistently and evaluate the response of the classifier. Since this process uses locations recorded during learning, it does not require matching points anymore. We use a boosting procedure to train this classifier common to all poses, which is able to deal with missing features, due in this context to self-occlusion. Our results demonstrate that the method combines the strengths of global image representations, discriminative even for very tiny images, and the robustness to occlusions of approaches based on local feature point descriptors., Peer Reviewed, Postprint (author’s final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Segmentation-aware deformable part models

  • Tsogkas, Stavros
  • Kokkinos, Iasonas
  • Trulls Fortuny, Eduard
  • Sanfeliu Cortés, Alberto
  • Moreno-Noguer, Francesc
In this work we propose a technique to combine bottom- up segmentation, coming in the form of SLIC superpixels, with sliding window detectors, such as Deformable Part Models (DPMs). The merit of our approach lies in ‘cleaning up’ the low-level HOG features by exploiting the spatial support of SLIC superpixels; this can be understood as using segmentation to split the feature variation into object-specific and background changes. Rather than committing to a single segmentation we use a large pool of SLIC superpixels and combine them in a scale-, position- and object-dependent manner to build soft segmentation masks. The segmentation masks can be computed fast enough to repeat this process over every candidate window, during training and detection, for both the root and part filters of DPMs. We use these masks to construct enhanced, background-invariant features to train DPMs. We test our approach on the PASCAL VOC 2007, outperforming the standard DPM in 17 out of 20 classes, yielding an average increase of 1.7% AP. Additionally, we demonstrate the robustness of this approach, extending it to dense SIFT descriptors for large displacement optical flow., Postprint (author’s final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Spatiotemporal descriptor for wide-baseline stereo reconstruction of non-rigid and ambiguous scenes

  • Trulls Fortuny, Eduard
  • Sanfeliu Cortés, Alberto
  • Moreno-Noguer, Francesc
This paper studies the use of temporal consistency to match appearance descriptors and handle complex ambiguities when computing dynamic depth maps from stereo. Previous attempts have designed 3D descriptors over the spacetime volume and have been mostly used for monocular action recognition, as they cannot deal with perspective changes. Our approach is based on a state-of-the-art 2D dense appearance descriptor which we extend in time by means of optical flow priors, and can be applied to wide-baseline stereo setups. The basic idea behind our approach is to capture the changes around a feature point in time instead of trying to describe the spatiotemporal volume. We demonstrate its effectiveness on very ambiguous synthetic video sequences with ground truth data, as well as real sequences., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Neuroaesthetics in fashion: modeling the perception of fashionability

  • Simó Serra, Edgar
  • Fidler, Sanja
  • Moreno-Noguer, Francesc
  • Urtasun, Raquel
In this paper, we analyze the fashion of clothing of a large social website. Our goal is to learn and predict how fashionable a person looks on a photograph and suggest subtle improvements the user could make to improve her/his appeal. We propose a Conditional Random Field model that jointly reasons about several fashionability factors such as the type of outfit and garments the user is wearing, the type of the user, the photograph’s setting (e.g., the scenery behind the user), and the fashionability score. Importantly, our model is able to give rich feedback back to the user, conveying which garments or even scenery she/he should change in order to improve fashionability. We demonstrate that our joint approach significantly outperforms a variety of intelligent baselines. We additionally collected a novel heterogeneous dataset with 144,169 user posts containing diverse image, textual and meta information which can be exploited for our task. We also provide a detailed analysis of the data, showing different outfit trends and fashionability scores across the globe and across a span of 6 years., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

On-board real-time pose estimation for UAVs using deformable visual contour registration

  • Amor Martínez, Adrián
  • Ruiz, Alberto
  • Moreno-Noguer, Francesc
  • Sanfeliu Cortés, Alberto
We present a real time method for pose estimation of objects from an UAV, using visual marks placed on non planar surfaces. It is designed to overcome constraints in small aerial robots, such as slow CPUs, low resolution cameras and image deformations due to distortions introduced by the lens or by the viewpoint changes produced during the flight navigation. The method consists of shape registration from extracted contours in an image. Instead of working with dense image patches or corresponding image features, we optimize a geometric alignment cost computed directly from the raw polygonal representations of the observed regions using efficient clipping algorithms. Moreover, instead of doing 2D image processing operations, the optimization is performed in the polygon representation space, allowing real-time projective matching. Deformation modes are easily included in the optimization scheme, allowing an accurate registration of different markers attached to curved surfaces using a single deformable prototype. As a result, the method achieves accurate object pose estimation precision in real-time, which is very important for interactive UAV tasks, for example for short distance surveillance or bar assembly. We describe the main algorithmic components of the method and present experiments where our method yields an average error of less than 5mm in position at a distance of 0.7m, using a visual mark of 19mm x 19mm. Finally, we compare these results with current computer vision state-of-the-art systems., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Estimation of camera calibration uncertainty using LIDAR data

  • Ortega Jimenez, Agustin Alberto
  • Galego, Ricardo
  • Ferreira, Ricardo
  • Bernardino Bernardino Malheiro, Alexandre José
  • Gaspar, José
  • Andrade-Cetto, Juan
This paper presents an analysis of uncertainty in the calibration of a network of cameras. A global 3D scene model, acquired with a LIDAR scanner, allows calibrating cameras with non overlapping ¿elds of view by means of the DLT-Lines algorithm. Once the projection matrix is computed for each camera, error sources are propagated to compute estimates of each camera position uncertainty. We validate the consistency of the uncertainty analysis with Monte-Carlo simulations, and apply the technique in a real camera network. This allows to evaluate the accuracy of DLT-Lines in real settings., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Task priority control for aerial manipulation

  • Santamaria Navarro, Àngel
  • Lippiello, Vincenzo
  • Andrade-Cetto, Juan
This paper presents a task oriented control strategy for aerial vehicles equipped with a manipulator. A camera is attached to the end-effector of the manipulator to perform a primary task consisting on visual servoing towards a desired target. Over-actuation of the whole quadrotor-arm system is exploited to achieve secondary velocity tasks. One subtask is proposed to horizontally stabilize the platform during flight by aligning the arm center of gravity with the quadrotor gravitational vector. The arm singularities and manipulability are addressed by another subtask that leads the arm to a preferable configuration, and also takes into account the arm joint limits. The performance of the whole visual servo and secondary tasks control scheme is shown in a Robot Operating System (ROS) implementation., Peer Reviewed, Postprint (author’s final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Uncalibrated image-based visual servoing

  • Santamaria Navarro, Àngel
  • Andrade-Cetto, Juan
This paper develops a new method for uncalibrated image-based visual servoing. In contrast to traditional image-based visual servo, the proposed solution does not require a known value of camera focal length for the computation of the image Jacobian. Instead, it is estimated at run time from the observation of the tracked target. The technique is shown to outperform classical visual servoing schemes in situations with noisy calibration parameters and for unexpected changes in the camera zoom. The method’s performance is demonstrated both in simulation experiments and in a ROS implementation of a quadrotor servoing task. The developed solution is tightly integrated with ROS and is made available as part of the IRI ROS stack., Peer Reviewed, Postprint (author draft version)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Mobile robot exploration with potential information fields

  • Vallvé Navarro, Joan
  • Andrade-Cetto, Juan
We present a mobile robot exploration strategy that computes trajectories that minimize both path and map entropies. The method evaluates joint entropy reduction and computes a potential ¿eld in robot con¿guration space using these joint entropy reduction estimates. The exploration trajectory is computed descending on the gradient of these ¿eld. The technique uses Pose SLAM as its estimation backbone. Very ef¿cient kernel convolution mechanisms are used to evaluate entropy reduction for each sensor ray, and for each possible robot orientation, taking frontiers and obstacles into account. In the end, the computation of this ¿eld on the entire C-space is shown to be very efficient computationally. The approach is tested in simulations in a common publicly available dataset comparing favorably both in quality of estimates and execution time against another entropy reduction strategy that uses occupancy maps, Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Active pose SLAM

  • Valencia Carreño, Rafael
  • Valls Miró, Jaime
  • Dissanayake, Gamini
  • Andrade-Cetto, Juan
We present an active exploration strategy that complements Pose SLAM [1] and optimal navigation in Pose SLAM [2]. The method evaluates the utility of exploratory and place revisiting sequences and chooses the one that minimizes overall map and path entropies. The technique considers trajectories of similar path length taking marginal pose uncertainties into account. An advantage of the proposed strategy with respect to competing approaches is that to evaluate information gain over the map, only a very coarse prior map estimate needs to be computed. Its coarseness is independent and does not jeopardize the Pose SLAM estimate. Moreover, a replanning scheme is devised to detect significant localization improvement during path execution. The approach is tested in simulations in a common publicly available dataset comparing favorably against frontier based exploration., Preprint
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Simultaneous pose, focal length and 2D-to-3D correspondences from noisy observations

  • Peñate Sanchez, Adrián
  • Serradell, Eduard
  • Andrade-Cetto, Juan
  • Moreno-Noguer, Francesc
Simultaneously recovering the camera pose and correspondences between a set of 2D-image and 3D-model points is a difficult problem, especially when the 2D-3D matches cannot be established based on appearance only. The problem becomes even more challenging when input images are acquired with an uncalibrated camera with varying zoom, which yields strong ambiguities between translation and focal length. We present a solution to this problem using only geometrical information. Our approach owes its robustness to an initial stage in which the joint pose and focal length solution space is split into several Gaussian regions. At runtime, each of these regions is explored using an hypothesize-and-test approach, in which the potential number of 2D-3D matches is progressively reduced using informed search through Kalman updates, iteratively refining the pose and focal length parameters. The technique is exhaustive but efficient, significantly improving previous methods in terms of robustness to outliers and noise., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Very fast solution to the PnP problem with algebraic outlier rejection

  • Ferraz Colomina, Luis
  • Binefa, Xavier
  • Moreno-Noguer, Francesc
We propose a real-time, robust to outliers and accurate solution to the Perspective-n-Point (PnP) problem. The main advantages of our solution are twofold: first, it integrates the outlier rejection within the pose estimation pipeline with a negligible computational overhead; and second, its scalability to arbitrarily large number of correspondences. Given a set of 3D-to-2D matches, we formulate pose estimation problem as a low-rank homogeneous system where the solution lies on its 1D null space. Outlier correspondences are those rows of the linear system which perturb the null space and are progressively detected by projecting them on an iteratively estimated solution of the null space. Since our outlier removal process is based on an algebraic criterion which does not require computing the full-pose and reprojecting back all 3D points on the image plane at each step, we achieve speed gains of more than 100× compared to RANSAC strategies. An extensive experimental evaluation will show that our solution yields accu- rate results in situations with up to 50% of outliers, and can process more than 1000 correspondences in less than 5ms., Peer Reviewed, Postprint (author’s final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Motion planning for 6D manipulation with aerial towed-cable systems

  • Manubens Ferriol, Montserrat
  • Devaurs, Didier
  • Ros Giralt, Lluís
  • Cortés, Juan
Performing aerial 6-dimensional manipulation using flying robots is a challenging problem, to which only little work has been devoted. This paper proposes a motion planning approach for the reliable 6-dimensional quasi-static manipulation with an aerial towed-cable system. The novelty of this approach lies in the use of a cost-based motion-planning algorithm together with some results deriving from the static analysis of cable-driven manipulators. Based on the so-called wrench-feasibility constraints applied to the cable tensions, as well as thrust constraints applied to the flying robots, we formally characterize the set of feasible configurations of the system. Besides, the expression of these constraints leads to a criterion to evaluate the quality of a configuration. This allows us to define a cost function over the configuration space, which we exploit to compute good-quality paths using the T-RRT algorithm. As part of our approach, we also propose an aerial towed-cable system that we name the FlyCrane. It consists of a platform attached to three flying robots using six fixed-length cables. We validate the proposed approach on two simulated 6-D quasi-static manipulation problems involving such a system, and show the benefit of taking the cost function into account for such motion planning tasks., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Simultaneous pose and non-rigid shape with particle dynamics

  • Agudo Martínez, Antonio
  • Moreno-Noguer, Francesc
In this paper, we propose a sequential solution to simultaneously estimate camera pose and non-rigid 3D shape from a monocular video. In contrast to most existing approaches that rely on global representations of the shape, we model the object at a local level, as an ensemble of particles, each ruled by the linear equation of the Newton's second law of motion. This dynamic model is incorporated into a bundle adjustment framework, in combination with simple regularization components that ensure temporal and spatial consistency of the estimated shape and camera poses. The resulting approach is both efficient and robust to several artifacts such as noisy and missing data or sudden camera motions, while it does not require any training data at all. Validation is done in a variety of real video sequences, including articulated and non-rigid motion, both for continuous and discontinuous shapes. Our system is shown to perform comparable to competing batch, computationally expensive, methods and shows remarkable improvement with respect to the sequential ones., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Modeling robot's world with minimal effort

  • Villamizar Vergel, Michael Alejandro
  • Garrell Zulueta, Anais
  • Sanfeliu Cortés, Alberto
  • Moreno-Noguer, Francesc
© 20xx IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works, We propose an efficient Human Robot Interaction approach to efficiently model the appearance of all relevant objects in robot’s environment. Given an input video stream recorded while the robot is navigating, the user just needs to annotate a very small number of frames to build specific classifiers for each of the objects of interest. At the core of the method, there are several random ferns classifiers that share the same features and are updated online. The resulting methodology is fast (runs at 8 fps), versatile (it can be applied to unconstrained scenarios), scalable (real experiments show we can model up to 30 different object classes), and minimizes the amount of human intervention by leveraging the uncertainty measures associated to each classifier. We thoroughly validate the approach on synthetic data and on real sequences acquired with a mobile platform in outdoor and challenging scenarios containing a multitude of different objects. We show that the human can, with minimal effort, provide the robot with a detailed model of the objects in the scene., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Exploration in information distribution maps

  • Jadidi, Maani Ghaffari
  • Valls Miró, Jaime
  • Valencia Carreño, Rafael
  • Andrade-Cetto, Juan
  • Dissanayake, Gamini
In this paper, a novel solution for autonomous robotic exploration is proposed. We model the distribution of information in an unknown environment as an unsteady diffusion process, which can be an appropriate mathematical formulation and analogy for expanding, time-varying, and dynamic envi- ronments. This information distribution map is the solution of the diffusion process partial differential equation, and is regressed from sensor data as a Gaussian Process. Optimization of the process parameters leads to an optimal frontier map which describes regions of interest for further exploration. Since the presented approach considers a continuous model of the environment, it can be used to plan smooth exploration paths exploiting the structural dependencies of the environment whilst handling sparse sensor measurements. The performance of the approach is evaluated through simulation results in the well- known Freiburg and Cave maps., Peer Reviewed, Postprint (author’s final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

High-frequency MAV state estimation using low-cost inertial and optical flow measurement units

  • Santamaria Navarro, Àngel
  • Solà Ortega, Joan
  • Andrade-Cetto, Juan
The paper has supplementary downloadable material available at http://ieeexplore.ieee.org, provided by the authors. The material includes a video of the state estimation presented in the paper., This paper develops a new method for 3D, high rate vehicle state estimation, specially designed for free-flying Micro Aerial Vehicles (MAVs). We fuse observations from inertial and optical flow low-cost measurement units, and extend the current use of this optical sensors from hovering purposes to odometry estimation. Two Kalman filters, with its extended and error-state versions, are developed, and benchmarked alongside a large number of algorithm variations, using both simulations and real experiments with precise ground-truth. In contrast to state-of-the-art visual-inertial odometry methods, the proposed solution does not require image processing in the main CPU. Instead, the data correction is done taking advantage of the recently appeared optical flow sensors, which directly provide metric information about the MAV motion. We hence reduce the computational load of the main processor unit, and obtain an accurate estimation of the vehicle state at a high update rate., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Leveraging feature uncertainty in the PnP problem

  • Ferraz Colomina, Luis
  • Binefa, Xavier
  • Moreno-Noguer, Francesc
We propose a real-time and accurate solution to the Perspective-n-Point (PnP) problem –estimating the pose of a calibrated camera from n 3D-to-2D point correspondences– that exploits the fact that in practice the 2D position of not all 2D features is estimated with the same accuracy. Assuming a model of such feature uncertainties is known in advance, we reformulate the PnP problem as a maximum likelihood minimization approximated by an unconstrained Sampson error function, which naturally penalizes the most noisy correspondences. The advantages of this approach are thoroughly demonstrated in synthetic experiments where feature uncertainties are exactly known. Pre-estimating the features uncertainties in real experiments is, though, not easy. In this paper we model feature uncertainty as 2D Gaussian distributions representing the sensitivity of the 2D feature detectors to different camera viewpoints. When using these noise models with our PnP formulation we still obtain promising pose estimation results that outperform the most recent approaches., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Exploration using an information-based reaction-diffusion process

  • Jadidi, Maani Ghaffari
  • Valls Miró, Jaime
  • Valencia Carreño, Rafael
  • Andrade-Cetto, Juan
  • Dissanayake, Gamini
In this paper, a novel solution for autonomous robotic exploration is proposed. We model the distribution of information in an unknown environment as an unsteady diffusion process, which can be an appropriate mathematical formulation and analogy for expanding, time-varying, and dynamic environments. This information distribution map is the solution of the diffusion process partial differential equation, and is regressed from sensor data as a Gaussian Process. Optimization of the process parameters leads to an optimal frontier map which describes regions of interest for further exploration. Since the presented approach considers a continuous model of the environment, it can be used to plan smooth exploration paths exploiting the structural dependencies of the environment whilst handling sparse sensor measurements. The performance of the approach is evaluated through simulation results in the well-known Freiburg and Cave maps., Peer Reviewed, Postprint (author’s final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Hierarchical task control for aerial inspection

  • Santamaria Navarro, Àngel
  • Andrade-Cetto, Juan
This paper presents a task oriented control strategy for aerial vehicles equipped with a robotic arm and a camera attached to its end-effector. With this setting the camera can reach a new set of orientations previously not feasible for the quadrotor. The over-actuation of the whole system is exploited with a hierarchical control law to achieve a primary task consisting on a visual servoing control, whilst secondary tasks can also be attained to minimize gravitational effects or undesired arm configurations. Results are shown in a Robot Operating System (ROS) simulation., Peer Reviewed, Postprint (author’s final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Proactive behavior of an autonomous mobile robot for human-assisted learning

  • Garrell Zulueta, Anais
  • Villamizar Vergel, Michael Alejandro
  • Moreno-Noguer, Francesc
  • Sanfeliu Cortés, Alberto
During the last decade, there has been a growing interest in making autonomous social robots able to interact with people. However, there are still many open issues regarding the social capabilities that robots should have in order to perform these interactions more naturally. In this paper we present the results of several experiments conducted at the Barcelona Robot Lab in the campus of the “Universitat Politècnica de Catalunya” in which we have analyzed different important aspects of the interaction between a mobile robot and non-trained human volunteers. First, we have proposed different robot behaviors to approach a person and create an engagement with him/her. In order to perform this task we have provided the robot with several perception and action capabilities, such as that of detecting people, planning an approach and verbally communicating its intention to initiate a conversation. Once the initial engagement has been created, we have developed further communication skills in order to let people assist the robot and improve its face recognition system. After this assisted and online learning stage, the robot becomes able to detect people under severe changing conditions, which, in turn enhances the number and the manner that subsequent human-robot interactions are performed., Peer Reviewed, Postprint (author’s final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Efficient monocular pose estimation for complex 3D models

  • Rubio Romano, Antonio
  • Villamizar Vergel, Michael Alejandro
  • Ferraz Colomina, Luis
  • Peñate Sánchez, Adrián
  • Ramisa Ayats, Arnau
  • Simó Serra, Edgar
  • Sanfeliu Cortés, Alberto
  • Moreno-Noguer, Francesc
We propose a robust and efficient method to estimate the pose of a camera with respect to complex 3D textured models of the environment that can potentially contain more than 100, 000 points. To tackle this problem we follow a top down approach where we combine high-level deep network classifiers with low level geometric approaches to come up with a solution that is fast, robust and accurate. Given an input image, we initially use a pre-trained deep network to compute a rough estimation of the camera pose. This initial estimate constrains the number of 3D model points that can be seen from the camera viewpoint. We then establish 3D-to-2D correspondences between these potentially visible points of the model and the 2D detected image features. Accurate pose estimation is finally obtained from the 2D-to-3D correspondences using a novel PnP algorithm that rejects outliers without the need to use a RANSAC strategy, and which is between 10 and 100 times faster than other methods that use it. Two real experimentsdealing with very large and complex 3D models demonstrate the effectiveness of the approach., Peer Reviewed, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

A motion planning approach to 6-D manipulation with aerial towed-cable systems

  • Manubens Ferriol, Montserrat
  • Devaurs, Didier
  • Ros Giralt, Lluís
  • Cortés, Juan
We propose a new approach for the reliable 6-dimensional quasi-static manipulation with aerial towed- cable systems. The novelty of this approach lies in the combination of results deriving from the static analysis of cable-driven manipulators with a cost-based motion-planning algorithm to solve manipulation queries. Such a combination of methods is able to produce feasible paths that do not approach dangerous/uncontrollable configurations of the system. As part of our approach, we also propose an original system that we name the FlyCrane. It consists of a platform attached to three flying robots using six fixed-length cables. Results of simulations on 6-D quasi-static manipulation problems show the interest of the method., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

HRA*: hybrid randomized path planning for complex 3D environments

  • Teniente Avilés, Ernesto Homar
  • Andrade-Cetto, Juan
We propose HRA*, a new randomized path planner for complex 3D environments. The method is a modified A* algorithm that uses a hybrid node expansion technique that combines a random exploration of the action space meeting vehicle kinematic constraints with a cost to goal metric that considers only kinematically feasible paths to the goal. The method includes also a series of heuristics to accelerate the search time. These include a cost penalty near obstacles, and a filter to prevent revisiting configurations. The performance of the method is compared against A*, RRT and RRT* in a series of challenging 3D outdoor datasets. HRA* is shown to outperform all of them in computation time, and delivering shorter paths than A* and RR, Postprint (author's final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Fast online learning and detection of natural landmarks for autonomous aerial robots

  • Villamizar Vergel, Michael Alejandro
  • Sanfeliu Cortés, Alberto
  • Moreno-Noguer, Francesc
We present a method for efficiently detecting natural landmarks that can handle scenes with highly repetitive patterns and targets progressively changing its appearance. At the core of our approach lies a Random Ferns classifier, that models the posterior probabilities of different views of the target using multiple and independent Ferns, each containing features at particular positions of the target. A Shannon entropy measure is used to pick the most informative locations of these features. This minimizes the number of Ferns while maximizing its discriminative power, allowing thus, for robust detections at low computational costs. In addition, after offline initialization, the new incoming detections are used to update the posterior probabilities on the fly, and adapt to changing appearances that can occur due to the presence of shadows or occluding objects. All these virtues, make the proposed detector appropriate for UAV navigation. Besides the synthetic experiments that will demonstrate the theoretical benefits of our formulation, we will show applications for detecting landing areas in regions with highly repetitive patterns, and specific objects under the presence of cast shadows or sudden camera motions., Preprint
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

6-D manipulation with aerial towed-cable system

  • Manubens Ferriol, Montserrat
  • Devaurs, Didier
  • Cortés, Juan
  • Ros Giralt, Lluís
We propose a new approach for the reliable 6-dimensional quasi-static manipulation of an aerial towed-cable system. The novelty of this approach lies in the combination of results deriving from the static analysis of cable-driven manipulators with the application of a cost-based motion-planning algorithm to solve manipulation queries. Using this approach, we can ensure that the produced paths are feasible and do not approach dangerous configurations that could provoque the malfunction of the system. The approach has been simulated on the FlyCrane, consisting of a platform attached to three flying robots using six fixed-length cables. The obtained results show the success and the suitability of the approach., Postprint (author’s final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Multimodal object recognition using random clustering trees

  • Villamizar Vergel, Michael Alejandro
  • Garrell Zulueta, Anais
  • Sanfeliu Cortés, Alberto
  • Moreno-Noguer, Francesc
In this paper, we present an object recognition approach that in addition allows to discover intra-class mo dalities exhibiting high-correlated visual information. Unlike to more conventional approaches based on computing multiple sp ecialized classiers, the proposed approach combines a single classier, Boosted Random Ferns (BRFs), with probabilistic Latent Semantic Analysis (pLSA) in order to recognize an object class and to find automatically the most prominent intra-class appearance mo dalities (clusters) through tree-structured visual words. The proposed approach has b een validated in synthetic and real experiments where we show that the method is able to recognize objects with multiple appearance, Peer Reviewed, Postprint (author's final draft)