Pasar al contenido principal

Resultados relacionados

Resultados totales (Incluyendo duplicados): 35
Encontrada(s) 1 página(s)

Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Connectomics to semantomics: addressing the brain's big data challenge

  • Arsiwalla, Xerxes D.
  • Dalmazzo, David
  • Zucca, Riccardo
  • Betella, Alberto
  • Brandi Hernández, Santiago
  • Martínez Bueno, Enrique
  • Omedas, Pedro
  • Verschure, Paul F. M. J.
Can semantic corpora be coupled to dynamical simulations in such a way so as to extract new associations from the data that were hitherto unapparent? We attempt to do this within neuroscience as an application domain, by introducing the notion of the semantome and coupling it to the connectome of the human brain network. This is implemented using BrainX3, a virtual reality simulation cum data mining platform that can be used for visualization, analysis and feature extraction of neuroscience data. We use this system to explore anatomical, functional and symptomatic semantics associated to simulated neuronal activity of a healthy brain, one with stroke and one perturbed by transcranial magnetic stimulation. In particular, we find that parietal and occipital lesions in stroke affect the visual processing pathway leading to symptoms such as visual neglect, depression and photo-sensitivity seizures. Integrating semantomics with connectomics thus generates hypotheses about symptoms, functions and brain activity that supplement existing tools for diagnosis of mental illness. Our results suggest a new approach to big data with potential applications to other domains., We thank Olaf Sporns and Chris Honey for sharing the DSI data. Research supported by CEEDS (FP7-ICT-2009-5) & CDAC (ERC-2013-ADG 341196) projects.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Differential neural mechanisms for early and late prediction error detection

  • Malekshahi, Rahim
  • Seth, Anil
  • Papanikolaou, Amalia
  • Mathews, Zenon
  • Birbaumer, Niels
  • Verschure, Paul F. M. J.
  • Caria, Andrea
Emerging evidence indicates that prediction, instantiated at different perceptual levels, facilitate visual processing and enable prompt and appropriate reactions. Until now, the mechanisms underlying the effect of predictive coding at different stages of visual processing have still remained unclear. Here, we aimed to investigate early and late processing of spatial prediction violation by performing combined recordings of saccadic eye movements and fast event-related fMRI during a continuous visual detection task. Psychophysical reverse correlation analysis revealed that the degree of mismatch between current perceptual input and prior expectations is mainly processed at late rather than early stage, which is instead responsible for fast but general prediction error detection. Furthermore, our results suggest that conscious late detection of deviant stimuli is elicited by the assessment of prediction error’s extent more than by prediction error per se. Functional MRI and functional connectivity data analyses indicated that higher-level brain systems interactions modulate conscious detection of prediction error through top-down processes for the analysis of its representational content, and possibly regulate subsequent adaptation of predictive models. Overall, our experimental paradigm allowed to dissect explicit from implicit behavioral and neural responses to deviant stimuli in terms of their reliance on predictive models., This work was supported by the European Union, FP7-ICT-2009 – CEEDS: The Collective Experience of Empathic Data Systems - Grant agreement no. 258749.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Inference of human affective states from psychophysiological measurements extracted under ecologically valid conditions

  • Betella, Alberto
  • Zucca, Riccardo
  • Cetnarski, Ryszard
  • Greco, Alberto
  • Lanatà, Antonio
  • Mazzei, Daniele
  • Tognetti, Alessandro
  • Arsiwalla, Xerxes D.
  • Omedas, Pedro
  • De Rossi, Danilo Emilio
  • Verschure, Paul F. M. J.
Compared to standard laboratory protocols, the measurement of psychophysiological signals in real world experiments poses technical and methodological challenges due to external factors that cannot be directly controlled. To address this problem, we propose a hybrid approach based on an immersive and human accessible space called the eXperience Induction Machine (XIM), that incorporates the advantages of a laboratory within a life-like setting. The XIM integrates unobtrusive wearable sensors for the acquisition of psychophysiological signals suitable for ambulatory emotion research. In this paper, we present results from two different studies conducted to validate the XIM as a general-purpose sensing infrastructure for the study of human affective states under ecologically valid conditions. In the first investigation, we recorded and classified signals from subjects exposed to pictorial stimuli corresponding to a range of arousal levels, while they were free to walk and gesticulate. In the second study, we designed an experiment that follows the classical conditioning paradigm, a well-known procedure in the behavioral sciences, with the additional feature that participants were free to move in the physical space, as opposed to similar studies measuring physiological signals in constrained laboratory settings. Our results indicate that, by using our sensing infrastructure, it is indeed possible to infer human event-elicited affective states through measurements of psychophysiological signals under ecological conditions., The research leading to these results has received funding from the European Community's Seventh Framework Programme (FP7-ICT-2009-5) under grant agreement n. 258749 [CEEDS]. The Generalitat de Catalunya (CUR, DIUE) and the European Social Fund are supporting this research.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Visual anticipation biases conscious decision making but not bottom-up visual processing

  • Mathews, Zenon
  • Cetnarski, Ryszard
  • Verschure, Paul F. M. J.
Prediction plays a key role in control of attention but it is not clear which aspects of prediction are most prominent in conscious experience. An evolving view on the brain is that it can be seen as a prediction machine that optimizes its ability to predict states of the world and the self through the top-down propagation of predictions and the bottom-up presentation of prediction errors. There are competing views though on whether prediction or prediction errors dominate the formation of conscious experience. Yet, the dynamic effects of prediction on perception, decision making and consciousness have been difficult to assess and to model. We propose a novel mathematical framework and a psychophysical paradigm that allows us to assess both the hierarchical structuring of perceptual consciousness, its content and the impact of predictions and/or errors on conscious experience, attention and decision-making. Using a displacement detection task combined with reverse correlation, we reveal signatures of the usage of prediction at three different levels of perceptual processing: bottom-up fast saccades, top-down driven slow saccades and consciousnes decisions. Our results suggest that the brain employs multiple parallel mechanism at different levels of perceptual processing in order to shape effective sensory consciousness within a predicted perceptual scene. We further observe that bottom-up sensory and top-down predictive processes can be dissociated through cognitive load. We propose a probabilistic data association model from dynamical systems theory to model the predictive multi-scale bias in perceptual processing that we observe and its role in the formation of conscious experience. We propose that these results support the hypothesis that consciousness provides a time-delayed description of a task that is used to prospectively optimize real time control structures, rather than being engaged in the real-time control of behavior itself, This work was carried out as part of the CEEDS project; an EU funded Integrated Project under the Seventh Framework Programme (ICT-258749) and ERC grant cDAC (ERC-341196).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Fast mental states decoding in mixed reality

  • De Massari, Daniele
  • Pacheco, Daniel
  • Malekshahi, Rahim
  • Betella, Alberto
  • Verschure, Paul F. M. J.
  • Birbaumer, Niels
  • Caria, Andrea
The combination of Brain-Computer Interface (BCI) technology, allowing online monitoring and decoding of brain activity, with virtual and mixed reality (MR) systems may help to shape and guide implicit and explicit learning using ecological scenarios. Real-time information of ongoing brain states acquired through BCI might be exploited for controlling data presentation in virtual environments. Brain states discrimination during mixed reality experience is thus critical for adapting specific data features to contingent brain activity. In this study we recorded electroencephalographic (EEG) data while participants experienced MR scenarios implemented through the eXperience Induction Machine (XIM). The XIM is a novel framework modeling the integration of a sensing system that evaluates and measures physiological and psychological states with a number of actuators and effectors that coherently reacts to the user's actions. We then assessed continuous EEG-based discrimination of spatial navigation, reading and calculation performed in MR, using linear discriminant analysis (LDA) and support vector machine (SVM) classifiers. Dynamic single trial classification showed high accuracy of LDA and SVM classifiers in detecting multiple brain states as well as in differentiating between high and low mental workload, using a 5 s time-window shifting every 200 ms. Our results indicate overall better performance of LDA with respect to SVM and suggest applicability of our approach in a BCI-controlled MR scenario. Ultimately, successful prediction of brain states might be used to drive adaptation of data representation in order to boost information processing in MR., The present study was supported by EU grants: FP7-ICT-2009-258749 CEEDs: The Collective Experience of Empathic Data Systems; FP7-ICT-2013- 609593 BNCI Horizon 2020. The Future of Brain/Neural Computer Interaction: Horizon 2020; Italian Ministry of Health, GR-2009-1591908.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Network dynamics with BrainX3: a large-scale simulation of the human brain network with real-time interaction

  • Arsiwalla, Xerxes D.
  • Zucca, Riccardo
  • Betella, Alberto
  • Martínez Bueno, Enrique
  • Dalmazzo, David
  • Omedas, Pedro
  • Deco, Gustavo
  • Verschure, Paul F. M. J.
BrainX3 is a large-scale simulation of human brain activity with real-time interaction, rendered in 3D in a virtual reality environment, which combines computational power with human intuition for the exploration and analysis of complex dynamical networks. We ground this simulation on structural connectivity obtained from diffusion spectrum imaging data and model it on neuronal population dynamics. Users can interact with BrainX3 in real-time by perturbing brain regions with transient stimulations to observe reverberating network activity, simulate lesion dynamics or implement network analysis functions from a library of graph theoretic measures. BrainX3 can thus be used as a novel immersive platform for exploration and analysis of dynamical activity patterns in brain networks, both at rest or in a task-related state, for discovery of signaling pathways associated to brain function and/or dysfunction and as a tool for virtual neurosurgery. Our results demonstrate these functionalities and shed insight on the dynamics of the resting-state attractor. Specifically, we found that a noisy network seems to favor a low firing attractor state. We also found that the dynamics of a noisy network is less resilient to lesions. Our simulations on TMS perturbations show that even though TMS inhibits most of the network, it also sparsely excites a few regions. This is presumably due to anti-correlations in the dynamics and suggests that even a lesioned network can show sparsely distributed increased activity compared to healthy resting-state, over specific brain areas., This research has been supported by the EC FP7 project, CEEDS (FP7-ICT-2009-5), under grant agreement n. 258749.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Spatializing experience: a framework for the geolocalization, visualization and exploration of historical data using VR/AR technologies

  • Pacheco Estefan, Daniel
  • Wierenga, Sytse
  • Omedas, Pedro
  • Wilbricht , Stefan
  • Knoch, Habbo
  • Verschure, Paul F. M. J.
Comunicació presentada a: the 2014 Virtual Reality International Conference (VRIC 2014), celebrada a Laval, França, del 9 al'11 d'abril de 2014, In this study we present a novel ICT framework for the exploration and visualization of historical information using Augmented Reality (AR) and geolocalization. The framework facilitates the geolocalization of multimedia les, as well as their later retrieval and visualization through an AR paradigm in which a virtual reconstruction is matched to user's positions and viewing angle. The main objective of the architecture is to enhance human-data interaction with cultural heritage content in outdoor settings and generate more engaging and profound learning experiences by exploiting information spatialization and sequencing strategies., This research received funding from the European Community's Seventh Framework Programme (FP7-ICT-2009-5) under grant agreement n. 258749 [CEEDS].
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Contribución de congreso (ConferenceOutput)

Segmentation of dynamic objects from laser data

  • Ortega, Agustín
  • Andrade-Cetto, Juan
Presentado al ECMR 2011 celebrado en Örebro (Sweden) del 7 al 9 de septiembre., We present a method to segment dynamic objects from high-resolution low-rate laser scans. Data points are tagged as static or dynamic based on the classification of pixel data from registered imagery. Per-pixel background classes are adapted online as Gaussian mixtures, and their matching 3D points are classified accordingly. Special attention is paid to the correct calibration and synchronization of the scanner with the the accessory camera. Results of the method are shown for a small indoor sequence with several people following arbitrarily different trajectories., This work has been partially supported by the Mexican Council of Science and Technology with a PhD Scholarship to A. Ortega, by the Spanish Ministry of Science and Innovation under projects PAU (DPI2008-06022) and MIPRCV Consolider Ingenio (CSD2007-018), and by the CEEDS (FP7-ICT- 2009-5-95682) and INTELLACT (FP7-ICT2009-6-269959) projects of the EU. The authors thank M. Morta for the development of the 3D laser used for this research., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Contribución de congreso (ConferenceOutput)

FaMSA: Fast multi-scan alignment with partially known correspondences

  • Teniente, Ernesto H.
  • Andrade-Cetto, Juan
Presentado al ECMR 2011 celebrado en Örebro (Sweden) del 7 al 9 de septiembre., This paper presents FaMSA, an efficient method to boost 3D scan registration from partially known correspondence sets. This situation is typical at loop closure in large laser-based mapping sessions. In such cases, scan registration for consecutive point clouds has already been made during open loop traverse, and the point match history can be used to speed up the computation of new scan matches. FaMSA allows to quickly match a new scan with multiple consecutive scans at a time, with the consequent benefits in computational speed. Registration error is shown to be comparable to that of independent scan alignment. Results are shown for dense 3D outdoor scan matching., This work has been partially supported by the Mexican Council of Science and Technology with a PhD Scholarship to E.H. Teniente, by the Spanish Ministry of Science and Innovation under projects PAU (DPI2008-06022) and MIPRCV Consolider Ingenio (CSD2007-018), and by the CEEDS (FP7-ICT- 2009-5-95682) and INTELLACT (FP7-ICT2009-6-269959) projects of the EU., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Contribución de congreso (ConferenceOutput)

Dense outdoor 3D mapping and navigation with Pose SLAM

  • Teniente, Ernesto H.
  • Valencia, Rafael
  • Andrade-Cetto, Juan
Presentado al Workshop de Robótica Experimental celebrado en Sevilla del 28 al 29 de noviembre de 2011., Pose SLAM is the variant of SLAM where only the robot trajectory is estimated and in which landmarks are solely used to compute relative constraints between robot poses. In previous work, we have developed efficient methods to build Pose SLAM maps that ponder the information content on odometry and measurement links to keep the graph of poses sparse. In this paper we show results of Pose SLAM mapping with our custom built 3D laser and an outdoor all-terrain mobile robot. Finally, we argue that Pose SLAM graphs can be directly used as belief roadmaps and, thus, used for path planning under uncertainty. We show how to plan trajectories with the lowest accumulated robot pose uncertainty, i.e., the most reliable path to the goal, taking into account the encoded uncertainty in the map. Results of this navigation strategy are demonstrated with our outdoor robot., This work has been partially supported by the Mexican Council of Science and Technology with PhD Scholarships to E.H. Teniente and R. Valencia, by the Spanish Ministry of Science and Innovation under projects PAU (DPI2008-06022) and MIPRCV Consolider Ingenio (CSD2007-018), and by the CEEDS (FP7-ICT-2009-5-95682) and INTELLACT (FP7-ICT2009-6-269959) projects of the EU., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Bootstrapping boosted random Ferns for discriminative and efficient object classification

  • Villamizar, Michael
  • Andrade-Cetto, Juan
  • Sanfeliu, Alberto
  • Moreno-Noguer, Francesc
Best Papers of Iberian Conference on Pattern Recognition and Image Analysis (IbPRIA'2011)., In this paper we show that the performance of binary classifiers based on Boosted Random Ferns can be significantly improved by appropriately bootstrapping the training step. This results in a classifier which is both highly discriminant and computationally efficient and is particularly suitable when only small sets of training images are available. During the learning process, a small set of labeled images is used to train the boosting binary classifier. The classifier is then evaluated over the training set and warped versions of the classified and misclassified patches are progressively added into the positive and negative sample sets for a new retraining step. In this paper we thoroughly study the conditions under which this bootstrapping scheme improves the detection rates. In particular we assess the quality of detection both as a function of the number of bootstrapping iterations and the size of the training set. We compare our algorithm against state-of-the-art approaches for several databases including faces, cars, motorbikes and horses, and show remarkable improvements in detection rates with just a few bootstrapping steps., This work was supported by the Spanish Ministry of Science and Innovation under Projects RobTaskCoop (DPI2010-17112), PAU (DPI2008-06022), PAU + (DPI2011-27510) and MIPRCV (Consolider-Ingenio 2010)(CSD2007-00018), and the EU CEEDS Project FP7-ICT-2009-5-95682 and the EU ARCAS Project FP7-ICT-2011-287617. The first author is funded by the Technical University of Catalonia., Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Contribución de congreso (ConferenceOutput)

Detection performance evaluation of boosted random Ferns

  • Villamizar Vergel, Michael Alejandro
  • Moreno-Noguer, Francesc
  • Andrade-Cetto, Juan
  • Sanfeliu, Alberto
Trabajo presentado a la 5th Iberian Conference (IbPRIA) celebrada en Las Palmas de Gran Canaria del 8 al 10 de junio de 2011., We present an experimental evaluation of Boosted Random Ferns in terms of the detection performance and the training data. We show that adding an iterative bootstrapping phase during the learning of the object classifier, it increases its detection rates given that additional positive and negative samples are collected (bootstrapped) for retraining the boosted classifier. After each bootstrapping iteration, the learning algorithm is concentrated on computing more discriminative and robust features (Random Ferns), since the bootstrapped samples extend the training data with more difficult images. The resulting classifier has been validated in two different object datasets, yielding successful detections rates in spite of challenging image conditions such as lighting changes, mild occlusions and cluttered background., This work was supported by the Spanish Ministry of Science and Innovation under Projects RobTaskCoop (DPI2010-17112), PAU (DPI2008-06022), and MIPRCV (Consolider-Ingenio 2010) (CSD2007-00018), and the EU CEEDS Project FP7-ICT-2009-5-95682. The first author is funded by the Technical University of Catalonia (UPC)., Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Contribución de congreso (ConferenceOutput)

Efficient 3D object detection using multiple pose-specific classifiers

  • Villamizar, Michael
  • Grabner, Helmut
  • Moreno-Noguer, Francesc
  • Andrade-Cetto, Juan
  • Gool, Luc van
  • Sanfeliu, Alberto
Presentado al 22nd BMVC celebrado en University of Dundee (Escocia) en septiembre de 2011., We propose an efficient method for object localization and 3D pose estimation. A two-step approach is used. In the first step, a pose estimator is evaluated in the input images in order to estimate potential object locations and poses. These candidates are then validated, in the second step, by the corresponding pose-specific classifier. The result is a detection approach that avoids the inherent and expensive cost of testing the complete set of specific classifiers over the entire image. A further speedup is achieved by feature sharing. Features are computed only once and are then used for evaluating the pose estimator and all specific classifiers. The proposed method has been validated on two public datasets for the problem of detecting of cars under several views. The results show that the proposed approach yields high detection rates while keeping efficiency., This work was supported by the Spanish Ministry of Science and Innovation under Projects RobTaskCoop (DPI2010-17112), PAU (DPI2008-06022), and MIPRCV (Consolider - Ingenio 2010 CSD2007-00018), and the EU CEEDS Project FP7-ICT-2009-5-95682., Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Contribución de congreso (ConferenceOutput)

Robot companions for guiding people in urban areas

  • Garrell, Anaís
  • Corominas Murtra, Andreu
  • Sanfeliu, Alberto
Presentado al Workshop de Robótica Experimental celebrado en Sevilla del 28 al 29 de noviembre de 2011., In this paper we explain some developments on robot guidance of people and how we manage the robust navigation in urban areas. This work is part of the research of ongoing EU and national research projects (URUS, RobTaskCoop, CONET). We describe the Discrete Time Model for people guidance by robots, how we optimize the tasks of the robots for doing the guidance mission and how we have verified the model comparing the model results against the ground truth of people and robot motions. In this verification we have assumed that people are not afraid by the robot motions. We also describe the robust navigation method that is used by the robots that perform the guiding mission showing some examples of navigation in the Barcelona Robot Lab, an outdoor lab of 10.000m sq m., This work was partially supported by CICYT projects RobTaskCoop (DPI2010-17112) and MIPRCV Consolider Ingenio (CSD2007-018); and by the project Cooperating Objects Network of Excellence FP7-ICT-2007-2-224053 and CEEDS (FP7-ICT-2009-5-95682) of the European Community., Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Contribución de congreso (ConferenceOutput)

XIM-Engine: a software framework to support the development of interactive applications that uses conscious and unconscious reactions in immersive mixed reality

  • Grau Saldes, Antoni
  • Goldhoorn, Alex
  • Guerra, Edmundo
  • Alquézar Mancho, Renato
  • Sanfeliu, Alberto
Trabajo presentado a la Virtual Reality International Conference (VRIC) celebrada del 9 al 11 de abril de 2014 en Laval (Francia).-- et al., The development of systems that allow multimodal interpretation of human-machine interaction is crucial to advance our understanding and validation of theoretical models of user behavior. In particular, a system capable of collecting, perceiving and interpreting unconscious behavior can provide rich contextual information for an interactive system. One possible application for such a system is in the exploration of complex data through immersion, where massive amounts of data are generated every day both by humans and computer processes that digitize information at different scales and resolutions thus exceeding our processing capacity. We need tools that accelerate our understanding and generation of hypotheses over the datasets, guide our searches and prevent data overload. We describe XIM-engine, a bio-inspired software framework designed to capture and analyze multi-modal human behavior in an immersive environment. The framework allows performing studies that can advance our understanding on the use of conscious and unconscious reactions in interactive systems., The work described in this paper has been supported by the European Commission, Seventh Framework Programme under the research grant CEEDs (FP7-ICT- 258749)., Peer Reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Tesis doctoral (DoctoralThesis)

Searching and tracking of humans in urban environments with humanoid robots

  • Goldhoorn, Alex
Doctoral Programme: Automatic Control, Robotics and Computer Vision. This thesis has been completed at: Institut de Robòtica i Informàtica Industrial, CSIC-UPC., [EN]: Searching and tracking are important behaviours for a mobile service robot to assist people, to search-and-rescue and, in general, to locate mobile objects, animals or humans. Even though searching might be evident for humans, for robots it is not, since it requires exploring, handling noisy sensors, coping with dynamic obstacles, and coordination in the case of multiple agents. In this thesis, we present several methods to search and track a person in an urban environment. All methods were fist tested extensively in simulation and then in real-life, using one or two mobile service robots, called Tibi and Dabo. The robots have laser range finders, which are used to navigate, to detect obstacles and to detect people's legs. Since we focus on search-and-track methods, we use existing methods for robot navigation, for people detection and person recognition. First tests are done with the hide-and-seek problem, in which the robot learns to catch the hider. Concretely, a Mixed Observable Markov Decision Process (MOMDP) model is used, in which the seeker's location is fully observable and the hider's location partially observable. Since the computational complexity depends on the number of states, we propose a hierarchical on-line method that reduces the state space by grouping them together. Although the method worked properly in simulation, in the real-life experiments the results were not satisfying and the on-line policy calculation was not fast enough to work in real-time. To handle larger environments, work in continuous state space and run in real-time, we propose to use an approach, the Continuous Real-time POMCP (CR-POMCP), that does Monte-Carlo simulations to learn a policy. The method performed correctly in simulation, but on the real robot it resulted in slow zigzag movements. Therefore, a new method is proposed, which uses the highest probable locations, according to its probability map (belief). Since the belief propagation of the POMCP resembles how a Particle Filter (PF) works, we also propose a method that uses a PF to maintain the belief. The PF method has to handle lack of observations, therefore, we introduce a special weight function. Both belief update methods take into account sensor and actuator noise, false negative detections, false positive detections (for a short time) and dynamic obstacles. Finally, a cooperative distributed multi-agent method is presented, it makes use of the previous belief update functions, but it uses all the agents' observations. Next, the search locations are assigned by exploring the working environment, taking into account: the belief, the distance to the search location and if another agent already will search close to it. Summarizing, the main contributions of this thesis are several methods to search and track a person in an urban environment with one or more mobile service robots. All these methods have been shown to work through a set of simulations and real-life experiments., [CA]: La cerca i el seguiment de persones són comportaments importants per un robot mòbil de servei per poder assistir, trobar i ajudar als humans, i en general, per localitzar objectes, animals o vianants. Tot i que la cerca és fàcil per als humans, no ho és per a un robot, ja que requereix exploració, maneig de soroll de sensors, fer front als obstacles dinàmics, i la coordinació en el cas de múltiples agents. En aquesta tesi presentem diferents mètodes per a buscar i seguir a una persona en un entorn urbà. Tots els mètodes han estat provats extensivament en simulació i després en el món real, utilitzant dos robots mòbils de servei, la Tibi i en Dabo. Els robots utilitzen sensors làser per a navegar, detectar obstacles i detectar les cames de les persones. Atès que aquest treball es centra en mètodes de cerca i seguiment, s’han usat els mètodes existents per a la navegació del robot, la detecció i el reconeixement de persones. Primerament, s’han fet proves amb el conegut joc del fet i amagar, on el robot aprèn a trobar l’amagador. S’ha fet servir el model Mixed Observable Markov Decision Process (MOMDP), on la posició del trobador és completament visible i la posició de l’amagador és parcialment visible. Degut a que la complexitat computacional depèn del nombre d’estats, es proposa un mètode jeràrquic en línia que redueix l’espai d’estats, tot agrupant-los. Tot i que el mètode va funcionar correctament en simulació, en els experiments reals els resultats no van ser satisfactoris, i el càlcul de la política no va ser prou ràpid com per treballar en temps real. Per tal de fer front a entorns de més superfície, treballar en l’espai continu i executar en temps real, proposem un nou enfocament, el Continuous Real-time POMCP (CRPOMCP), que fa simulacions de Monte-Carlo per aprendre una política. El mètode va funcionar correctament en l’entorn simulat, però a l’entorn real el robot realitzava lents moviments en zig-zag. Per tant, es proposa un mètode nou, que utilitza els llocs amb més alta probabilitat, d’acord amb el seu mapa de probabilitats (belief). Atès que la propagació de les probabilitats en el POMCP és similar al funcionament d’un filtre de partícules (PF), proposem, a més, un mètode que utilitza un PF per mantenir el belief. El mètode de PF ha de manejar la manca d’observacions. Per tant, introduïm una funció del pes especial. Tots dos mètodes de creences tenen en compte el soroll dels sensors i actuadors, la detecció de falsos negatius i positius (per a un curt període de temps) i els obstacles dinàmics. Finalment, es presenta un mètode multi-agent distribuït cooperatiu, que fa ús de les anteriors funcions d’actualització de la creença (belief), i a més utilitza totes les observacions dels agents. En el proper pas, les ubicacions de cerca s’assignen mitjançant l’exploració de l’entorn de treball, tenint en compte la creença, la distància a la ubicació de cerca i si un altre agent ja buscarà a prop d’ella. En resum, les principals contribucions d’aquesta tesi són diversos mètodes per a la cerca i seguiment d’una persona en un entorn urbà amb un o més robots de serveis mòbils. Tots aquests mètodes han demostrat que funcionen a través d’un conjunt de simulacions i experiments en la entorn real dinàmics., [ES]: La búsqueda y el seguimiento de personas son comportamientos importantes para un robot móvil de servicio para poder asistir, buscar y ayudar a la gente, y en general, para localizar un objeto, animal o humano. Aunque la búsqueda puede parecer muy fácil para los humanos, para los robots no lo es, ya que requiere explorar, manejar ruido de sensores, enfrentarse con obstáculos dinámicos y la coordinación en el caso de haber más agentes. En esta tesis, presentamos diferentes métodos para buscar y seguir a una persona en un entorno urbano. Todos los métodos han sido probados excesivamente en simulación y en experimentos reales, usando uno o dos robots móviles de servicio, Tibi y Dabo. Los robots tienen localizadores láser, los cuales se usan para navegar, detectar obstáculos y detectar piernas. Ya que el principal enfoque en este trabajo son los métodes de buscar-y-seguir, utilizamos métodos existentes para la navigación del robot, la detección de personas y el reconecimiento del humano. Las primeras pruebas se hicieron con el juego de escondite, en el cual el robot aprende a buscar el ocultador. Concretamente, usamos un modelo MOMDP, donde la posición del buscador es completamente observable y la posición del ocultador lo es parcialmente. Como la complejidad computacional depende del número de estados, proponemos un método en línea jerárquica, que reduce el espacio de los estados agrupándolos. Aunque el método funcionó correctamente en simulación, en los experimentos reales los resultados no fueron satisfechos y el cálculo de la política en línea no fue suficientemente rápido. Para poder trabajar en áreas largas, espacio continuo y en línea, proponemos un enfoque, el Continuous Real-time POMCP (CR-POMCP), que hace simulaciones de Monte-Carlo para aprender la política. El método funcionó correctamente en simulación, pero con el robot real resultaba en movimientos lentos en forma zigzag. Por eso, otro método fue propuesto, el cual usa las posiciones con la probabilidad más alta según el mapa de probabilidades (belief). Como la propagación del belief se parece mucho a como funciona un PF, proponemos un método que usa un PF para mantener el belief. El método PF tiene que manejar la falta de observaciones y por eso introducimos una función del peso especial. Los dos métodos para actualizar el belief tienen en cuenta el ruido de los sensores y actuadores, falsos negativos y positivos (durante un periodo corto de tiempo) y obstáculos dinámicos. Finalmente, se presenta un método cooperativo y distribuido para multi agentes, que usa el mapa de probabilidades (belief), y éste usa todas las observaciones. Después, se asigna las posiciones de búsqueda a los agentes, explorando el entorno, y teniendo en cuenta: la probabilidad de la posición, la distancia a la posición y si otro agente ya buscará cerca del lugar. En resumen, la contribución más importante de esta tesis son diferentes métodos de búsqueda y seguimiento de una persona en un entorno urbano con uno o más robots de servicio móviles. Todos estos métodos fueron comprobados en simulación y en experimentación real., [NL]: Zoeken en traceren zijn belangrijke manieren om een mobiele servicerobot te helpen mensen, om te zoeken en te redden en, in het algemeen, om mobiele objecten, dieren of mensen te lokaliseren. En hoewel zoeken evident is voor de mens, is dit niet het geval voor robots. Het vereist namelijk verschillende vaardigeheden zoals verkennen, omgaan met ruis in de sensoren en dynamische obstakels en coördinatie in het geval van meerdere agenten. In deze thesis presenteren we verschillende methoden om een persoon te zoeken en te volgen (search-and-track) in een stedelijke omgeving. De methoden zijn eerst getest met simulaties en daarna met twee echte mobiele servicerobots, genaamd Tibi en Dabo. De robots hebben laser rangefinders om te navigeren en om obstakels en benen van mensen te detecteren. Omdat we ons richten op het zoeken en volgen van mensen gebruiken we bestaande methoden voor de robotnavigatie, detectie van personen en het herkennen van de gezochte persoon. De eerste testen gedaan met het spel hide-and-seek, waar de robot leert om de persoon te vinden. Een Mixed Observable Markov Decision Process (MOMDP) is gebruikt, waar de positie van de robot (zoeker) volledig waarneembaar is en die van de persoon (verstopper) gedeeltelijk. Omdat de berekeningscomplexiteit van het aantal staten afhangt, stellen we een hiërarchische online methode voor die de staatruimte verkleind door het groeperen van staten. Hoewel de methode goed werkt in simulatie, waren de resultaten van de experimenten met de robots minder goed. Verder was het online genereren van de politiek niet snel genoeg. Om in grote omgevingen te kunnen werken en continue staatruimte te gebruiken in real-time, hebben we de Continuous Real-time POMCP (CR-POMCP) voorgesteld. Dit algoritme gebruikt Monte-Carlo simulaties om de politiek (beste actie voor een bepaalde staat) te leren. De methode werkte goed in de simulaties, maar de robot maakte in de experimenten zigzaggende bewegingen. Om deze reden hebben we een nieuwe methode voorgesteld die gebruik maakt van een waarschijnlijkheidskaart (belief) over de lokatie van de persoon. Omdat de propagatie van de POMCP lijkt op hoe een Particle Filter (PF) werkt, stellen we ook een methode voor die een PF gebruikt om de belief bij te houden. De PF methode moet om kunnen gaan met missende observaties en we introduceren daarom een speciale gewichtsfunctie. Beide belief update methoden houden rekening met sensor en actuator ruis, incorrecte negatieve detecties, incorrecte positieve detecties (gedurende een korte tijd) en dynamische obstakels. Als laatst presenteren we een coöperatieve multi-agent methode die gebruik maakt van de genoemde belief update methoden, maar tevens gebruik maakt van de observaties van alle agenten. Vervolgens worden de zoeklocaties toegekend om de hele omgeving te verkennen waarbij rekening gehouden wordt met: de belief, de afstand tot de zoeklocatie en of een andere agent al dichtbij de lokatie gaat zoeken. Samenvattend zijn de belangrijkste bijdragen van deze thesis de verschillende methoden om personen te zoeken en te volgen in een stedelijke omgeving met één of meer mobiele servicerobots. Alle methoden zijn getest met simulaties en met experimenten met echte robots., This work has been supported by the Institut de Robòtica i Informàtica Industrial (IRI), Universitat Politècnica de Catalunya (UPC) and the following research projects: • The Collective Experience of Empathic Systems (CEEDs) [FP7-ICT-2009-5] (funded by the European Union). • RobTaskCoop: Cooperación robots humanos en áreas urbanas [DPI2010-17112] (funded by MINECO). • Rob-In-Coop: Interacción, aprendizaje y cooperación robot-humano en áreas urbanas [DPI2013-42458-P] (funded by MINECO)., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Detection performance evaluation of boosted random Ferns

  • Villamizar Vergel, Michael Alejandro
  • Moreno-Noguer, Francesc
  • Andrade-Cetto, Juan|||0000-0002-6354-8941
  • Sanfeliu Cortés, Alberto|||0000-0003-3868-9678
We present an experimental evaluation of Boosted Random Ferns in terms of the detection performance and the training data. We show that adding an iterative bootstrapping phase during the learning of the object classifier, it increases its detection rates given that additional positive and negative samples are collected (bootstrapped) for retraining the boosted classifier. After each bootstrapping iteration, the learning algorithm is concentrated on computing more discriminative and robust features (Random Ferns), since the bootstrapped samples extend the training data with more difficult images. The resulting classifier has been validated in two different object datasets, yielding successful detections rates in spite of challenging image conditions such as lighting changes, mild occlusions and cluttered background.
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Robot companions for guiding people in urban areas

  • Garrell Zulueta, Anais|||0000-0002-4629-0723
  • Corominas Murtra, Andreu|||0000-0001-8111-2351
  • Sanfeliu Cortés, Alberto|||0000-0003-3868-9678
In this paper we explain some developments on robot guidance of people and how we manage the robust navigation in urban areas. This work is part of the research of ongoing EU and national research projects (URUS, Rob- TaskCoop, CONET). We describe the Discrete Time Model for people guidance by robots, how we optimize the tasks of the robots for doing the guidance mission and how we have verified the model comparing the model results against the ground truth of people and robot motions. In this verification we have assumed that people are not afraid by the robot motions. We also describe the robust navigation method that is used by the robots that perform the guiding mission showing some examples of navigation in the Barcelona Robot Lab, an outdoor lab of 10.000m sq m.
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Dense outdoor 3D mapping and navigation with Pose SLAM

  • Teniente Avilés, Ernesto
  • Valencia Carreño, Rafael
  • Andrade-Cetto, Juan|||0000-0002-6354-8941
Pose SLAM is the variant of SLAM where only the robot trajectory is estimated and in which landmarks are solely used to compute relative constraints between robot poses. In previous work, we have developed efficient methods to build Pose SLAM maps that ponder the information content on odometry and measurement links to keep the graph of poses sparse. In this paper we show results of Pose SLAM mapping with our custom built 3D laser and an outdoor all-terrain mobile robot. Finally, we argue that Pose SLAM graphs can be directly used as belief roadmaps and, thus, used for path planning under uncertainty. We show how to plan trajectories with the lowest accumulated robot pose uncertainty, i.e., the most reliable path to the goal, taking into account the encoded uncertainty in the map. Results of this navigation strategy are demonstrated with our outdoor robot., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Efficient 3D object detection using multiple pose-specific classifiers

  • Villamizar Vergel, Michael Alejandro
  • Grabner, Helmut
  • Andrade-Cetto, Juan|||0000-0002-6354-8941
  • Sanfeliu Cortés, Alberto|||0000-0003-3868-9678
  • Van Gool, Luc
  • Moreno-Noguer, Francesc
We propose an efficient method for object localization and 3D pose estimation. A two-step approach is used. In the first step, a pose estimator is evaluated in the input images in order to estimate potential object locations and poses. These candidates are then validated, in the second step, by the corresponding pose-specific classifier. The result is a detection approach that avoids the inherent and expensive cost of testing the complete set of specific classifiers over the entire image. A further speedup is achieved by feature sharing. Features are computed only once and are then used for evaluating the pose estimator and all specific classifiers. The proposed method has been validated on two public datasets for the problem of detecting of cars under several views. The results show that the proposed approach yields high detection rates while keeping efficiency.
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

Segmentation of dynamic objects from laser data

  • Ortega Jiménez, Agustín Alberto
  • Andrade-Cetto, Juan|||0000-0002-6354-8941
We present a method to segment dynamic objects from high-resolution low-rate laser scans. Data points are tagged as static or dynamic based on the classification of pixel data from registered imagery. Per-pixel background classes are adapted online as Gaussian mixtures, and their matching 3D points are classified accordingly. Special attention is paid to the correct calibration and synchronization of the scanner with the the accessory camera. Results of the method are shown for a small indoor sequence with several people following arbitrarily different trajectories., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

FaMSA: fast multi-scan alignment with partially known correspondences

  • Teniente Avilés, Ernesto
  • Andrade-Cetto, Juan|||0000-0002-6354-8941
This paper presents FaMSA, an efficient method to boost 3D scan registration from partially known correspondence sets. This situation is typical at loop closure in large laser-based mapping sessions. In such cases, scan registration for consecutive point clouds has already been made during open loop traverse, and the point match history can be used to speed up the computation of new scan matches. FaMSA allows to quickly match a new scan with multiple consecutive scans at a time, with the consequent benefits in computational speed. Registration error is shown to be comparable to that of independent scan alignment. Results are shown for dense 3D outdoor scan matching.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

FaMSA: fast multi-scan alignment with partially known correspondences

  • Teniente Avilés, Ernesto
  • Andrade-Cetto, Juan
This paper presents FaMSA, an efficient method to boost 3D scan registration from partially known correspondence sets. This situation is typical at loop closure in large laser-based mapping sessions. In such cases, scan registration for consecutive point clouds has already been made during open loop traverse, and the point match history can be used to speed up the computation of new scan matches. FaMSA allows to quickly match a new scan with multiple consecutive scans at a time, with the consequent benefits in computational speed. Registration error is shown to be comparable to that of independent scan alignment. Results are shown for dense 3D outdoor scan matching., Preprint
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Robot companions for guiding people in urban areas

  • Garrell Zulueta, Anais
  • Corominas Murtra, Andreu
  • Sanfeliu Cortés, Alberto
In this paper we explain some developments on robot guidance of people and how we manage the robust navigation in urban areas. This work is part of the research of ongoing EU and national research projects (URUS, Rob- TaskCoop, CONET). We describe the Discrete Time Model for people guidance by robots, how we optimize the tasks of the robots for doing the guidance mission and how we have verified the model comparing the model results against the ground truth of people and robot motions. In this verification we have assumed that people are not afraid by the robot motions. We also describe the robust navigation method that is used by the robots that perform the guiding mission showing some examples of navigation in the Barcelona Robot Lab, an outdoor lab of 10.000m sq m., Postprint (author’s final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Visual anticipation biases conscious decision making but not bottom-up visual processing

  • Mathews, Zenon
  • Cetnarski, Ryszard
  • Verschure, Paul F. M. J.
Prediction plays a key role in control of attention but it is not clear which aspects of prediction are most prominent in conscious experience. An evolving view on the brain is that it can be seen as a prediction machine that optimizes its ability to predict states of the world and the self through the top-down propagation of predictions and the bottom-up presentation of prediction errors. There are competing views though on whether prediction or prediction errors dominate the formation of conscious experience. Yet, the dynamic effects of prediction on perception, decision making and consciousness have been difficult to assess and to model. We propose a novel mathematical framework and a psychophysical paradigm that allows us to assess both the hierarchical structuring of perceptual consciousness, its content and the impact of predictions and/or errors on conscious experience, attention and decision-making. Using a displacement detection task combined with reverse correlation, we reveal signatures of the usage of prediction at three different levels of perceptual processing: bottom-up fast saccades, top-down driven slow saccades and consciousnes decisions. Our results suggest that the brain employs multiple parallel mechanism at different levels of perceptual processing in order to shape effective sensory consciousness within a predicted perceptual scene. We further observe that bottom-up sensory and top-down predictive processes can be dissociated through cognitive load. We propose a probabilistic data association model from dynamical systems theory to model the predictive multi-scale bias in perceptual processing that we observe and its role in the formation of conscious experience. We propose that these results support the hypothesis that consciousness provides a time-delayed description of a task that is used to prospectively optimize real time control structures, rather than being engaged in the real-time control of behavior itself, This work was carried out as part of the CEEDS project; an EU funded Integrated Project under the Seventh Framework Programme (ICT-258749) and ERC grant cDAC (ERC-341196).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Efficient 3D object detection using multiple pose-specific classifiers

  • Villamizar Vergel, Michael Alejandro
  • Grabner, Helmut
  • Andrade-Cetto, Juan
  • Sanfeliu Cortés, Alberto
  • Van Gool, Luc
  • Moreno-Noguer, Francesc
We propose an efficient method for object localization and 3D pose estimation. A two-step approach is used. In the first step, a pose estimator is evaluated in the input images in order to estimate potential object locations and poses. These candidates are then validated, in the second step, by the corresponding pose-specific classifier. The result is a detection approach that avoids the inherent and expensive cost of testing the complete set of specific classifiers over the entire image. A further speedup is achieved by feature sharing. Features are computed only once and are then used for evaluating the pose estimator and all specific classifiers. The proposed method has been validated on two public datasets for the problem of detecting of cars under several views. The results show that the proposed approach yields high detection rates while keeping efficiency., Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Differential neural mechanisms for early and late prediction error detection

  • Malekshahi, Rahim
  • Seth, Anil
  • Papanikolaou, Amalia
  • Mathews, Zenon
  • Birbaumer, Niels
  • Verschure, Paul F. M. J.
  • Caria, Andrea
Emerging evidence indicates that prediction, instantiated at different perceptual levels, facilitate visual processing and enable prompt and appropriate reactions. Until now, the mechanisms underlying the effect of predictive coding at different stages of visual processing have still remained unclear. Here, we aimed to investigate early and late processing of spatial prediction violation by performing combined recordings of saccadic eye movements and fast event-related fMRI during a continuous visual detection task. Psychophysical reverse correlation analysis revealed that the degree of mismatch between current perceptual input and prior expectations is mainly processed at late rather than early stage, which is instead responsible for fast but general prediction error detection. Furthermore, our results suggest that conscious late detection of deviant stimuli is elicited by the assessment of prediction error’s extent more than by prediction error per se. Functional MRI and functional connectivity data analyses indicated that higher-level brain systems interactions modulate conscious detection of prediction error through top-down processes for the analysis of its representational content, and possibly regulate subsequent adaptation of predictive models. Overall, our experimental paradigm allowed to dissect explicit from implicit behavioral and neural responses to deviant stimuli in terms of their reliance on predictive models., This work was supported by the European Union, FP7-ICT-2009 – CEEDS: The Collective Experience of Empathic Data Systems - Grant agreement no. 258749.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Spatializing experience: a framework for the geolocalization, visualization and exploration of historical data using VR/AR technologies

  • Pacheco Estefan, Daniel
  • Wierenga, Sytse
  • Omedas, Pedro
  • Wilbricht , Stefan
  • Knoch, Habbo
  • Verschure, Paul F. M. J.
Comunicació presentada a: the 2014 Virtual Reality International Conference (VRIC 2014), celebrada a Laval, França, del 9 al'11 d'abril de 2014, In this study we present a novel ICT framework for the exploration and visualization of historical information using Augmented Reality (AR) and geolocalization. The framework facilitates the geolocalization of multimedia les, as well as their later retrieval and visualization through an AR paradigm in which a virtual reconstruction is matched to user's positions and viewing angle. The main objective of the architecture is to enhance human-data interaction with cultural heritage content in outdoor settings and generate more engaging and profound learning experiences by exploiting information spatialization and sequencing strategies., This research received funding from the European Community's Seventh Framework Programme (FP7-ICT-2009-5) under grant agreement n. 258749 [CEEDS].
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Connectomics to semantomics: addressing the brain's big data challenge

  • Arsiwalla, Xerxes D.
  • Dalmazzo, David
  • Zucca, Riccardo
  • Betella, Alberto
  • Brandi Hernández, Santiago
  • Martínez Bueno, Enrique
  • Omedas, Pedro
  • Verschure, Paul F. M. J.
Can semantic corpora be coupled to dynamical simulations in such a way so as to extract new associations from the data that were hitherto unapparent? We attempt to do this within neuroscience as an application domain, by introducing the notion of the semantome and coupling it to the connectome of the human brain network. This is implemented using BrainX3, a virtual reality simulation cum data mining platform that can be used for visualization, analysis and feature extraction of neuroscience data. We use this system to explore anatomical, functional and symptomatic semantics associated to simulated neuronal activity of a healthy brain, one with stroke and one perturbed by transcranial magnetic stimulation. In particular, we find that parietal and occipital lesions in stroke affect the visual processing pathway leading to symptoms such as visual neglect, depression and photo-sensitivity seizures. Integrating semantomics with connectomics thus generates hypotheses about symptoms, functions and brain activity that supplement existing tools for diagnosis of mental illness. Our results suggest a new approach to big data with potential applications to other domains., We thank Olaf Sporns and Chris Honey for sharing the DSI data. Research supported by CEEDS (FP7-ICT-2009-5) & CDAC (ERC-2013-ADG 341196) projects.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Detection performance evaluation of boosted random Ferns

  • Villamizar Vergel, Michael Alejandro
  • Moreno-Noguer, Francesc
  • Andrade-Cetto, Juan
  • Sanfeliu Cortés, Alberto
We present an experimental evaluation of Boosted Random Ferns in terms of the detection performance and the training data. We show that adding an iterative bootstrapping phase during the learning of the object classifier, it increases its detection rates given that additional positive and negative samples are collected (bootstrapped) for retraining the boosted classifier. After each bootstrapping iteration, the learning algorithm is concentrated on computing more discriminative and robust features (Random Ferns), since the bootstrapped samples extend the training data with more difficult images. The resulting classifier has been validated in two different object datasets, yielding successful detections rates in spite of challenging image conditions such as lighting changes, mild occlusions and cluttered background., Postprint (author’s final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Segmentation of dynamic objects from laser data

  • Ortega Jiménez, Agustín Alberto
  • Andrade-Cetto, Juan
We present a method to segment dynamic objects from high-resolution low-rate laser scans. Data points are tagged as static or dynamic based on the classification of pixel data from registered imagery. Per-pixel background classes are adapted online as Gaussian mixtures, and their matching 3D points are classified accordingly. Special attention is paid to the correct calibration and synchronization of the scanner with the the accessory camera. Results of the method are shown for a small indoor sequence with several people following arbitrarily different trajectories., Peer Reviewed, Postprint (author’s final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Network dynamics with BrainX3: a large-scale simulation of the human brain network with real-time interaction

  • Arsiwalla, Xerxes D.
  • Zucca, Riccardo
  • Betella, Alberto
  • Martínez Bueno, Enrique
  • Dalmazzo, David
  • Omedas, Pedro
  • Deco, Gustavo
  • Verschure, Paul F. M. J.
BrainX3 is a large-scale simulation of human brain activity with real-time interaction, rendered in 3D in a virtual reality environment, which combines computational power with human intuition for the exploration and analysis of complex dynamical networks. We ground this simulation on structural connectivity obtained from diffusion spectrum imaging data and model it on neuronal population dynamics. Users can interact with BrainX3 in real-time by perturbing brain regions with transient stimulations to observe reverberating network activity, simulate lesion dynamics or implement network analysis functions from a library of graph theoretic measures. BrainX3 can thus be used as a novel immersive platform for exploration and analysis of dynamical activity patterns in brain networks, both at rest or in a task-related state, for discovery of signaling pathways associated to brain function and/or dysfunction and as a tool for virtual neurosurgery. Our results demonstrate these functionalities and shed insight on the dynamics of the resting-state attractor. Specifically, we found that a noisy network seems to favor a low firing attractor state. We also found that the dynamics of a noisy network is less resilient to lesions. Our simulations on TMS perturbations show that even though TMS inhibits most of the network, it also sparsely excites a few regions. This is presumably due to anti-correlations in the dynamics and suggests that even a lesioned network can show sparsely distributed increased activity compared to healthy resting-state, over specific brain areas., This research has been supported by the EC FP7 project, CEEDS (FP7-ICT-2009-5), under grant agreement n. 258749.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Fast mental states decoding in mixed reality

  • De Massari, Daniele
  • Pacheco, Daniel
  • Malekshahi, Rahim
  • Betella, Alberto
  • Verschure, Paul F. M. J.
  • Birbaumer, Niels
  • Caria, Andrea
The combination of Brain-Computer Interface (BCI) technology, allowing online monitoring and decoding of brain activity, with virtual and mixed reality (MR) systems may help to shape and guide implicit and explicit learning using ecological scenarios. Real-time information of ongoing brain states acquired through BCI might be exploited for controlling data presentation in virtual environments. Brain states discrimination during mixed reality experience is thus critical for adapting specific data features to contingent brain activity. In this study we recorded electroencephalographic (EEG) data while participants experienced MR scenarios implemented through the eXperience Induction Machine (XIM). The XIM is a novel framework modeling the integration of a sensing system that evaluates and measures physiological and psychological states with a number of actuators and effectors that coherently reacts to the user's actions. We then assessed continuous EEG-based discrimination of spatial navigation, reading and calculation performed in MR, using linear discriminant analysis (LDA) and support vector machine (SVM) classifiers. Dynamic single trial classification showed high accuracy of LDA and SVM classifiers in detecting multiple brain states as well as in differentiating between high and low mental workload, using a 5 s time-window shifting every 200 ms. Our results indicate overall better performance of LDA with respect to SVM and suggest applicability of our approach in a BCI-controlled MR scenario. Ultimately, successful prediction of brain states might be used to drive adaptation of data representation in order to boost information processing in MR., The present study was supported by EU grants: FP7-ICT-2009-258749 CEEDs: The Collective Experience of Empathic Data Systems; FP7-ICT-2013- 609593 BNCI Horizon 2020. The Future of Brain/Neural Computer Interaction: Horizon 2020; Italian Ministry of Health, GR-2009-1591908.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Dense outdoor 3D mapping and navigation with Pose SLAM

  • Teniente Avilés, Ernesto
  • Valencia Carreño, Rafael
  • Andrade-Cetto, Juan
Pose SLAM is the variant of SLAM where only the robot trajectory is estimated and in which landmarks are solely used to compute relative constraints between robot poses. In previous work, we have developed efficient methods to build Pose SLAM maps that ponder the information content on odometry and measurement links to keep the graph of poses sparse. In this paper we show results of Pose SLAM mapping with our custom built 3D laser and an outdoor all-terrain mobile robot. Finally, we argue that Pose SLAM graphs can be directly used as belief roadmaps and, thus, used for path planning under uncertainty. We show how to plan trajectories with the lowest accumulated robot pose uncertainty, i.e., the most reliable path to the goal, taking into account the encoded uncertainty in the map. Results of this navigation strategy are demonstrated with our outdoor robot., Peer Reviewed, Postprint (author’s final draft)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Inference of human affective states from psychophysiological measurements extracted under ecologically valid conditions

  • Betella, Alberto
  • Zucca, Riccardo
  • Cetnarski, Ryszard
  • Greco, Alberto
  • Lanatà, Antonio
  • Mazzei, Daniele
  • Tognetti, Alessandro
  • Arsiwalla, Xerxes D.
  • Omedas, Pedro
  • De Rossi, Danilo Emilio
  • Verschure, Paul F. M. J.
Compared to standard laboratory protocols, the measurement of psychophysiological signals in real world experiments poses technical and methodological challenges due to external factors that cannot be directly controlled. To address this problem, we propose a hybrid approach based on an immersive and human accessible space called the eXperience Induction Machine (XIM), that incorporates the advantages of a laboratory within a life-like setting. The XIM integrates unobtrusive wearable sensors for the acquisition of psychophysiological signals suitable for ambulatory emotion research. In this paper, we present results from two different studies conducted to validate the XIM as a general-purpose sensing infrastructure for the study of human affective states under ecologically valid conditions. In the first investigation, we recorded and classified signals from subjects exposed to pictorial stimuli corresponding to a range of arousal levels, while they were free to walk and gesticulate. In the second study, we designed an experiment that follows the classical conditioning paradigm, a well-known procedure in the behavioral sciences, with the additional feature that participants were free to move in the physical space, as opposed to similar studies measuring physiological signals in constrained laboratory settings. Our results indicate that, by using our sensing infrastructure, it is indeed possible to infer human event-elicited affective states through measurements of psychophysiological signals under ecological conditions., The research leading to these results has received funding from the European Community's Seventh Framework Programme (FP7-ICT-2009-5) under grant agreement n. 258749 [CEEDS]. The Generalitat de Catalunya (CUR, DIUE) and the European Social Fund are supporting this research.