Pasar al contenido principal

PERCEPCION Y COGNICION NEUROMORFICA PARA ACTUACION ROBOTICA DE ALTA VELOCIDAD

PID2019-105556GB-C33

•
Nombre agencia financiadora Agencia Estatal de Investigación
Acrónimo agencia financiadora AEI
Programa Programa Estatal de I+D+i Orientado a los Retos de la Sociedad
Convocatoria Proyectos de I+D+i (Generación de Conocimiento y Retos Investigación)
Año convocatoria 2019
Plan Estatal 2017-2020 Plan Estatal de Investigación Científica y Técnica y de Innovación
Centro beneficiario UNIVERSIDAD DE SEVILLA

Resultados relacionados

Resultados totales (Incluyendo duplicados): 9
Encontrada(s) 1 página(s)

RODIN. Repositorio de Objetos de Docencia e Investigación de la Universidad de Cádiz
Publicación Artículo científico (JournalArticle)

A Neuromorphic Vision and Feedback Sensor Fusion Based on Spiking Neural Networks for Real-Time Robot Adaption

  • López Osorio, Pablo
  • Domínguez Morales, Juan P.
  • Pérez Peña, Fernando
For some years now, the locomotion mechanisms used by vertebrate animals have been a major inspiration for the improvement of robotic systems. These mechanisms range from adapting their movements to move through the environment to the ability to chase prey, all thanks to senses such as sight, hearing, and touch. Neuromorphic engineering is inspired by brain problem-solving techniques with the goal of implementing models that take advantage of the characteristics of biological neural systems. While this is a well-defined and explored area in this field, there is no previous work that fuses analog and neuromorphic sensors to control and modify robotic behavior in real time. Herein, a system is presented based on spiking neural networks implemented on the SpiNNaker hardware platform that receives information from both analog (force-sensing resistor) and digital (neuromorphic retina) sensors and is able to adapt the speed and orientation of a hexapod robot depending on the stability of the terrain where it is located and the position of the target. These sensors are used to modify the behavior of different spiking central pattern generators, which in turn will adapt the speed and orientation of the robotic platform, all in real time. In particular, experiments show that the network is capable of correctly adapting to the stimuli received from the sensors, modifying the speed and heading of the robotic platform
RODIN. Repositorio de Objetos de Docencia e Investigación de la Universidad de Cádiz
Publicación Artículo científico (JournalArticle)

WiN-GUI: A graphical tool for neuron-based encoding

  • Müller-Cleve, Simon F.
  • Quintana Velázquez, Fernando Manuel
  • Fra, Vittorio
  • Galindo Riaño, Pedro Luis
  • Pérez Peña, Fernando
  • Urgese, Gianvito
  • Bartolozzi, Chiara
Neuromorphic computing relies on event-based, energy-efficient communication, inherently implying the need for conversion between real-valued (sensory) data and binary, sparse spiking representation. This is usually accomplished by using the real-valued data as current input to a spiking neuron model and tuning the neuron's parameters to match a desired – often biologically inspired – behavior. To support the investigation of neuron models and parameter combinations to identify suitable configurations for neuron-based encoding of sample-based data into spike trains we developed the WiN-GUI. Thanks to the generalized LIF model implemented by default, next to the LIF and Izhikevich neuron models, many spiking behaviors can be investigated out of the box offering the possibility of tuning biologically plausible responses to the input data. The GUI is provided open source and with documentation and is easy to extend with further neuron models and personalize with data analysis functions.
RODIN. Repositorio de Objetos de Docencia e Investigación de la Universidad de Cádiz
Publicación Artículo científico (JournalArticle)

NESIM-RT: A real-time distributed spiking neural network simulator

  • Rosa-Gallardo, Daniel J.
  • Torre Macías, Juan Carlos de la
  • Quintana Velázquez, Fernando Manuel
  • Domínguez Morales, Juan P.
  • Pérez Peña, Fernando
The neuromorphic engineering field aims to mimic complex biological structures by means of mathematical models, implementing them in either analog or digital circuits. These models include the dynamic characteristics of biological neurons and synapses, which are interconnected creating spiking neural networks. These are first simulated using software frameworks in order to verify the expected behavior of the implemented model. In this work, a novel software, called NESIM-RT, for simulating spiking neural networks in real time is presented. A friendly user interface allows users to design and modify the network, together with visualising its output in real time. A novel implementation of the MDHCP protocol is proposed to support online changes in the network together with allowing the simulation in a many-cores distributed architecture. The performance of the proposed software is compared with other widely-used simulators in the neuromorphic engineering field, highlighting the advantages in terms of latencies and network scalability. NESIM-RT also allows exporting the SNN model directly to SpiNNaker, enabling an immediate transition between software simulation and hardware implementation, Fernando M. Quintana and Juan Carlos de la Torre are funded by the Spanish Ministerio de Ciencia, Innovación Universidades under the FPU grants FPU18/04321 and FPU17/00563 . This work was partially supported by the Spanish grants (with support from the European Regional Development Fund) NEMOVISION ( PID2019-109465RB-I00 ), OPTIMALE ( FEDER-UCA18-108393 ) and MIND-ROB ( PID2019-105556GB-C33 ), together with the Andalusian Regional Project PAIDI2020 GENIUS ( P18-FR-2399 ). Besides, this publication is part of the project TED2021-131880B-I00 supported by the Spanish Ministry (with support from the European Union “NextGenerationEU”). All the authors want to thank Juan Andres Herrera Rodriguez for his support to the manuscript.
RODIN. Repositorio de Objetos de Docencia e Investigación de la Universidad de Cádiz
Publicación Artículo científico (JournalArticle)

Exploiting the PIR Sensor Analog Behavior as Thermoreceptor: Movement Direction Classification Based on Spiking Neurons

  • Guerrero Rodríguez, José María
  • Cifredo Chacón, María Ángeles
  • Cobos Sánchez, Clemente
  • Pérez Peña, Fernando
Pyroelectric infrared sensors (PIR) are widely used as infrared (IR) detectors due to their basic implementation, low cost, low power, and performance. Combined with a Fresnel lens, they can be used as a binary detector in applications of presence and motion control. Furthermore, due to their features, they can be used in autonomous intelligent devices or included in robotics applications or sensor networks. In this work, two neural processing architectures are presented: (1) an analog processing approach to achieve the behavior of a presynaptic neuron from a PIR sensor. An analog circuit similar to the leaky integrate and fire model is implemented to be able to generate spiking rates proportional to the IR stimuli received at a PIR sensor. (2) An embedded postsynaptic neuron where a spiking neural network matrix together with an algorithm based on digital processing techniques is introduced. This structure allows connecting a set of sensors to the post-synaptic circuit emulating an optic nerve. As a case study, the entire neural processing approach presented in this paper is applied to optical flow detection considering a four-PIR array as input. The results validate both the spiking approach for an analog sensor presented and the ability to retrieve the analog information sent as spike trains in a simulated optic nerve., Los sensores infrarrojos piroeléctricos (PIR) se utilizan ampliamente como detectores de infrarrojos (IR) debido a su implementación básica, bajo costo, baja potencia y rendimiento. Combinados con una lente Fresnel, se pueden utilizar como detector binario en aplicaciones de control de presencia y movimiento. Además, por sus características, pueden utilizarse en dispositivos inteligentes autónomos o incluirse en aplicaciones de robótica o redes de sensores. En este trabajo, se presentan dos arquitecturas de procesamiento neuronal: (1) un enfoque de procesamiento analógico para lograr el comportamiento de una neurona presináptica a partir de un sensor PIR. Se implementa un circuito analógico similar al modelo de integración y disparo con fugas para poder generar tasas de picos proporcionales a los estímulos IR recibidos en un sensor PIR. (2) Una neurona postsináptica integrada donde se introduce una matriz de red neuronal con picos junto con un algoritmo basado en técnicas de procesamiento digital. Esta estructura permite conectar un conjunto de sensores al circuito postsináptico emulando un nervio óptico. Como estudio de caso, todo el enfoque de procesamiento neuronal presentado en este artículo se aplica a la detección de flujo óptico considerando una matriz de cuatro PIR como entrada. Los resultados validan tanto el enfoque de picos para un sensor analógico presentado como la capacidad de recuperar la información analógica enviada como trenes de picos en un nervio óptico simulado., This research was partially supported by the Spanish grant MINDROB (PID2019-105556GB-C33) and by the CHIST-ERA H2020 grant SMALL (CHIST-ERA-18-ACAI-004).
RODIN. Repositorio de Objetos de Docencia e Investigación de la Universidad de Cádiz
Publicación Artículo científico (JournalArticle)

Neuromorphic adaptive spiking CPG towards bio-inspired locomotion

  • López Osorio, Pablo
  • Patiño-Saucedo, Alberto
  • Domínguez Morales, Juan P.
  • Rostro-Gonzalez, Horacio
  • Pérez Peña, Fernando
In recent years, locomotion mechanisms exhibited by vertebrate animals have been the inspiration for the improvement in the performance of robotic systems. These mechanisms include the adaptability of their locomotion to any change registered in the environment through their biological sensors. In this regard, we aim to replicate such kind of adaptability through a sCPG. This sCPG generates different locomotion (rhythmic) patterns which are driven by an external stimulus, that is, the output of a FSR sensor to provide feedback. The sCPG consists of a network of five populations of LIF neurons designed with a specific topology in such a way that the rhythmic patterns can be generated and driven by the aforementioned external stimulus. Therefore, eventually, the locomotion of an end robotic platform could be adapted to the terrain by using any sensor as input. The sCPG with adaptation has been numerically validated at software and hardware level, using the Brian 2 simulator and the SpiNNaker neuromorphic platform for the latest. In particular, our experiments clearly show an adaptation in the oscillation frequencies between the spikes produced in the populations of the sCPG while the input stimulus varies. To validate the robustness and adaptability of the sCPG, we have performed several tests by variating the output of the sensor. These experiments were carried out in Brian 2 and SpiNNaker; both implementations showed a similar behavior with a Pearson correlation coefficient of 0.905. © 2022 The Author(s)
RODIN. Repositorio de Objetos de Docencia e Investigación de la Universidad de Cádiz
Publicación Artículo científico (JournalArticle)

Towards neuromorphic FPGA-based infrastructures for a robotic arm

  • Canas Moreno, Salvador
  • Piñero-Fuentes, Enrique
  • Rios-Navarro, Antonio
  • Cascado-Caballero, Daniel
  • Pérez Peña, Fernando
  • Linares Barranco, Alejandro
Muscles are stretched with bursts of spikes that come from motor neurons connected to the cerebellum through the spinal cord. Then, alpha motor neurons directly innervate the muscles to complete the motor command coming from upper biological structures. Nevertheless, classical robotic systems usually require complex computational capabilities and relative highpower consumption to process their control algorithm, which requires information from the robot’s proprioceptive sensors. The way in which the information is encoded and transmitted is an important difference between biological systems and robotic machines. Neuromorphic engineering mimics these behaviors found in biology into engineering solutions to produce more efficient systems and for a better understanding of neural systems. This paper presents the application of a Spike-based Proportional-Integral-Derivative controller to a 6-DoF Scorbot ER-VII robotic arm, feeding the motors with Pulse-FrequencyModulation instead of Pulse-Width-Modulation, mimicking the way in which motor neurons act over muscles. The presented frameworks allow the robot to be commanded and monitored locally or remotely from both a Python software running on a computer or from a spike-based neuromorphic hardware. Multi-FPGA and single-PSoC solutions are compared. These frameworks are intended for experimental use of the neuromorphic community as a testbed platform and for dataset recording for machine learning purposes.
RODIN. Repositorio de Objetos de Docencia e Investigación de la Universidad de Cádiz
Publicación Artículo científico (JournalArticle)

Real-time detection of uncalibrated sensors using neural networks

  • Muñoz Molina, Luis J.
  • Cazorla Piñar, Ignacio
  • Domínguez Morales, Juan P.
  • Lafuente Molinero, Luis
  • Pérez Peña, Fernando
Nowadays, sensors play a major role in several fields, such as science, industry and everyday technology. Therefore, the information received from the sensors must be reliable. If the sensors present any anomalies, serious problems can arise, such as publishing wrong theories in scientific papers, or causing production delays in industry. One of the most common anomalies are uncalibrations. An uncalibration occurs when the sensor is not adjusted or standardized by calibration according to a ground truth value. In this work, an online machine-learning based uncalibration detector for temperature, humidity and pressure sensors is presented. This development integrates an artificial neural network as the main component which learns from the behavior of the sensors under calibrated conditions. Then, after being trained and deployed, it detects uncalibrations once they take place. The obtained results show that the proposed system is able to detect the 100% of the presented uncalibration events, although the time response in the detection depends on the resolution of the model for the specific location, i.e., the minimum statistically significant variation in the sensor behavior that the system is able to detect. This architecture can be adapted to different contexts by applying transfer learning, such as adding new sensors or having different environments by re-training the model with minimum amount of data., Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature. This work was partially supported by the Altran Innovation Center for Advance Manufacturing, the EU H2020 project Virtual IoT Maintenance System (VIMS Grant ID: 878757), the Spanish grant (with support from the European Regional Development Fund) MIND-ROB (PID2019-105556GB-C33) and by the EU H2020 project CHIST-ERA SMALL (PCI2019-111841-2).
RODIN. Repositorio de Objetos de Docencia e Investigación de la Universidad de Cádiz
Publicación Artículo científico (JournalArticle)

Bioinspired Spike-Based Hippocampus and Posterior Parietal Cortex Models for Robot Navigation and Environment Pseudomapping

  • Casanueva-Morato, Daniel
  • Ayuso-Martinez, Alvaro
  • Domínguez Morales, Juan P.
  • Jimenez Fernandez, Angel
  • Jiménez Moreno, Gabriel
  • Pérez Peña, Fernando
The brain has great capacity for computation and efficient resolution of complex problems, far surpassing modern computers. Neuromorphic engineering seeks to mimic the basic principles of the brain to develop systems capable of achieving such capabilities. In the neuromorphic field, navigation systems are of great interest due to their potential applicability to robotics, although these systems are still a challenge to be solved. This work proposes a spike-based robotic navigation and environment pseudomapping system formed by a bioinspired hippocampal memory model connected to a posterior parietal cortex (PPC) model. The hippocampus is in charge of maintaining a representation of an environment state map, and the PPC is in charge of local decision-making. This system is implemented on the SpiNNaker hardware platform using spiking neural networks. A set of real-time experiments are applied to demonstrate the correct functioning of the system in virtual and physical environments on a robotic platform. The system is able to navigate through the environment to reach a goal position starting from an initial position, avoiding obstacles and mapping the environment. To the best of the authors’ knowledge, this is the first implementation of an environment pseudomapping system with dynamic learning based on a bioinspired hippocampal memory.
RUA. Repositorio Institucional de la Universidad de Alicante
Publicación Otros (Other)

Práctica de desarrollo de un dispositivo de accesibilidad controlado mediante extremidades distales superiores basado en la plataforma Leap Motion

  • Ayuso-Martínez, Alvaro
  • Casanueva-Morato, Daniel
  • Marron-Esquivel, José Manuel
  • Duran-Lopez, Lourdes
  • Dominguez-Morales, Juan Pedro
Este artículo presenta una práctica de laboratorio impartida en el contexto de la asignatura Sistemas de Rehabilitación y Ayuda a la Discapacidad, la cual se imparte como optativa en el Grado en Ingeniería de la Salud – Mención en Ingeniería Biomédica. El objetivo principal de dicha práctica es la de adquirir la capacidad de desarrollar un dispositivo enfocado a la accesibilidad, el cual permita controlar el ratón del ordenador únicamente mediante gestos realizados con las manos. Los dispositivos y herramientas empleados para dicho fin son el hardware Leap Motion, que recoge los movimientos de las manos y los dedos gracias a los sensores de los que se compone, junto con el entorno de desarrollo Visual Studio, en el que se desarrolla una aplicación de escritorio mediante Windows Forms, .NET y C#. El proceso de desarrollo está guiado y documentado, aportando al alumno todo un entorno base sobre el que construir e ir aprendiendo mientras se avanza en el desarrollo. El proyecto a desarrollar por el alumno abarca competencias clave propias del grado en el que se lleva a cabo, incluyendo la resolución de problemas de carácter multidisciplinar, además de la programación orientada al desarrollo de dispositivos asistenciales.