Skip to main content

Resultados relacionados

Resultados totales (Incluyendo duplicados): 7
Encontrada(s) 1 página(s)

DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Artículo científico (JournalArticle)

A CMOL-Like Memristor-CMOS Neuromorphic Chip-Core Demonstrating Stochastic Binary STDP

  • Camuñas-Mesa, Luis A.
  • Vianello, Elisa
  • Reita, Carlo
  • Serrano-Gotarredona, Teresa
  • Linares-Barranco, Bernabé
The advent of nanoscale memristors raised hopes of being able to build CMOL (CMOS/nanowire/molecular) type ultra-dense in-memory-computing circuit architectures. In CMOL, nanoscale memristors would be fabricated at the intersection of nanowires. The CMOL concept can be exploited in neuromorphic hardware by fabricating lower density neurons on CMOS and placing massive analog synaptic connectivity with nanowire and nanoscale-memristor fabric post-fabricated on top. However, technical problems have hindered such developments for presently available reliable commercial monolithic CMOS-memristor technologies. On one hand, each memristor needs a MOS selector transistor in series to guarantee forming and programming operations in large arrays. This results in compound MOS-memristor synapses (called 1T1R) which are no longer synapses at the crossing of nanowires. On the other hand, memristors do not yet constitute highly reliable, stable analog memories for massive analog-weight synapses with gradual learning. Here we demonstrate a pseudo-CMOL monolithic chip core that circumvents the two technical problems mentioned above by: (a) exploiting a CMOL-like geometrical chip layout technique to improve density despite the 1T1R limitation, and (b) exploiting a binary weight stochastic Spike-Timing-Dependent-Plasticity (STDP) learning rule that takes advantage of the more reliable binary memory capability of the memristors used. Experimental results are provided for a spiking neural network (SNN) CMOL-core with 64 input neurons, 64 output neurons and 4096 1T1R synapses, fabricated in 130nm CMOS with 200nm-sized Ti/HfOx/TiN memristors on top. The CMOL-core uses query-driven event read-out, which allows for memristor variability insensitive computations. Experimental system-level demonstrations are provided for plain template matching tasks, as well as regularized stochastic binary STDP feature-extraction learning, obtaining perfect recognition in hardware for a 4-letter recognition experiment., This work was supported in part by EU H2020 under Grant 687299 “NeuRAM3” and Grant 871371 “MeM-Scales;” and in part by the Spain’s Ministry of Science and Innovation, with support from the European Regional Development Fund, under Grant PID2019-105556GB-C31 (NANOMIND). The work of Luis A. Camuñas-Mesa was supported by the VI PPIT through the Universidad de Sevilla., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Artículo científico (JournalArticle)

A CMOS-memristor hybrid system for implementing stochastic binary spike timing-dependent plasticity

  • Ahmadi-Farsani, Javad
  • Ricci, Saverio
  • Hashemkhani, Shahin
  • Ielmini, Daniele
  • Linares-Barranco, Bernabé
  • Serrano-Gotarredona, Teresa
This article is part of the theme issue ‘Advanced neurotechnologies: translating innovation for health and well-being’., This paper describes a fully experimental hybrid system in which a 4×4 memristive crossbar spiking neural network (SNN) was assembled using custom high-resistance state memristors with analogue CMOS neurons fabricated in 180 nm CMOS technology. The custom memristors used NMOS selector transistors, made available on a second 180 nm CMOS chip. One drawback is that memristors operate with currents in the micro-amperes range, while analogue CMOS neurons may need to operate with currents in the pico-amperes range. One possible solution was to use a compact circuit to scale the memristor-domain currents down to the analogue CMOS neuron domain currents by at least 5–6 orders of magnitude. Here, we proposed using an on-chip compact current splitter circuit based on MOS ladders to aggressively attenuate the currents by over 5 orders of magnitude. This circuit was added before each neuron. This paper describes the proper experimental operation of an SNN circuit using a 4×4 1T1R synaptic crossbar together with four post-synaptic CMOS circuits, each with a 5-decade current attenuator and an integrate-and-fire neuron. It also demonstrates one-shot winner-takes-all training and stochastic binary spike-timing-dependent-plasticity learning using this small system., This work was funded by EU H2020 grant nos. 824164 HERMES and 871371 MEM-SCALES, and by Spanish grants from the Ministry of Economy and Competitivity TEC2015- 63884-C2-1-P (COGNET) and PID2019-105556GB-C31 (NANOMIND) (with support from the European Regional Development Fund)., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Artículo científico (JournalArticle)

Liquid state machine on SpiNNaker for spatio-temporal classification tasks

  • Patiño-Saucedo, Alberto
  • Rostro-Gonzalez, Horacio
  • Serrano-Gotarredona, Teresa
  • Linares-Barranco, Bernabé
Liquid State Machines (LSMs) are computing reservoirs composed of recurrently connected Spiking Neural Networks which have attracted research interest for their modeling capacity of biological structures and as promising pattern recognition tools suitable for their implementation in neuromorphic processors, benefited from the modest use of computing resources in their training process. However, it has been difficult to optimize LSMs for solving complex tasks such as event-based computer vision and few implementations in large-scale neuromorphic processors have been attempted. In this work, we show that offline-trained LSMs implemented in the SpiNNaker neuromorphic processor are able to classify visual events, achieving state-of-the-art performance in the event-based N-MNIST dataset. The training of the readout layer is performed using a recent adaptation of back-propagation-through-time (BPTT) for SNNs, while the internal weights of the reservoir are kept static. Results show that mapping our LSM from a Deep Learning framework to SpiNNaker does not affect the performance of the classification task. Additionally, we show that weight quantization, which substantially reduces the memory footprint of the LSM, has a small impact on its performance., This work was supported by EU H2020 grant 871371 (MeM-Scales), by Spanish grant from the Ministry of Science and Innovation PID2019-105556GB-C31 (NANOMIND) with support from the European Regional Development Fund), and by CONACYT scholarship number 688116/578600., We also acknowledge support of the publication fee by the CSIC Open Access Publication Support Initiative through its Unit of Information Resources for Research (URICI)., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Artículo científico (JournalArticle)

SL-Animals-DVS: event-driven sign language animals dataset

  • Vasudevan, Ajay
  • Negri, Pablo
  • Di Ielsi, Camila
  • Linares-Barranco, Bernabé
  • Serrano-Gotarredona, Teresa
Non-intrusive visual-based applications supporting the communication of people employing sign language for communication are always an open and attractive research field for the human action recognition community. Automatic sign language interpretation is a complex visual recognition task where motion across time distinguishes the sign being performed. In recent years, the development of robust and successful deep-learning techniques has been accompanied by the creation of a large number of databases. The availability of challenging datasets of Sign Language (SL) terms and phrases helps to push the research to develop new algorithms and methods to tackle their automatic recognition. This paper presents ‘SL-Animals-DVS’, an event-based action dataset captured by a Dynamic Vision Sensor (DVS). The DVS records non-fluent signers performing a small set of isolated words derived from SL signs of various animals as a continuous spike flow at very low latency. This is especially suited for SL signs which are usually made at very high speeds. We benchmark the recognition performance on this data using three state-of-the-art Spiking Neural Networks (SNN) recognition systems. SNNs are naturally compatible to make use of the temporal information that is provided by the DVS where the information is encoded in the spike times. The dataset has about 1100 samples of 59 subjects performing 19 sign language signs in isolation at different scenarios, providing a challenging evaluation platform for this emerging technology., This work was funded by EU H2020 grants 824164 “HERMES”, 871371 “Memscales” and 871501 “NeuroNN”, Spanish grant from the Ministry of Economy and Competitivity NANOMIND-PID2019-105556GB-C31, with support from the European Regional Development Fund. P. Negri was partially supported by the Scholarship Program Mobility of the Postgraduate Iberoamerican University Association (AUIP). C. Di Ielsi was supported by a scholarship of the Computer Department of the University of Buenos Aires. A. Vasudevan was supported by the MINECO FPI scholarship BES-2016-077757., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Artículo científico (JournalArticle)

2022 roadmap on neuromorphic computing and engineering

  • Christensen, D.V.
  • Dittmann, R.
  • Linares-Barranco, Bernabé
  • Sebastian, A.
  • Le Gallo, M.
  • Redaelli, A.
  • Slesazeck, S.
  • Mikolajick, T.
  • Spiga, S.
  • Spiga, S.
Modern computation based on von Neumann architecture is now a mature cutting-edge science. In the von Neumann architecture, processing and memory units are implemented as separate blocks interchanging data intensively and continuously. This data transfer is responsible for a large part of the power consumption. The next generation computer technology is expected to solve problems at the exascale with 10 calculations each second. Even though these future computers will be incredibly powerful, if they are based on von Neumann type architectures, they will consume between 20 and 30 megawatts of power and will not have intrinsic physically built-in capabilities to learn or deal with complex data as our brain does. These needs can be addressed by neuromorphic computing systems which are inspired by the biological concepts of the human brain. This new generation of computers has the potential to be used for the storage and processing of large amounts of digital information with much lower power consumption than conventional processors. Among their potential future applications, an important niche is moving the control from data centers to edge devices. The aim of this roadmap is to present a snapshot of the present state of neuromorphic technology and provide an opinion on the challenges and opportunities that the future holds in the major areas of neuromorphic technology, namely materials, devices, neuromorphic circuits, neuromorphic algorithms, applications, and ethics. The roadmap is a collection of perspectives where leading researchers in the neuromorphic community provide their own view about the current state and the future challenges for each research area. We hope that this roadmap will be a useful resource by providing a concise yet comprehensive introduction to readers outside this field, for those who are just entering the field, as well as providing future perspectives for those who are well established in the neuromorphic computing community.
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Artículo científico (JournalArticle)

A tunable multi-timescale Indium-Gallium-Zinc-Oxide thin-film transistor neuron towards hybrid solutions for spiking neuromorphic applications

  • Velázquez López, Mauricio
  • Linares-Barranco, Bernabé
  • Lee, Jua
  • Erfanijazi, Hamidreza
  • Patiño-Saucedo, Alberto
  • Sifalakis, Manolis
  • Catthoor, Francky
  • Myny, Kris
Spiking neural network algorithms require fine-tuned neuromorphic hardware to increase their effectiveness. Such hardware, mainly digital, is typically built on mature silicon nodes. Future artificial intelligence applications will demand the execution of tasks with increasing complexity and over timescales spanning several decades. The multi-timescale requirements for certain tasks cannot be attained effectively enough through the existing silicon-based solutions. Indium-Gallium-Zinc-Oxide thin-film transistors can alleviate the timescale-related shortcomings of silicon platforms thanks to their bellow atto-ampere leakage currents. These small currents enable wide timescale ranges, far beyond what has been feasible through various emerging technologies. Here we have estimated and exploited these low leakage currents to create a multi-timescale neuron that integrates information spanning a range of 7 orders of magnitude and assessed its advantages in larger networks. The multi-timescale ability of this neuron can be utilized together with silicon to create hybrid spiking neural networks capable of effectively executing more complex tasks than their single-technology counterparts., The authors thank Donald Raddoux from KU Leuven, Belgium for his help during the sample packaging efforts and François Berghmans from imec Leuven, Belgium for his contribution in additional measurements during the review process of this paper. The authors acknowledge the support from the Horizon 2020 European project MeM-Scales—Memory technologies with multi-scale time constants for neuromorphic architectures (grant agreement No. 871371). Part of this work has received funding under the Horizon Europe program from the European Research Council (ERC) under grant agreement No 101088591 “ORISON”. Views and opinions expressed are, however, those of the author(s) only and do not necessarily reflect those of the European Union or the European Research Council. Neither the European Union nor the granting authority can be held responsible for them. The authors would like to thank the foundry Pragmatic for fabricating the circuits presented in this paper., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Artículo científico (JournalArticle)

Update Disturbance-Resilient Analog ReRAM Crossbar Arrays for In-Memory Deep Learning Accelerators

  • Choi, Wooseok
  • Stecconi, Tommaso
  • Falcone, Donato Francesco
  • Galetta, Matteo
  • Clerico, Victoria
  • Zaccaria, Elisa
  • Ram, Mamidala Saketh
  • La Porta, Antonio
  • Horst, Folkert
  • Jubin, Daniel
  • Senger, Matias
  • Sousa, Marilyne
  • Reidt, Steffen
  • Heller, Ralph
  • Linares-Barranco, Bernabé
  • Bragaglia, Valeria
  • Offrein, Bert Jan
Resistive memory (ReRAM) technologies with crossbar array architectures hold significant potential for analog AI accelerator hardware, enabling both in-memory inference and training. Recent developments have successfully demonstrated inference acceleration by offloading compute-heavy training workloads to off-chip digital processors. However, in-memory acceleration of training algorithms is crucial for more sustainable and power-efficient AI, but still in an early stage of research. This study addresses in-memory training acceleration using analog ReRAM arrays, focusing on a key challenge during fully parallel weight updates: disturbances of the weight values in cross-point devices. A ReRAM device solution is presented on 350 nm silicon technology, utilizing a resistive switching conductive metal oxide (CMO) formed on a nanoscale conductive filament within a HfOx layer. The devices not only exhibit 60 ns fast, non-volatile analog switching, but also demonstrates outstanding resilience to update disturbances, enduring over 100k pulses. The disturbance tolerance of the ReRAM is analyzed using COMSOL Multiphysics simulations, modeling the filament-induced thermoelectric energy concentration that results in highly nonlinear device responses to input voltage amplitudes. Disturbance-free parallel weight mapping is also demonstrated on the back-end-of-line integrated ReRAM array chip. Finally, comprehensive hardware-aware neural network simulations validate the potential of the ReRAM for in-memory deep learning accelerators capable of fully parallel weight updates., W.C. and T.S., contributed equally to this work. This work was co-funded by SNSF ALMOND (grantID: 198612), by the European Union and Swiss state secretariat SERI within the H2020 MeM-Scales (grantID: 871371) and PHASTRAC (grantID: 101092096) projects. The authors also acknowledged the Binnig and Rohrer Nanotechnology Center (BRNC) at IBM Research Europe - Zurich., Peer reviewed