Pasar al contenido principal

Resultados relacionados

Resultados totales (Incluyendo duplicados): 4
Encontrada(s) 1 página(s)

DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

A 128×128 Electronically Multi-Foveated Dynamic Vision Sensor With Real-Time Resolution Reconfiguration

  • Faramarzi, Farnaz
  • Linares-Barranco, Bernabé
  • Serrano-Gotarredona, Teresa
This paper presents the design and implementation of a 128× 128 electronically foveated dynamic vision sensor (EF-DVS) fabricated using 350 nm CMOS technology. The EF-DVS integrates a novel pixel grouping approach that permits real-time dynamic resolution adjustments via external digital signals. Previous approaches rely on physically crafting high- and low-resolution regions, which require a mechanical setup for tracking moving objects within the fovea. Here, our innovation supports flexible and fast operation modes, acting on amplified photocurrents, allowing the sensor to operate in both high-resolution and low-resolution settings, and to configure multiple high-resolution regions of interest (ROIs) with arbitrary shapes and sizes within the pixel array in real-time. Although the pixel circuitry is more complex than its un-foveated predecessor, we have kept the same pixel area, sacrificing slightly fixed pattern noise (FPN). The sensor achieves a latency of 3.66μs and demonstrates a contrast sensitivity down to 1.03%. It maintains a dynamic range exceeding 120 dB and an intra-scene dynamic range above 60 dB. Notably, the power consumption is reduced with respect to its predecessor, down to 0.7 mW at 100 Keps when configured in low-resolution mode with a 2× 2 pixel grouping. The ability to dynamically adjust spatial resolution reduces noise event rates, enhances sensitivity, and lowers both data bandwidth and processing requirements. These features make the EF-DVS a suitable candidate for applications in robotics, surveillance, and real-time monitoring systems where efficient data processing and low latency are critical., This work was supported in part by EU CHIST-ERA Grants APROVIS3D under Project PCI2019-111826-2; in part by EU HE NIMBLEAI under Grant 101070679; in part by the Andalusian Regional Grant BIOVEO under Project PROYEXCEL_00060; in part by Spanish Grants from the Ministry of Science, Innovation and Universities MULTI-SENS under Grant PDC2023-145841-C31; and in part by the NANOMIND through European Regional Development Fund under Grant PID2019-105556GB-C31. The work of Farnaz Faramarzi was supported by the FPI Scholarship from the Spanish Ministry of Science, Innovation, and Universities., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Neuromorphic Computing and Applications: A Topical Review

  • Enuganti, Pavan Kumar
  • Sen-Bhattacharya, Basabdatta
  • Serrano-Gotarredona, Teresa
  • Rhodes, Oliver
Neuromorphic computers achieve energy efficiency by emulating brain structure and event-driven processing that reduces energy consumption significantly. An increasing interest in this technology started in the initial years of this millennium, sparked by the awareness and concern on the ever-increasing power demands of modern-day computing. In current times, there are several neuromorphic computers and sensors that continue to be developed in both industry and academic research. The focus of this survey is on the neuromorphic computing applications of these devices that include brain-inspired neural networks, brain-inspired artificial neural networks, and Hybrid circuits comprising both artificial and brain-inspired units of computation. Many of these applications use neuromorphic sensors as input devices. We have surveyed three specific neuromorphic computers viz. SpiNNaker, TrueNorth, Loihi, and one neuromorphic sensor viz. Dynamic vision sensor (DVS)-based electronic retina; the demonstration of neuromorphic computing and applications using these devices far outnumbers those on the others that are currently available, which forms the basis of our choice. The applications include low-power cognitive machine intelligence as well as neuropathological understanding and knowledge discovery. Overall, our survey identifies the potential for neuromorphic computing to provide low power, low cost, and dynamic solutions for societal and scientific problems in the not-too-distant future., EPK was supported by the BITS Pilani Goa Campus Institute Fellowship awarded towards his Doctoral Research. Part of this research was supported by the Science and Engineering Research Board (SERB) Core Research Grant CRG/2019/003534 to BSB. TSG was funded by Spanish National Projects MEMVIS (PDC2023-145841-C31 / AEI / 10.13039/501100011033 and the EU PRTR funds-NextGenerationEU) and EUPHORIC (PID2023-149071NB-C51 funded by MCIU/ AEI / 10.13039/501100011033/FEDER,UE). OR was supported in part through the NimbleAI project, which has received funding from the EU's Horizon Europe Research and Innovation programme (Grant Agreement 101070679), and by UK Research and Innovation (UKRI) under the UK government's Horizon Europe funding guarantee (Grant Agreement 10039070). The research is also supported by the EPSRC UK through the Edgy Organism research project (Grant agreement EP/Y030133/1)., Peer reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Contribución de congreso (ConferenceOutput)

NimbleAI: towards neuromorphic sensing-processing 3D-integrated chips

  • Iturbe Lili, Xabier
  • Abderrahmane, Nassim
  • Abella Ferrer, Jaume|||0000-0001-7951-4028
  • Alcaide Portet, Sergi|||0000-0001-8561-7795
  • Beyne, Eric
  • Charles, Henri Pierre
  • Charpin Nicolle, Christelle
  • Chittka, Lars
  • Dávila Guzmán, Maria Angélica
  • Erdmann, Arne
The NimbleAI Horizon Europe project leverages key principles of energy-efficient visual sensing and processing in biological eyes and brains, and harnesses the latest advances in 33D stacked silicon integration, to create an integral sensing-processing neuromorphic architecture that efficiently and accurately runs computer vision algorithms in area-constrained endpoint chips. The rationale behind the NimbleAI architecture is: sense data only with high information value and discard data as soon as they are found not to be useful for the application (in a given context). The NimbleAI sensing-processing architecture is to be specialized after-deployment by tunning system-level trade-offs for each particular computer vision algorithm and deployment environment. The objectives of NimbleAI are: (1) 100x performance per mW gains compared to state-of-the-practice solutions (i.e., CPU/GPUs processing frame-based video); (2) 50x processing latency reduction compared to CPU/GPUs; (3) energy consumption in the order of tens of mWs; and (4) silicon area of approx. 50 mm 2 ., NimbleAI has received funding from the EU’s Horizon Europe Research and Innovation programme (Grant Agreement 101070679), and by the UK Research and Innovation (UKRI) under the UK government’s Horizon Europe funding guarantee (Grant Agreement 10039070), Peer Reviewed, Article signat per 49 autors/es: Xabier Iturbe, IKERLAN, Basque Country (Spain); Nassim Abderrahmane, MENTA, France; Jaume Abella, Barcelona Supercomputing Center (BSC), Catalonia, Spain; Sergi Alcaide, Barcelona Supercomputing Center (BSC), Catalonia, Spain; Eric Beyne, IMEC, Belgium; Henri-Pierre Charles, CEA-LIST, University Grenoble Alpes, France; Christelle Charpin-Nicolle, CEALETI, Univ. Grenoble Alpes, France; Lars Chittka, Queen Mary University of London, UK; Angélica Dávila, IKERLAN, Basque Country (Spain); Arne Erdmann, Raytrix, Germany; Carles Estrada, IKERLAN, Basque Country (Spain); Ander Fernández, IKERLAN, Basque Country (Spain); Anna Fontanelli, Monozukuri (MZ Technologies), Italy; José Flich, Universitat Politecnica de Valencia, Spain; Gianluca Furano, ESA ESTEC, Netherlands; Alejandro Hernán Gloriani, Viewpointsystem, Austria; Erik Isusquiza, ULMA Medical Technologies, Basque Country (Spain); Radu Grosu, TU Wien, Austria; Carles Hernández, Universitat Politecnica de Valencia, Spain; Daniele Ielmini, Politecnico Milano, Italy; David Jackson, University of Manchester, UK; Maha Kooli, CEA-LIST, University Grenoble Alpes, France; Nicola Lepri, Politecnico Milano, Italy; Bernabé Linares-Barranco, CSIC, Spain; Jean-Loup Lachese, MENTA, France; Eric Laurent, MENTA, France; Menno Lindwer, GrAI Matter Labs (GML), Netherlands; Frank Linsenmaier, Viewpointsystem, Austria; Mikel Luján, University of Manchester, UK; Karel Masařík, CODASIP, Czech Republic; Nele Mentens, Universiteit Leiden, Netherlands; Orlando Moreira, GrAI Matter Labs (GML), Netherlands; Chinmay Nawghane, IMEC, Belgium; Luca Peres, University of Manchester, UK; Jean-Philippe Noel, CEA-LIST, University Grenoble Alpes, France; Arash Pourtaherian, GrAI Matter Labs (GML), Netherlands; Christoph Posch, PROPHESEE, France; Peter Priller, AVL List, Austria; Zdenek Prikryl, CODASIP, Czech Republic; Felix Resch, TU Wien, Austria; Oliver Rhodes, University of Manchester, UK; Todor Stefanov, Universiteit Leiden, Netherlands; Moritz Storring, IMEC, Belgium; Michele Taliercio, Monozukuri (MZ Technologies), Italy; Rafael Tornero, Universitat Politecnica de Valencia, Spain; Marcel van de Burgwal, IMEC, Belgium; Geert van der Plas, IMEC, Belgium; Elisa Vianello, CEALETI, Univ. Grenoble Alpes, France; Pavel Zaykov, CODASIP, Czech Republic
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

NimbleAI: towards neuromorphic sensing-processing 3D-integrated chips

  • Iturbe Lili, Xabier
  • Abderrahmane, Nassim
  • Abella Ferrer, Jaume
  • Alcaide Portet, Sergi
  • Beyne, Eric
  • Charles, Henri Pierre
  • Charpin Nicolle, Christelle
  • Chittka, Lars
  • Dávila Guzmán, Maria Angélica
  • Erdmann, Arne
The NimbleAI Horizon Europe project leverages key principles of energy-efficient visual sensing and processing in biological eyes and brains, and harnesses the latest advances in 33D stacked silicon integration, to create an integral sensing-processing neuromorphic architecture that efficiently and accurately runs computer vision algorithms in area-constrained endpoint chips. The rationale behind the NimbleAI architecture is: sense data only with high information value and discard data as soon as they are found not to be useful for the application (in a given context). The NimbleAI sensing-processing architecture is to be specialized after-deployment by tunning system-level trade-offs for each particular computer vision algorithm and deployment environment. The objectives of NimbleAI are: (1) 100x performance per mW gains compared to state-of-the-practice solutions (i.e., CPU/GPUs processing frame-based video); (2) 50x processing latency reduction compared to CPU/GPUs; (3) energy consumption in the order of tens of mWs; and (4) silicon area of approx. 50 mm 2 ., NimbleAI has received funding from the EU’s Horizon Europe Research and Innovation programme (Grant Agreement 101070679), and by the UK Research and Innovation (UKRI) under the UK government’s Horizon Europe funding guarantee (Grant Agreement 10039070), Peer Reviewed, Article signat per 49 autors/es: Xabier Iturbe, IKERLAN, Basque Country (Spain); Nassim Abderrahmane, MENTA, France; Jaume Abella, Barcelona Supercomputing Center (BSC), Catalonia, Spain; Sergi Alcaide, Barcelona Supercomputing Center (BSC), Catalonia, Spain; Eric Beyne, IMEC, Belgium; Henri-Pierre Charles, CEA-LIST, University Grenoble Alpes, France; Christelle Charpin-Nicolle, CEALETI, Univ. Grenoble Alpes, France; Lars Chittka, Queen Mary University of London, UK; Angélica Dávila, IKERLAN, Basque Country (Spain); Arne Erdmann, Raytrix, Germany; Carles Estrada, IKERLAN, Basque Country (Spain); Ander Fernández, IKERLAN, Basque Country (Spain); Anna Fontanelli, Monozukuri (MZ Technologies), Italy; José Flich, Universitat Politecnica de Valencia, Spain; Gianluca Furano, ESA ESTEC, Netherlands; Alejandro Hernán Gloriani, Viewpointsystem, Austria; Erik Isusquiza, ULMA Medical Technologies, Basque Country (Spain); Radu Grosu, TU Wien, Austria; Carles Hernández, Universitat Politecnica de Valencia, Spain; Daniele Ielmini, Politecnico Milano, Italy; David Jackson, University of Manchester, UK; Maha Kooli, CEA-LIST, University Grenoble Alpes, France; Nicola Lepri, Politecnico Milano, Italy; Bernabé Linares-Barranco, CSIC, Spain; Jean-Loup Lachese, MENTA, France; Eric Laurent, MENTA, France; Menno Lindwer, GrAI Matter Labs (GML), Netherlands; Frank Linsenmaier, Viewpointsystem, Austria; Mikel Luján, University of Manchester, UK; Karel Masařík, CODASIP, Czech Republic; Nele Mentens, Universiteit Leiden, Netherlands; Orlando Moreira, GrAI Matter Labs (GML), Netherlands; Chinmay Nawghane, IMEC, Belgium; Luca Peres, University of Manchester, UK; Jean-Philippe Noel, CEA-LIST, University Grenoble Alpes, France; Arash Pourtaherian, GrAI Matter Labs (GML), Netherlands; Christoph Posch, PROPHESEE, France; Peter Priller, AVL List, Austria; Zdenek Prikryl, CODASIP, Czech Republic; Felix Resch, TU Wien, Austria; Oliver Rhodes, University of Manchester, UK; Todor Stefanov, Universiteit Leiden, Netherlands; Moritz Storring, IMEC, Belgium; Michele Taliercio, Monozukuri (MZ Technologies), Italy; Rafael Tornero, Universitat Politecnica de Valencia, Spain; Marcel van de Burgwal, IMEC, Belgium; Geert van der Plas, IMEC, Belgium; Elisa Vianello, CEALETI, Univ. Grenoble Alpes, France; Pavel Zaykov, CODASIP, Czech Republic, Postprint (author's final draft)