Pasar al contenido principal

INTELIGENCIA EMBEBIDA EN SENSORES Y SISTEMAS DE VISION DE BAJO CONSUMO Y OPERACION DE LARGO TERMINO

PID2021-128009OB-C31

•
Nombre agencia financiadora Agencia Estatal de Investigación
Acrónimo agencia financiadora AEI
Programa Programa Estatal para Impulsar la Investigación Científico-Técnica y su Transferencia
Subprograma Subprograma Estatal de Generación de Conocimiento
Convocatoria Proyectos de I+D+i (Generación de Conocimiento y Retos Investigación)
Año convocatoria 2021
Plan Estatal 2021-2023 Plan Estatal de Investigación Científica y Técnica y de Innovación
Centro beneficiario AGENCIA ESTATAL CONSEJO SUPERIOR DE INVESTIGACIONES CIENTIFICAS (CSIC)

Resultados relacionados

Resultados totales (Incluyendo duplicados): 3
Encontrada(s) 1 página(s)

DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Reliable and efficient integration of AI into camera traps for smart wildlife monitoring based on continual learning

  • Velasco-Montero, Delia
  • Fernández-Berni, J.
  • Carmona-Galán, R.
  • Sanglas, Ariadna
  • Palomares, Francisco
In this paper, we comprehensively report on an efficient approach for the integration of artificial intelligence (AI) processing pipelines in camera traps for smart on-site wildlife monitoring. Our work covers hardware, software, and algorithmics. We have built two prototypes of smart camera trap on a maximum bill of materials of 100$. We have also built two datasets, made publicly available, comprising over 17 k images, many of them notably challenging even for humans. Leveraging our broad expertise on embedded systems, specialized software libraries and toolchains, and AI techniques such as transfer learning, explainable AI, and, most importantly, continual learning, we achieve more reliable inference on-site - specifically 10 % higher F1-score - than MegaDetector run off-site on a desktop computer. The paper includes many practical details on system realization and on-site training in addition to a vast set of lab and experimental results., This work was supported by project SEMIoTICS (PID2021-128009OB-C31), funded by MCIN/AEI/10.13039/501100011033 and EU “ERDF: A way of making Europe”; by project ULTIMATE (TED2021-131835B-I00), funded by MCIN/AEI/10.13039/501100011033 and by the European Union NextGenerationEU/PRTR; by project SUMHAL (LIFEWATCH-2019-09-CSIC-4, POPE 2014-2020), funded by Ministry of Science and Innovation of Spain through European Regional Development Fund; by the Ministry for Digital Transformation and Public Function through grant USECHIP (TSI-069100-2023-001) of PERTE Chip Chair Program, funded by European Union – Next Generation EU; and by project SIMMRE, “Plan Complementario de I+D+i en el área de Biodiversidad (PCBIO)” funded by the European Union within the framework of the Recovery, Transformation and Resilience Plan - NextGenerationEU, by the Spanish Ministry of Science, Innovation and Universities and by the Regional Government of Andalucia., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Single-Shot Auto-Exposure and High Dynamic Range Imaging Based on Asynchronous Operation of Pixel Array Circuitry

  • Lamouaraa-Sedlackova, Yassine
  • Fernández-Berni, J.
  • Carmona-Galán, R.
This paper introduces an image formation technique that realizes automatic adaptation to the illumination conditions during image capture. This adaptation takes place asynchronously in a single shot, requiring neither external control nor iterations on the exposure setting. These characteristics are especially suitable for applications such as visual robot navigation, where illumination may abruptly change and immediate decisions must be made. The equations that model the proposed technique show exposure-time independence. Moreover, each pixel adapts itself according to the ratio between local and global illuminations. The dependence on this ratio—which is a relative rather than absolute magnitude—along with the aforementioned independence on exposure time means that, theoretically, any illumination scenario can be represented within an arbitrary signal range. We also address the CMOS implementation of this technique. An extensive set of electrical simulations confirms its auto-exposure and high-dynamic-range encoding capabilities. In particular, we simulated the capture of a 118-dB scene on a (Formula presented.) -px array over five orders of magnitude of ambient illumination. Corner and mismatch simulations reveal strong robustness of the proposed circuitry against fabrication non-idealities. Finally, although we aim to applications in which large image resolution is not a critical specification, strategies to minimize the impact of the required focal-plane circuit elements on the pixel pitch are examined., This work has been supported by Project SEMIoTICS (PID2021-128009OB-C31), funded by MCIN/AEI/10.13039/501100011033 and EU “ERDF: A way of making Europe,” and by Project ULTIMATE (TED2021-131835B-I00), funded by MCIN/AEI/10.13039/501100011033 and by the European Union NextGenerationEU/PRTR., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Compressive Image Encoder Architecture for In-Sensor Feature-Space Sampling

  • Khan, Amir
  • Fernández-Berni, J.
  • Carmona-Galán, R.
An architecture for the on-chip implementation of a compressive image encoder is presented. It is 100% compatible with standard CMOS image sensor architectures. It does not interfere with normal CMOS image sensor operation. No significant image degradation is expected. A stream of compressed vectors containing feature-space samples is provided in parallel with the full raw image data. The major technical challenges posed by the additional in-sensor circuitry are: introducing negligible disturbances on image capture and maintaining image resolution and quality. Concerning the compressive sampling measurement strategy, it is generated on-chip, without requiring storage or communication of the measurement matrix. A new pseudo-diagonal random ternary measurement matrix is proposed that generates compressed vectors that require only 6-bit ADC resolution to render accurate classification results. In addition, the proposed architecture is flexible to implement other measurement strategies. The proposed encoder architecture is implemented in a 110nm CMOS image sensor technology., Spanish Ministry of Science, Innovation and Universities (MCIN/AEI /10.13039/501100011033) through the SEMIoTICs Project under Grant PID2021-128009OB-C31; in part by the EU “European Regional Development Fund (ERDF): A way of making Europe” funded by MCIN/AEI/10s.13039/501100011033 under Grant PRE2019-088478; in part by the EU “European Social Fund (ESF): Investing in your future” and the Deutsche Forschungsgemeinschaft (DFG, German Research Foundation)— Project Mem2CNN under Project 441957207; in part by the DFG Priority Program SPP 2262 MemrisTec under Project 422738993; and in part by the Secretary of State for Telecommunications and Digital Infrastructure, Ministry for Digital Transformation and Civil Service and by European Union–NextGenerationEU/PRTR through the Chair in Microelectronics of the University of Seville (USECHIP) Project under Grant TSI-069100-2023-001., Peer reviewed