Pasar al contenido principal

CONSTRUCCION DE SISTEMAS ESPECTRO-SELECTIVOS OPTIMIZADOS: GENERACION DE SISTEMAS DE VISION MULTIESPECTRALES OPTIMIZADOS MEDIANTE APRENDIZAJE COMPUTACIONAL

TIN2017-89723-P

•
Nombre agencia financiadora Agencia Estatal de Investigación
Acrónimo agencia financiadora AEI
Programa Programa Estatal de Fomento de la Investigación Científica y Técnica de Excelencia
Subprograma Subprograma Estatal de Generación de Conocimiento
Convocatoria Proyectos de I+D (Excelencia / Generación de Conocimiento)
Año convocatoria 2017
Plan Estatal 2017-2020 Plan Estatal de Investigación Científica y Técnica y de Innovación
Centro beneficiario CENTRO DE VISION POR COMPUTADOR

Resultados relacionados

Resultados totales (Incluyendo duplicados): 5
Encontrada(s) 1 página(s)

DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Contribución de congreso (ConferenceOutput)

2D-to-3D facial expression transfer

  • Rotger, Gemma
  • Lumbreras, Felipe
  • Moreno-Noguer, Francesc
  • Agudo Martínez, Antonio
Trabajo presentado en la 24th International Conference on Pattern Recognition (ICPR), celebrada en Beijing (China), del 20 al 24 de agosto de 2018, Automatically changing the expression and physical features of a face from an input image is a topic that has been traditionally tackled in a 2D domain. In this paper, we bring this problem to 3D and propose a framework that given an input RGB video of a human face under a neutral expression, initially computes his/her 3D shape and then performs a transfer to a new and potentially non-observed expression. For this purpose, we parameterize the rest shape -obtained from standard factorization approaches over the input video- using a triangular mesh which is further clustered into larger macro-segments. The expression transfer problem is then posed as a direct mapping between this shape and a source shape, such as the blend shapes of an off-the-shelf 3D dataset of human facial expressions. The mapping is resolved to be geometrically consistent between 3D models by requiring points in specific regions to map on semantic equivalent regions. We validate the approach on several synthetic and real examples of input faces that largely differ from the source shapes, yielding very realistic expression transfers even in cases with topology changes, such as a synthetic video sequence of a single-eyed cyclops., This work is supported in part by the Spanish Ministry of Science and Innovation under projects FireDMMI TIN2014-56919-C3-2-R, BOSSS TIN2017-89723- P, HuMoUR TIN2017-90086-R, and María de Maeztu Seal of Excellence MDM-2016-0656, Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Artículo científico (JournalArticle)

Detailed 3D face reconstruction from a single RGB image

  • Rotger, Gemma
  • Moreno-Noguer, Francesc
  • Lumbreras, Felipe
  • Agudo Martínez, Antonio
This paper introduces a method to obtain a detailed 3D reconstruction of facial skin from a single RGB image. To this end, we propose the exclusive use of an input image without requiring any information about the observed material nor training data to model the wrinkle properties. They are detected and characterized directly from the image via a simple and effective parametric model, determining several features such as location, orientation, width, and height. With these ingredients, we propose to minimize a photometric error to retrieve the final detailed 3D map, which is initialized by current techniques based on deep learning. In contrast with other approaches, we only require estimating a depth parameter, making our approach fast and intuitive. Extensive experimental evaluation is presented in a wide variety of synthetic and real images, including different skin properties and facial expressions. In all cases, our method outperforms the current approaches regarding 3D reconstruction accuracy, providing striking results for both large and fine wrinkles., This work has been partially supported by the Spanish Ministry of Science and Innovation under projects FireDMMI TIN2014-56919-C3-2- R, BOSSS TIN2017-89723-P, and HuMoUR TIN2017- 90086-R; by the CSIC project R3OBJ 201850I099, and by the Spanish State Research Agency through the María de Maeztu Seal of Excellence to IRI MDM2016-0656.
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publicación Contribución de congreso (ConferenceOutput)

Single view facial hair 3D reconstruction

  • Rotger, Gemma
  • Moreno-Noguer, Francesc
  • Lumbreras, Felipe
  • Agudo Martínez, Antonio
Trabajo presentado en el Iberian Conference on Pattern Recognition and Image Analysis, celebrado en Madrid (España), del 1 al 4 de julio de 2019, In this work, we introduce a novel energy-based framework that addresses the challenging problem of 3D reconstruction of facial hair from a single RGB image. To this end, we identify hair pixels over the image via texture analysis and then determine individual hair fibers that are modeled by means of a parametric hair model based on 3D helixes. We propose to minimize an energy composed of several terms, in order to adapt the hair parameters that better fit the image detections. The final hairs respond to the resulting fibers after a post-processing step where we encourage further realism. The resulting approach generates realistic facial hair fibers from solely an RGB image without assuming any training data nor user interaction. We provide an experimental evaluation on real-world pictures where several facial hair styles and image conditions are observed, showing consistent results and establishing a comparison with respect to competing approaches., This work has been partially supported by the Spanish Ministry of Science and Innovation under projects FireDMMI TIN2014-56919-C3-2-R, BOSSS TIN2017-89723-P, and HuMoUR TIN2017-90086-R; by the Spanish State Research Agency through the Mar´ıa de Maeztu Seal of Excellence to IRI MDM-2016-0656, and by the CSIC project R3OBJ 201850I099
Dipòsit Digital de Documents de la UAB
Publicación Artículo científico (JournalArticle)

Melamine Faced Panels Defect Classification beyond the Visible Spectrum

  • Aguilera, Cristhian A.|||0000-0003-2504-9305
  • Sappa, Angel|||0000-0003-2468-0031
In this work, we explore the use of images from different spectral bands to classify defects in melamine faced panels, which could appear through the production process. Through experimental evaluation, we evaluate the use of images from the visible (VS), near-infrared (NIR), and long wavelength infrared (LWIR), to classify the defects using a feature descriptor learning approach together with a support vector machine classifier. Two descriptors were evaluated, Extended Local Binary Patterns (E-LBP) and SURF using a Bag of Words (BoW) representation. The evaluation was carried on with an image set obtained during this work, which contained five different defect categories that currently occurs in the industry. Results show that using images from beyond the visual spectrum helps to improve classification performance in contrast with a single visible spectrum solution.
Investigo. Repositorio Institucional de la Universidade de Vigo
Publicación Artículo científico (JournalArticle)

Hybrid MSRM-based deep learning and multitemporal sentinel 2-based machine learning algorithm detects near 10k archaeological tumuli in North-Western Iberia

  • Berganzo Besga, Iban
  • Orengo, Hector A.
  • Lumbreras, Felipe
  • Carrero Pazos, Miguel
  • Fonte, João
  • Vilas Estévez, Benito
This paper presents an algorithm for large-scale automatic detection of burial mounds, one of the most common types of archaeological sites globally, using LiDAR and multispectral satellite data. Although previous attempts were able to detect a good proportion of the known mounds in a given area, they still presented high numbers of false positives and low precision values. Our proposed approach combines random forest for soil classification using multitemporal multispectral Sentinel-2 data and a deep learning model using YOLOv3 on LiDAR data previously pre-processed using a multi–scale relief model. The resulting algorithm significantly improves previous attempts with a detection rate of 89.5%, an average precision of 66.75%, a recall value of 0.64 and a precision of 0.97, which allowed, with a small set of training data, the detection of 10,527 burial mounds over an area of near 30,000 km2, the largest in which such an approach has ever been applied. The open code and platforms employed to develop the algorithm allow this method to be applied anywhere LiDAR data or high-resolution digital terrain models are available., Ministerio de Ciencia e Innovación, España | Ref. RYC-2016-19637, Ministerio de Ciencia e Innovación, España | Ref. BOSSS TIN2017-89723-P, European Commission | Ref. H2020, n. 886793, European Commission | Ref. H2020, n. 794048, Fundación BBVA | Ref. Ayuda a Equipos de Investigación Científica