Skip to main content

Resultados relacionados

Resultados totales (Incluyendo duplicados): 13
Encontrada(s) 1 página(s)

TECNALIA Publications
Publication Artículo científico (JournalArticle)

Unravelling the effect of data augmentation transformations in polyp segmentation

  • Sánchez-Peralta, Luisa F.
  • Picón, Artzai
  • Sánchez-Margallo, Francisco M.
  • Pagador, J. Blas
Purpose: Data augmentation is a common technique to overcome the lack of large annotated databases, a usual situation when applying deep learning to medical imaging problems. Nevertheless, there is no consensus on which transformations to apply for a particular field. This work aims at identifying the effect of different transformations on polyp segmentation using deep learning. Methods: A set of transformations and ranges have been selected, considering image-based (width and height shift, rotation, shear, zooming, horizontal and vertical flip and elastic deformation), pixel-based (changes in brightness and contrast) and application-based (specular lights and blurry frames) transformations. A model has been trained under the same conditions without data augmentation transformations (baseline) and for each of the transformation and ranges, using CVC-EndoSceneStill and Kvasir-SEG, independently. Statistical analysis is performed to compare the baseline performance against results of each range of each transformation on the same test set for each dataset. Results: This basic method identifies the most adequate transformations for each dataset. For CVC-EndoSceneStill, changes in brightness and contrast significantly improve the model performance. On the contrary, Kvasir-SEG benefits to a greater extent from the image-based transformations, especially rotation and shear. Augmentation with synthetic specular lights also improves the performance. Conclusion: Despite being infrequently used, pixel-based transformations show a great potential to improve polyp segmentation in CVC-EndoSceneStill. On the other hand, image-based transformations are more suitable for Kvasir-SEG. Problem-based transformations behave similarly in both datasets. Polyp area, brightness and contrast of the dataset have an influence on these differences.
TECNALIA Publications
Publication Artículo científico (JournalArticle)

Medical needs related to the endoscopic technology and colonoscopy for colorectal cancer diagnosis

  • Ortega-Morán, Juan Francisco
  • Azpeitia, Águeda
  • Sánchez-Peralta, Luisa F.
  • Bote-Curiel, Luis
  • Pagador, Blas
  • Cabezón, Virginia
  • Saratxaga, Cristina L.
  • Sánchez-Margallo, Francisco M.
Background. The high incidence and mortality rate of colorectal cancer require new technologies to improve its early diagnosis. This study aims at extracting the medical needs related to the endoscopic technology and the colonoscopy procedure currently used for colorectal cancer diagnosis, essential for designing these demanded technologies. Methods. Semi-structured interviews and an online survey were used. Results. Six endoscopists were interviewed and 103 were surveyed, obtaining the demanded needs that can be divided into: a) clinical needs, for better polyp detection and classification (especially flat polyps), location, size, margins and penetration depth; b) computer-aided diagnosis (CAD) system needs, for additional visual information supporting polyp characterization and diagnosis; and c) operational/physical needs, related to limitations of image quality, colon lighting, flexibility of the endoscope tip, and even poor bowel preparation.
TECNALIA Publications
Publication Artículo científico (JournalArticle)

Deep learning to find colorectal polyps in colonoscopy: A systematic literature review: A systematic literature review

  • Sánchez-Peralta, Luisa F.
  • Bote-Curiel, Luis
  • Picón, Artzai
  • Sánchez-Margallo, Francisco M.
  • Pagador, J. Blas
Colorectal cancer has a great incidence rate worldwide, but its early detection significantly increases the survival rate. Colonoscopy is the gold standard procedure for diagnosis and removal of colorectal lesions with potential to evolve into cancer and computer-aided detection systems can help gastroenterologists to increase the adenoma detection rate, one of the main indicators for colonoscopy quality and predictor for colorectal cancer prevention. The recent success of deep learning approaches in computer vision has also reached this field and has boosted the number of proposed methods for polyp detection, localization and segmentation. Through a systematic search, 35 works have been retrieved. The current systematic review provides an analysis of these methods, stating advantages and disadvantages for the different categories used; comments seven publicly available datasets of colonoscopy images; analyses the metrics used for reporting and identifies future challenges and recommendations. Convolutional neural networks are the most used architecture together with an important presence of data augmentation strategies, mainly based on image transformations and the use of patches. End-to-end methods are preferred over hybrid methods, with a rising tendency. As for detection and localization tasks, the most used metric for reporting is the recall, while Intersection over Union is highly used in segmentation. One of the major concerns is the difficulty for a fair comparison and reproducibility of methods. Even despite the organization of challenges, there is still a need for a common validation framework based on a large, annotated and publicly available database, which also includes the most convenient metrics to report results. Finally, it is also important to highlight that efforts should be focused in the future on proving the clinical value of the deep learning based methods, by increasing the adenoma detection rate.
TECNALIA Publications
Publication Artículo científico (JournalArticle)

Constellation loss: Improving the efficiency of deep metric learning loss functions for the optimal embedding of histopathological images

  • Picon, Artzai
  • Medela, Alfonso
Deep learning diagnostic algorithms are proving comparable results with human experts in a wide variety of tasks, and they still require a huge amount of well-annotated data for training, which is often non affordable. Metric learning techniques have allowed a reduction in the required annotated data allowing few-shot learning over deep learning architectures. Aims and Objectives: In this work, we analyze the state-of-the-art loss functions such as triplet loss, contrastive loss, and multi-class N-pair loss for the visual embedding extraction of hematoxylin and eosin (H&E) microscopy images and we propose a novel constellation loss function that takes advantage of the visual distances of the embeddings of the negative samples and thus, performing a regularization that increases the quality of the extracted embeddings. Materials and Methods: To this end, we employed the public H&E imaging dataset from the University Medical Center Mannheim (Germany) that contains tissue samples from low-grade and high-grade primary tumors of digitalized colorectal cancer tissue slides. These samples are divided into eight different textures (1. tumour epithelium, 2. simple stroma, 3. complex stroma, 4. immune cells, 5. debris and mucus, 6. mucosal glands, 7. adipose tissue and 8. background,). The dataset was divided randomly into train and test splits and the training split was used to train a classifier to distinguish among the different textures with just 20 training images. The process was repeated 10 times for each loss function. Performance was compared both for cluster compactness and for classification accuracy on separating the aforementioned textures. Results: Our results show that the proposed loss function outperforms the other methods by obtaining more compact clusters (Davis-Boulding: 1.41 ± 0.08, Silhouette: 0.37 ± 0.02) and better classification capabilities (accuracy: 85.0 ± 0.6) over H and E microscopy images. We demonstrate that the proposed constellation loss can be successfully used in the medical domain in situations of data scarcity.
TECNALIA Publications
Publication Contribución de congreso (ConferenceOutput)

Few Shot Learning in Histopathological Images:Reducing the Need of Labeled Data on Biological Datasets: Reducing the need of labeled data on biological datasets

  • Medela, Alfonso
  • Picon, Artzai
  • Saratxaga, Cristina L.
  • Belar, Oihana
  • Cabezon, Virginia
  • Cicchi, Riccardo
  • Bilbao, Roberto
  • Glover, Ben
Although deep learning pathology diagnostic algorithms are proving comparable results with human experts in a wide variety of tasks, they still require a huge amount of well annotated data for training. Generating such extensive and well labelled datasets is time consuming and is not feasible for certain tasks and so, most of the medical datasets available are scarce in images and therefore, not enough for training. In this work we validate that the use of few shot learning techniques can transfer knowledge from a well defined source domain from Colon tissue into a more generic domain composed by Colon, Lung and Breast tissue by using very few training images. Our results show that our few-shot approach is able to obtain a balanced accuracy (BAC) of 90% with just 60 training images, even for the Lung and Breast tissues that were not present on the training set. This outperforms the finetune transfer learning approach that obtains 73% BAC with 60 images and requires 600 images to get up to 81% BAC.
TECNALIA Publications
Publication Artículo científico (JournalArticle)

PICCOLO White-Light and Narrow-Band Imaging Colonoscopic Dataset: A Performance Comparative of Models and Datasets: A performance comparative of models and datasets

  • Sánchez-Peralta, Luisa F.
  • Pagador, J. Blas
  • Picón, Artzai
  • Calderón, Ángel José
  • Polo, Francisco
  • Andraka, Nagore
  • Bilbao, Roberto
  • Glover, Ben
  • Saratxaga, Cristina L.
  • Sánchez-Margallo, Francisco M.
Colorectal cancer is one of the world leading death causes. Fortunately, an early diagnosis allows for effective treatment, increasing the survival rate. Deep learning techniques have shown their utility for increasing the adenoma detection rate at colonoscopy, but a dataset is usually required so the model can automatically learn features that characterize the polyps. In this work, we present the PICCOLO dataset, that comprises 3433 manually annotated images (2131 white-light images 1302 narrow-band images), originated from 76 lesions from 40 patients, which are distributed into training (2203), validation (897) and test (333) sets assuring patient independence between sets. Furthermore, clinical metadata are also provided for each lesion. Four different models, obtained by combining two backbones and two encoder–decoder architectures, are trained with the PICCOLO dataset and other two publicly available datasets for comparison. Results are provided for the test set of each dataset. Models trained with the PICCOLO dataset have a better generalization capacity, as they perform more uniformly along test sets of all datasets, rather than obtaining the best results for its own test set. This dataset is available at the website of the Basque Biobank, so it is expected that it will contribute to the further development of deep learning methods for polyp detection, localisation and classification, which would eventually result in a better and earlier diagnosis of colorectal cancer, hence improving patient outcomes.
TECNALIA Publications
Publication Artículo científico (JournalArticle)

Novel Pixelwise Co-Registered Hematoxylin-Eosin and Multiphoton Microscopy Image Dataset for Human Colon Lesion Diagnosis

  • Picon, Artzai
  • Terradillos, Elena
  • Sánchez-Peralta, Luisa F.
  • Mattana, Sara
  • Cicchi, Riccardo
  • Blover, Benjamin J.
  • Arbide, Nagore
  • Velasco, Jacques
  • Etzezarraga, Mª Carmen
  • Pavone, Francesco S.
  • Garrote, Estibaliz
  • Saratxaga, Cristina L.
Colorectal cancer presents one of the most elevated incidences of cancer worldwide. Colonoscopy relies on histopathology analysis of hematoxylin-eosin (H&E) images of the removed tissue. Novel techniques such as multi-photon microscopy (MPM) show promising results for performing real-time optical biopsies. However, clinicians are not used to this imaging modality and correlation between MPM and H&E information is not clear. The objective of this paper is to describe and make publicly available an extensive dataset of fully co-registered H&E and MPM images that allows the research community to analyze the relationship between MPM and H&E histopathological images and the effect of the semantic gap that prevents clinicians from correctly diagnosing MPM images. The dataset provides a fully scanned tissue images at 10x optical resolution (0.5 µm/px) from 50 samples of lesions obtained by colonoscopies and colectomies. Diagnostics capabilities of TPF and H&E images were compared. Additionally, TPF tiles were virtually stained into H&E images by means of a deep-learning model. A panel of 5 expert pathologists evaluated the different modalities into three classes (healthy, adenoma/hyperplastic, and adenocarcinoma). Results showed that the performance of the pathologists over MPM images was 65% of the H&E performance while the virtual staining method achieved 90%. MPM imaging can provide appropriate information for diagnosing colorectal cancer without the need for H&E staining. However, the existing semantic gap among modalities needs to be corrected.
TECNALIA Publications
Publication Artículo científico (JournalArticle)

Characterization of Optical Coherence Tomography Images for Colon Lesion Differentiation under Deep Learning

  • Saratxaga, Cristina L.
  • Bote, Jorge
  • Ortega-Morán, Juan F.
  • Picón, Artzai
  • Terradillos, Elena
  • del Río, Nagore Arbide
  • Andraka, Nagore
  • Garrote, Estibaliz
  • Conde, Olga M.
(1) Background: Clinicians demand new tools for early diagnosis and improved detection of colon lesions that are vital for patient prognosis. Optical coherence tomography (OCT) allows microscopical inspection of tissue and might serve as an optical biopsy method that could lead to in-situ diagnosis and treatment decisions; (2) Methods: A database of murine (rat) healthy, hyperplastic and neoplastic colonic samples with more than 94,000 images was acquired. A methodology that includes a data augmentation processing strategy and a deep learning model for automatic classification (benign vs. malignant) of OCT images is presented and validated over this dataset. Comparative evaluation is performed both over individual B-scan images and C-scan volumes; (3) Results: A model was trained and evaluated with the proposed methodology using six different data splits to present statistically significant results. Considering this, 0.9695 (_0.0141) sensitivity and 0.8094 (_0.1524) specificity were obtained when diagnosis was performed over B-scan images. On the other hand, 0.9821 (_0.0197) sensitivity and 0.7865 (_0.205) specificity were achieved when diagnosis was made considering all the images in the whole C-scan volume; (4) Conclusions: The proposed methodology based on deep learning showed great potential for the automatic characterization of colon polyps and future development of the optical biopsy paradigm.
Addi. Archivo Digital para la Docencia y la Investigación
Publication Artículo científico (JournalArticle)

Analysis on the Characterization of Multiphoton Microscopy Images for Malignant Neoplastic Colon Lesion Detection under Deep Learning Methods

  • Terradillos Fernández, Elena
  • López Saratxaga, Cristina
  • Mattana, Sara
  • Cicchi, Riccardo
  • Pavone, Francesco S.
  • Andraka Rueda, Nagore
  • Glover, Benjamin J.
  • Arbide del Río, Nagore
  • Velasco Arteche, Jacques
  • Etxezarraga Zuluaga, María Carmen
  • Picón Ruiz, Artzai
Background: Colorectal cancer has a high incidence rate worldwide, with over 1.8 million new cases and 880,792 deaths in 2018. Fortunately, its early detection significantly increases the survival rate, reaching a cure rate of 90% when diagnosed at a localized stage. Colonoscopy is the gold standard technique for detection and removal of colorectal lesions with potential to evolve into cancer. When polyps are found in a patient, the current procedure is their complete removal. However, in this process, gastroenterologists cannot assure complete resection and clean margins which are given by the histopathology analysis of the removed tissue, which is performed at laboratory. Aims: In this paper, we demonstrate the capabilities of multiphoton microscopy (MPM) technology to provide imaging biomarkers that can be extracted by deep learning techniques to identify malignant neoplastic colon lesions and distinguish them from healthy, hyperplastic, or benign neoplastic tissue, without the need for histopathological staining. Materials and Methods: To this end, we present a novel MPM public dataset containing 14,712 images obtained from 42 patients and grouped into 2 classes. A convolutional neural network is trained on this dataset and a spatially coherent predictions scheme is applied for performance improvement. Results: We obtained a sensitivity of 0.8228 ± 0.1575 and a specificity of 0.9114 ± 0.0814 on detecting malignant neoplastic lesions. We also validated this approach to estimate the self-confidence of the network on its own predictions, obtaining a mean sensitivity of 0.8697 and a mean specificity of 0.9524 with the 18.67% of the images classified as uncertain. Conclusions: This work lays the foundations for performing in vivo optical colon biopsies by combining this novel imaging technology together with deep learning algorithms, hence avoiding unnecessary polyp resection and allowing in situ diagnosis assessment., This work was supported by the PICCOLO project. This project has received funding from the European Union's Horizon2020 Research and Innovation Programme under grant agreement No. 732111. This research has also been supported by the project ONKOTOOLS (KK-2020/00069) funded by the Basque Government Industry Department under the ELKARTEK program
Addi. Archivo Digital para la Docencia y la Investigación
Publication Artículo científico (JournalArticle)

Autofluorescence Image Reconstruction and Virtual Staining for In-Vivo Optical Biopsying

  • Picón Ruiz, Artzai
  • Medela Ayarzaguena, Alfonso
  • Sánchez Peralta, Luisa F.
  • Cicchi, Riccardo
  • Bilbao, Roberto
  • Alfieri, Domenico
  • Elola Artano, Andoni
  • Glover, Ben
  • López Saratxaga, Cristina
Modern photonic technologies are emerging, allowing the acquisition of in-vivo endoscopic tissue imaging at a microscopic scale, with characteristics comparable to traditional histological slides, and with a label-free modality. This raises the possibility of an 'optical biopsy' to aid clinical decision making. This approach faces barriers for being incorporated into clinical practice, including the lack of existing images for training, unfamiliarity of clinicians with the novel image domains and the uncertainty of trusting 'black-box' machine learned image analysis, where the decision making remains inscrutable. In this paper, we propose a new method to transform images from novel photonics techniques (e.g. autofluorescence microscopy) into already established domains such as Hematoxilyn-Eosin (H-E) microscopy through virtual reconstruction and staining. We introduce three main innovations: 1) we propose a transformation method based on a Siamese structure that simultaneously learns the direct and inverse transformation ensuring domain back-transformation quality of the transformed data. 2) We also introduced an embedding loss term that ensures similarity not only at pixel level, but also at the image embedding description level. This drastically reduces the perception distortion trade-off problem existing in common domain transfer based on generative adversarial networks. These virtually stained images can serve as reference standard images for comparison with the already known H-E images. 3) We also incorporate an uncertainty margin concept that allows the network to measure its own confidence, and demonstrate that these reconstructed and virtually stained images can be used on previously-studied classification models of H-E images that have been computationally degraded and de-stained. The three proposed methods can be seamlessly incorporated on any existing architectures. We obtained balanced accuracies of 0.95 and negative predictive values of 1.00 over the reconstructed and virtually stained image-set on the detection of color-rectal tumoral tissue. This is of great importance as we reduce the need for extensive labeled datasets for training, which are normally not available on the early studies of a new imaging technology, This work was supported in part by the European Union's Horizon 2020 Research and Innovation Programme under Grant 732111 (PICCOLO project), and in part by the Basque Government's Industry Department through the ELKARTEK Program's Project 3KIA under Grant KK-2020/00049. The work of Andoni Elola was supported by his pre-doctoral research from the Basque Government under Grant PRE_2019_2_0100 and Grant IT1229-19
Addi. Archivo Digital para la Docencia y la Investigación
Publication Artículo científico (JournalArticle)

Novel Pixelwise Co-Registered Hematoxylin-Eosin and Multiphoton Microscopy Image Dataset for Human Colon Lesion Diagnosis

  • Picón Ruiz, Artzai
  • Terradillos Fernández, Elena
  • Sánchez Peralta, Luisa F.
  • Mattana, Sara
  • Cicchi, Riccardo
  • Blover, Benjamin J.
  • Arbide del Río, Nagore
  • Velasco Arteche, Jacques
  • Etxezarraga Zuluaga, María Carmen
  • Pavone, Francesco S.
  • Garrote Contreras, Estíbaliz
  • López Saratxaga, Cristina
Colorectal cancer presents one of the most elevated incidences of cancer worldwide. Colonoscopy relies on histopathology analysis of hematoxylin-eosin (H&E) images of the removed tissue. Novel techniques such as multi-photon microscopy (MPM) show promising results for performing real-time optical biopsies. However, clinicians are not used to this imaging modality and correlation between MPM and H&E information is not clear. The objective of this paper is to describe and make publicly available an extensive dataset of fully co-registered H&E and MPM images that allows the research community to analyze the relationship between MPM and H&E histopathological images and the effect of the semantic gap that prevents clinicians from correctly diagnosing MPM images. The dataset provides a fully scanned tissue images at 10x optical resolution (0.5 m/px) from 50 samples of lesions obtained by colonoscopies and colectomies. Diagnostics capabilities of TPF and H&E images were compared. Additionally, TPF tiles were virtually stained into H&E images by means of a deep-learning model. A panel of 5 expert pathologists evaluated the different modalities into three classes (healthy, adenoma/hyperplastic, and adenocarcinoma). Results showed that the performance of the pathologists over MPM images was 65% of the H&E performance while the virtual staining method achieved 90%. MPM imaging can provide appropriate information for diagnosing colorectal cancer without the need for H&E staining. However, the existing semantic gap among modalities needs to be corrected., This work was supported by the PICCOLO project. This project has received funding from the European Union's Horizon 2020 Research and Innovation Programme under grant agreement No. 732111. The sole re- sponsibility of this publication lies with the authors. The European Union is not responsible for any use that may be made of the information contained therein
Addi. Archivo Digital para la Docencia y la Investigación
Publication Artículo científico (JournalArticle)

Constellation Loss: Improving the Efficiency of Deep Metric Learning Loss Functions for the Optimal Embedding of Histopathological Images

  • Medela Ayarzaguena, Alfonso
  • Picón Ruiz, Artzai
Background: Deep learning diagnostic algorithms are proving comparable results with human experts in a wide variety of tasks, and they still require a huge amount of well-annotated data for training, which is often non affordable. Metric learning techniques have allowed a reduction in the required annotated data allowing few-shot learning over deep learning architectures. Aims and Objectives: In this work, we analyze the state-of-the-art loss functions such as triplet loss, contrastive loss, and multi-class N-pair loss for the visual embedding extraction of hematoxylin and eosin (H&E) microscopy images and we propose a novel constellation loss function that takes advantage of the visual distances of the embeddings of the negative samples and thus, performing a regularization that increases the quality of the extracted embeddings. Materials and Methods: To this end, we employed the public H&E imaging dataset from the University Medical Center Mannheim (Germany) that contains tissue samples from low-grade and high-grade primary tumors of digitalized colorectal cancer tissue slides. These samples are divided into eight different textures (1. tumour epithelium, 2. simple stroma, 3. complex stroma, 4. immune cells, 5. debris and mucus, 6. mucosal glands, 7. adipose tissue and 8. background,). The dataset was divided randomly into train and test splits and the training split was used to train a classifier to distinguish among the different textures with just 20 training images. The process was repeated 10 times for each loss function. Performance was compared both for cluster compactness and for classification accuracy on separating the aforementioned textures. Results: Our results show that the proposed loss function outperforms the other methods by obtaining more compact clusters (Davis-Boulding: 1.41 ± 0.08, Silhouette: 0.37 ± 0.02) and better classification capabilities (accuracy: 85.0 ± 0.6) over H and E microscopy images. We demonstrate that the proposed constellation loss can be successfully used in the medical domain in situations of data scarcity., This work was partially supported by PICCOLO project. This project has received funding from the European Union’s Horizon2020 Research and Innovation Programme under grant agreement No. 732111.
UCrea Repositorio Abierto de la Universidad de Cantabria
Publication Tesis doctoral (DoctoralThesis)

Contribuciones al diagnóstico oncológico mediante Tomografía de Coherencia Óptica (OCT) y técnicas de imagen médica, Contribution to oncological diagnosis based on Optical coherence Tomography (OCT) and other medical imaging techniques

  • López Sarachaga, Cristina
Los clínicos reclaman nuevas técnicas y métodos que les permitan realizar un estudio no invasivo y en tiempo real de las lesiones, especialmente del cáncer, para favorecer el diagnóstico temprano. Técnicas como OCT (Tomografía de Coherencia Óptica), proporcionan información arquitectónica y estructural de las capas internas del tejido, lo que permite estudiar las alteraciones que se producen en presencia de patología. La interpretación clínica de las imágenes OCT resulta compleja, por lo que se propone aplicar técnicas de procesado de imagen y de aprendizaje automático para el análisis de las imágenes, con el objetivo de extraer características clínicamente relevantes. De esta forma, a través de dos casos de estudio, se busca aportar al desarrollo del concepto de "biopsia óptica" y la creación de herramientas de ayuda al diagnóstico (CAD), facilitando la diferenciación de lesiones benignas de aquellas malignas o con potencial de serlo., Clinicians demand new techniques and methods that allow them to conduct a non-invasive and real-time study of lesions, especially cancer, to facilitate early diagnosis. Techniques such as OCT (Optical Coherence Tomography) provide architectural and structural information about the internal layers of tissue, enabling the study of alterations that occur in the presence of pathology. The clinical interpretation of OCT images is complex, so this thesis proposes developing image processing and machine learning techniques for the analysis of images, with the goal of extracting clinically relevant characteristics. The final objective is to contribute to the development of the concept of "optical biopsy" and the creation of Computed Aided Diagnosis (CAD) tools, facilitating the differentiation of benign lesions from those that are malignant or have the potential to evolve to malignancy., El trabajo desarrollado en esta tesis doctoral ha sido posible gracias a los siguientes proyectos: - ASTONISH: Advancing Smart Optical Imaging and Sensing for Health. Proyecto Europeo de la convocaría ECSEL-04-2015 – Smart Health. Project ID: 692470. https://cordis.europa.eu/project/id/692470 - PICCOLO: Multimodal highly-sensitive PhotonICs endoscope for improved in-vivo COLOn Cancer diagnosis and clinical decision support. Proyecto Europeo de la convocatoria ICT-29-2016 – Photonics KET 2016. Project ID: 732111. https://cordis.europa.eu/project/id/732111 También gracias a la convocatoria de ayuda para el desarrollo del programa de doctorados industriales 2016 de la universidad de Cantabria (BOC Nº206 de 26 de octubre de 2016).