Pasar al contenido principal

HERRAMIENTAS DE NEUROIMAGEN PARA MEJORAR EL DIAGNOSIS Y EL SEGUIMIENTO CLINICO DE LOS PACIENTES CON ESCLEROSIS MULTIPLE

TIN2014-55710-R

•
Nombre agencia financiadora Ministerio de Economía y Competitividad
Acrónimo agencia financiadora MINECO
Programa Programa Estatal de I+D+i Orientado a los Retos de la Sociedad
Convocatoria Proyectos I+D+i Retos de Investigación
Año convocatoria 2014
Plan Estatal 2013-2016 Plan Estatal de Investigación Científica y Técnica y de Innovación
Unidad de gestión Secretaría de Estado de Educación, Formación Profesional y Universidades
Centro beneficiario UNIVERSITAT DE GIRONA
Identificador persistente http://dx.doi.org/10.13039/501100003329

Resultados relacionados

Resultados totales (Incluyendo duplicados): 17
Encontrada(s) 1 página(s)

Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Supervised Domain Adaptation for Automatic Sub-cortical Brain Structure Segmentation with Minimal User Interaction

  • Kushibar, Kaisar
  • Valverde Valverde, Sergi
  • González Villà, Sandra
  • Bernal Moyano, Jose
  • Cabezas Grebol, Mariano
  • Oliver i Malagelada, Arnau
  • Lladó Bardera, Xavier
In recent years, some convolutional neural networks (CNNs) have been proposed to segment sub-cortical brain structures from magnetic resonance images (MRIs). Although these methods provide accurate segmentation, there is a reproducibility issue regarding segmenting MRI volumes from different image domains – e.g., differences in protocol, scanner, and intensity profile. Thus, the network must be retrained from scratch to perform similarly in different imaging domains, limiting the applicability of such methods in clinical settings. In this paper, we employ the transfer learning strategy to solve the domain shift problem. We reduced the number of training images by leveraging the knowledge obtained by a pretrained network, and improved the training speed by reducing the number of trainable parameters of the CNN. We tested our method on two publicly available datasets – MICCAI 2012 and IBSR – and compared them with a commonly used approach: FIRST. Our method showed similar results to those obtained by a fully trained CNN, and our method used a remarkably smaller number of images from the target domain. Moreover, training the network with only one image from MICCAI 2012 and three images from IBSR datasets was sufficient to significantly outperform FIRST with (p < 0.001) and (p < 0.05), respectively, Kaisar Kushibar and Jose Bernal hold FI-DGR2017 grant from the Catalan Government with reference numbers 2017FI_B00372 and 2017FI_B00476, respectively. This work has been partially supported by La Fundació la Marató de TV3, by Retos de Investigación TIN2014-55710-R, TIN2015-73563-JIN, and DPI2017-86696-R from the Ministerio de Ciencia y Tecnologia
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Quantitative Analysis of Patch-Based Fully Convolutional Neural Networks for Tissue Segmentation on Brain Magnetic Resonance Imaging

  • Bernal Moyano, Jose
  • Kushibar, Kaisar
  • Cabezas Grebol, Mariano
  • Valverde Valverde, Sergi
  • Oliver i Malagelada, Arnau
  • Lladó Bardera, Xavier
Accurate brain tissue segmentation in magnetic resonance imaging (MRI) has attracted the attention of medical doctors and researchers since variations in tissue volume and shape permit diagnosing and monitoring neurological diseases. Several proposals have been designed throughout the years comprising conventional machine learning strategies as well as convolutional neural networks (CNNs) approaches. In particular, in this paper, we analyze a sub-group of deep learning methods producing dense predictions. This branch, referred in the literature as fully CNN (FCNN), is of interest as these architectures can process an input volume in less time than CNNs. Our study focuses on understanding the architectural strengths and weaknesses of literature-like approaches. We implement eight FCNN architectures inspired by robust state-of-the-art methods on brain segmentation related tasks and use them within a standard pipeline. We evaluate them using the IBSR18, MICCAI2012, and iSeg2017 datasets as they contain infant and adult data and exhibit different voxel spacing, image quality, number of scans, and available imaging modalities. The discussion is driven in four directions: comparison between 2D and 3D approaches, the relevance of multiple imaging sequences, the effect of patch size, and the impact of patch overlap as a sampling strategy for training and testing models. Besides the aforementioned analysis, we show that the methods under evaluation can yield top performance on the three data collections. A public version is accessible to download from our research website to encourage other researchers to explore the evaluation framework, This work was supported in part by the La Fundació la Marató de TV3 and in part by the Retos de Investigació under Grant TIN2014-55710-R, Grant TIN2015-73563-JIN, and Grant DPI2017-86696-R from the Ministerio de Ciencia y Tecnología. The work of J. Bernal and K. Kushibar was supported by the Catalan Government under Grant FI-DGR2017, Grant 2017FI B00476, and Grant 2017FI B00372. The work of M. Cabezas was supported by the Juan de la Cierva–Incorporación Grant from the Spanish Government under Grant IJCI-2016-29240
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

A supervised framework with intensity subtraction and deformation field features for the detection of new T2-w lesions in multiple sclerosis

  • Salem, Mostafa
  • Cabezas Grebol, Mariano
  • Valverde Valverde, Sergi
  • Pareto, Deborah
  • Oliver i Malagelada, Arnau
  • Salvi, Joaquim
  • Rovira, Àlex
  • Lladó Bardera, Xavier
Longitudinal magnetic resonance imaging (MRI) analysis has an important role in multiple sclerosis diagnosis and follow-up. The presence of new T2-w lesions on brain MRI scans is considered a prognostic and predictive biomarker for the disease. In this study, we propose a supervised approach for detecting new T2-w lesions using features from image intensities, subtraction values, and deformation fields (DF). Methods One year apart multi-channel brain MRI scans were obtained for 60 patients, 36 of them with new T2-w lesions. Images from both temporal points were preprocessed and co-registered. Afterwards, they were registered using multi-resolution affine registration, allowing their subtraction. In particular, the DFs between both images were computed with the Demons non-rigid registration algorithm. Afterwards, a logistic regression model was trained with features from image intensities, subtraction values, and DF operators. We evaluated the performance of the model following a leave-one-out cross-validation scheme. Results In terms of detection, we obtained a mean Dice similarity coefficient of 0.77 with a true-positive rate of 74.30% and a false-positive detection rate of 11.86%. In terms of segmentation, we obtained a mean Dice similarity coefficient of 0.56. The performance of our model was significantly higher than state-of-the-art methods. Conclusions The performance of the proposed method shows the benefits of using DF operators as features to train a supervised learning model. Compared to other methods, the proposed model decreases the number of false-positives while increasing the number of true-positives, which is relevant for clinical settings, This work has been supported by “La Fundació la Marató de TV3”, by Retos de Investigación TIN2014-55710-R and TIN2015-73563-JIN, and by MPC UdG 2016/022 grant
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Evaluating the effect of multiple sclerosis lesions on automatic brain structure segmentation

  • González Villà, Sandra
  • Valverde Valverde, Sergi
  • Cabezas Grebol, Mariano
  • Pareto, Deborah
  • Vilanova, Joan Carles
  • Ramió i Torrentà, Lluís
  • Rovira, Àlex
  • Oliver i Malagelada, Arnau
  • Lladó Bardera, Xavier
In recent years, many automatic brain structure segmentation methods have been proposed. However, these methods are commonly tested with non-lesioned brains and the effect of lesions on their performance has not been evaluated. Here, we analyze the effect of multiple sclerosis (MS) lesions on three well-known automatic brain structure segmentation methods, namely, FreeSurfer, FIRST and multi-atlas fused by majority voting, which use learning-based, deformable and atlas-based strategies, respectively. To perform a quantitative analysis, 100 synthetic images of MS patients with a total of 2174 lesions are simulated on two public databases with available brain structure ground truth information (IBSR18 and MICCAI’12). The Dice similarity coefficient (DSC) differences and the volume differences between the healthy and the simulated images are calculated for the subcortical structures and the brainstem. We observe that the three strategies are affected when lesions are present. However, the effects of the lesions do not follow the same pattern; the lesions either make the segmentation method underperform or surprisingly augment the segmentation accuracy. The obtained results show that FreeSurfer is the method most affected by the presence of lesions, with DSC differences (generated − healthy) ranging from−0.11 ± 0.54 to 9.65 ± 9.87, whereas FIRST tends to be the most robust method when lesions are present (−2.40 ± 5.54 to 0.44 ± 0.94). Lesion location is not important for global strategies such as FreeSurfer or majority voting, where structure segmentation is affected wherever the lesions exist. On the other hand, FIRST is more affected when the lesions are overlaid or close to the structure of analysis. The most affected structure by the presence of lesions is the nucleus accumbens (from −1.12 ± 2.53 to 1.32 ± 4.00 for the left hemisphere and from −2.40 ± 5.54 to 9.65 ± 9.87 for the right hemisphere), whereas the structures that show less variation include the thalamus (from 0.03 ± 0.35 to 0.74 ± 0.89 and from −0.48 ± 1.08 to −0.04 ± 0.22) and the brainstem (from −0.20 ± 0.38 to 1.03 ± 1.31). The three segmentation approaches are affected by the presence of MS lesions, which demonstrates that there exists a problem in the automatic segmentation methods of the deep gray matter (DGM) structures that has to be taken into account when using them as a tool to measure the disease progression, This work has been partially supported by “La Fundació la Marató de TV3” Ref. 201425 30, by Retos de Investigación TIN2014-55710-R and TIN2015-73563-JIN, and by MPC UdG 2016/022 grant
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Automated sub-cortical brain structure segmentation combining spatial and deep convolutional features

  • Kushibar, Kaisar
  • Valverde Valverde, Sergi
  • González Villà, Sandra
  • Bernal Moyano, Jose
  • Cabezas Grebol, Mariano
  • Oliver i Malagelada, Arnau
  • Lladó Bardera, Xavier
Sub-cortical brain structure segmentation in Magnetic Resonance Images (MRI) has attracted the interest of the research community for a long time as morphological changes in these structures are related to different neurodegenerative disorders. However, manual segmentation of these structures can be tedious and prone to variability, highlighting the need for robust automated segmentation methods. In this paper, we present a novel convolutional neural network based approach for accurate segmentation of the sub-cortical brain structures that combines both convolutional and prior spatial features for improving the segmentation accuracy. In order to increase the accuracy of the automated segmentation, we propose to train the network using a restricted sample selection to force the network to learn the most difficult parts of the structures. We evaluate the accuracy of the proposed method on the public MICCAI 2012 challenge and IBSR 18 datasets, comparing it with different traditional and deep learning state-of-the-art methods. On the MICCAI 2012 dataset, our method shows an excellent performance comparable to the best participant strategy on the challenge, while performing significantly better than state-of-the-art techniques such as FreeSurfer and FIRST. On the IBSR 18 dataset, our method also exhibits a significant increase in the performance with respect to not only FreeSurfer and FIRST, but also comparable or better results than other recent deep learning approaches. Moreover, our experiments show that both the addition of the spatial priors and the restricted sampling strategy have a significant effect on the accuracy of the proposed method. In order to encourage the reproducibility and the use of the proposed method, a public version of our approach is available to download for the neuroimaging community, Kaisar Kushibar and Jose Bernal hold FI-DGR2017 grant from the Catalan Government with reference numbers 2017FI_B00372 and 2017FI_B00476, respectively. This work has been partially supported by La Fundació la Marató de TV3, by Retos de Investigación TIN2014-55710-R, TIN2015-73563-JIN, and DPI2017-86696-R from the Ministerio de Ciencia y Tecnologia
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

A collection of challenging motion segmentation benchmark datasets

  • Mahmood, Muhammad Habib
  • Diez, Yago
  • Salvi, Joaquim
  • Lladó Bardera, Xavier
An in-depth analysis of computer vision methodologies is greatly dependent on the benchmarks they are tested upon. Any dataset is as good as the diversity of the true nature of the problem enclosed in it. Motion segmentation is a preprocessing step in computer vision whose publicly available datasets have certain limitations. Some databases are not up-to-date with modern requirements of frame length and number of motions, and others do not have ample ground truth in them. In this paper, we present a collection of diverse multifaceted motion segmentation benchmarks containing trajectory- and region-based ground truth. These datasets enclose real-life long and short sequences, with increased number of motions and frames per sequence, and also real distortions with missing data. The ground truth is provided on all the frames of all the sequences. A comprehensive benchmark evaluation of the state-of-the-art motion segmentation algorithms is provided to establish the difficulty of the problem and to also contribute a starting point. All the resources of the datasets have been made publicly available at http://dixie.udg.edu/udgms/, This work is supported by the FP7-ICT-2011 7project PANDORA (Ref 288273) funded by the European Commission, two projects funded by the Ministry of Economy and Competitiveness of the Spanish Government. RAIMON (Ref CTM2011-29691-C02-02) and NICOLE (Ref TIN2014-55710-R)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

A toolbox for multiple sclerosis lesion segmentation

  • Roura Perez, Eloy
  • Oliver i Malagelada, Arnau
  • Cabezas Grebol, Mariano
  • Valverde Valverde, Sergi
  • Pareto, Deborah
  • Vilanova, Joan Carles
  • Ramió i Torrentà, Lluís
  • Rovira, Àlex
  • Lladó Bardera, Xavier
Lesion segmentation plays an important role in the diagnosis and follow-up of multiple sclerosis (MS). This task is very time-consuming and subject to intra- and inter-rater variability. In this paper, we present a new tool for automated MS lesion segmentation using T1w and fluid-attenuated inversion recovery (FLAIR) images. Methods: Our approach is based on two main steps, initial brain tissue segmentation according to the gray matter (GM), white matter (WM), and cerebrospinal fluid (CSF) performed in T1w images, followed by a second step where the lesions are segmented as outliers to the normal apparent GM brain tissue on the FLAIR image. Results: The tool has been validated using data from more than 100 MS patients acquired with different scanners and at different magnetic field strengths. Quantitative evaluation provided a better performance in terms of precision while maintaining similar results on sensitivity and Dice similarity measures compared with those of other approaches. Conclusion: Our tool is implemented as a publicly available SPM8/12 extension that can be used by both the medical and research communities, E. Roura holds a BRUdG2013 grant. S. Valverde holds a FI-DGR2013 grant from the Generalitat de Catalunya. This work has been partially supported by BLa Fundació la Marató de TV3^ and by Retos de Investigación TIN2014-55710-R, This work has been partially supported by BLa Fundació la Marató de TV3^ and by Retos de Investigación TIN2014-55710-R
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Automated Detection of Lupus White Matter Lesions in MRI

  • Roura Perez, Eloy
  • Sarbu, Nicolae
  • Oliver i Malagelada, Arnau
  • Valverde Valverde, Sergi
  • González Villà, Sandra
  • Cervera, Ricard
  • Bargalló, Núria
  • Lladó Bardera, Xavier
Brain magnetic resonance imaging provides detailed information which can be used to detectand segment white matter lesions (WML). In this work we propose an approach to automatically segment WML in Lupus patients by using T1 wandfluid-attenuated inversion recovery (FLAIR) images. Lupus WML appear as small fo calabnormal tissue observed as hyperintensities in the FLAIR images. The quantification of these WML is a key factor for the stratification of lupus patients and therefore both lesion detection and segmentation play an important role. In our approach, the T1 wimage is first used to classify the three maint issues of the brain , white matter (WM), graymatter (GM) ,and cerebro spinal fluid (CSF), while the FLAIR image is then used to detect focal WM La soutliers of its GMintensity distribution. Aset of post-processing steps based on lesionsize, tissue neighborhood, and location are used to refine the lesion candidates. The propos alise valuated on 20 patients, presenting qualitative, and quantitative results in terms of precision and sensitivity of lesion detection [True Positive Rate (62%) and Positive Prediction Value (80%), respectively] as well as segmentation accuracy [Dice Similarity Coefficient (72%)]. Obtained results illustrate the validity of the aproach to automatically detectand segment lupus lesions. Besides,our approach is publicly available as a SPM8/12 tool box extension with a simple parameter configuration, ER holds a BR-UdG2013 Ph.D. grant. SV holds a FI-DGR2013 Ph.D.grant. This work has been supported by“L aFundació la Marató de TV3”,by Retos de Investigación TIN2014-55710-R, and by MP CUdG2016/022grant
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

One-shot domain adaptation in multiple sclerosis lesion segmentation using convolutional neural networks

  • Valverde Valverde, Sergi
  • Salem, Mostafa
  • Cabezas Grebol, Mariano
  • Pareto, Deborah
  • Vilanova, Joan Carles
  • Ramió i Torrentà, Lluís
  • Rovira, Àlex
  • Salvi, Joaquim
  • Oliver i Malagelada, Arnau
  • Lladó Bardera, Xavier
In recent years, several convolutional neural network (CNN) methods have been proposed for the automated white matter lesion segmentation of multiple sclerosis (MS) patient images, due to their superior performance compared with those of other state-of-the-art methods. However, the accuracies of CNN methods tend to decrease significantly when evaluated on different image domains compared with those used for training, which demonstrates the lack of adaptability of CNNs to unseen imaging data. In this study, we analyzed the effect of intensity domain adaptation on our recently proposed CNN-based MS lesion segmentation method. Given a source model trained on two public MS datasets, we investigated the transferability of the CNN model when applied to other MRI scanners and protocols, evaluating the minimum number of annotated images needed from the new domain and the minimum number of layers needed to re-train to obtain comparable accuracy. Our analysis comprised MS patient data from both a clinical center and the public ISBI2015 challenge database, which permitted us to compare the domain adaptation capability of our model to that of other state-of-the-art methods. In both datasets, our results showed the effectiveness of the proposed model in adapting previously acquired knowledge to new image domains, even when a reduced number of training samples was available in the target dataset. For the ISBI2015 challenge, our one-shot domain adaptation model trained using only a single case showed a performance similar to that of other CNN methods that were fully trained using the entire available training set, yielding a comparable human expert rater performance. We believe that our experiments will encourage the MS community to incorporate its use in different clinical settings with reduced amounts of annotated data. This approach could be meaningful not only in terms of the accuracy in delineating MS lesions but also in the related reductions in time and economic costs derived from manual lesion labeling, Mariano Cabezas holds a Juan de la Cierva - Incorporación grant from the Spanish Government with reference number IJCI-2016-29240. This work has been partially supported by La Fundació la Marató de TV3, Spain; by Retos de Investigación TIN2014-55710-R, TIN2015- 73563-JIN and DPI2017-86696-R from the Ministerio de Ciencia y Tecnología, Spain. The authors gratefully acknowledge the support of the NVIDIA Corporation with their donation of the TITAN-X PASCAL GPU used in this research
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Semi-automatic tool for motion annotation on complex video sequences

  • Mahmood, Muhammad Habib
  • Salvi, Joaquim
  • Lladó Bardera, Xavier
Ground truth annotation on motion segmentation (MS) datasets of arbitrary real-life videos is a difficult and challenging task. The research community lacks a standard annotation tool for such datasets, which makes it an open research field. Here an annotation tool is proposed for trajectories in complex videos, which provides a publicly available platform to create and reinforce MS datasets. The user friendly interface allows to refine an initial automatic segmentation result to produce ground truth annotation on all the motions of all the frames of a given sequence. In long videos with multiple rigid/non-rigid motions containing complete occlusion and real distortions, the tool facilitates rapid annotation of motion in a semi-automatic way, This work was supported by the FP7-ICT-2011-7 project PANDORA (Ref 288273), RAIMON (Ref CTM2011-29691- C02-02) and NICOLE (Ref TIN2014-55710-R)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Quantifying brain tissue volume in multiple sclerosis with automated lesion segmentation and filling

  • Valverde Valverde, Sergi
  • Oliver i Malagelada, Arnau
  • Roura Perez, Eloy
  • Pareto, Deborah
  • Vilanova, Joan Carles
  • Ramió i Torrentà, Lluís
  • Sastre Garriga, Jaume
  • Montalban Gairín, Xavier
  • Rovira, Àlex
  • Lladó Bardera, Xavier
Lesion filling has been successfully applied to reduce the effect of hypo-intense T1-wMultiple Sclerosis (MS) lesions on automatic brain tissue segmentation. However, a study of fully automated pipelines incorporating lesion segmentation and lesion filling on tissue volume analysis has not yet been performed. Here,we analyzed the % of error introduced by automating the lesion segmentation and filling processes in the tissue segmentation of 70 clinically isolated syndrome patient images. First of all, images were processed using the LST and SLS toolkits with different pipeline combinations that differed in either automated ormanual lesion segmentation, and lesion filling or masking out lesions. Then, images processed following each of the pipelines were segmented into gray matter (GM) andwhite matter (WM) using SPM8, and compared with the same images where expert lesion annotationswere filled before segmentation. Our results showed that fully automated lesion segmentation and filling pipelines reduced significantly the % of error inGMandWMvolumeon images ofMS patients, and performed similarly to the images where expert lesion annotations were masked before segmentation. In all the pipelines, the amount of misclassified lesion voxels was the main cause in the observed error inGMandWMvolume. However, the % of error was significantly lower when automatically estimated lesionswere filled and not masked before segmentation. These results are relevant and suggest that LST and SLS toolboxes allow the performance of accurate brain tissue volume measurements without any kind of manual intervention, which can be convenient not only in terms of time and economic costs, but also to avoid the inherent intra/inter variability between manual annotations, S. Valverde holds a FI-DGR2013 grant from the Generalitat de Catalunya. E. Roura holds a BR-UdG2013 grant. This work has been partially supported by “La Fundació la Marató de TV3” and by Retos de Investigación TIN2014-55710-R
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

A review on brain structures segmentation in magnetic resonance imaging

  • González Villà, Sandra
  • Oliver i Malagelada, Arnau
  • Valverde Valverde, Sergi
  • Wang, Liping
  • Zwiggelaar, Reyer
  • Lladó Bardera, Xavier
Background and objectives Automatic brain structures segmentation in magnetic resonance images has been widely investigated in recent years with the goal of helping diagnosis and patient follow-up in different brain diseases. Here, we present a review of the state-of-the-art of automatic methods available in the literature ranging from structure specific segmentation methods to whole brain parcellation approaches. Methods We divide first the algorithms according to their target structures and then we propose a general classification based on their segmentation strategy, which includes atlas-based, learning-based, deformable, region-based and hybrid methods. We further discuss each category's strengths and weaknesses and analyze its performance in segmenting different brain structures providing a qualitative and quantitative comparison. Results We compare the results of the analyzed works for the following brain structures: hippocampus, thalamus, caudate nucleus, putamen, pallidum, amygdala, accumbens, lateral ventricles, and brainstem. The structures on which more works have focused on are the hippocampus and the caudate nucleus. In general, the accumbens (0.69 mean DSC) is the most difficult structure to segment whereas the structures that seem to get the best results are the brainstem, closely followed by the thalamus and the putamen with 0.88, 0.87 and 0.86 mean DSC, respectively. Atlas-based approaches achieve good results when segmenting the hippocampus (DSC between 0.75 and 0.90), thalamus (0.88–0.92) and lateral ventricles (0.83–0.93), while deformable methods perform good for caudate nucleus (0.84–0.91) and putamen segmentation (0.86–0.89). Conclusions There is not yet a single automatic segmentation approach that can emerge as a standard for the clinical practice, providing accurate brain structures segmentation. Future trends need to focus on combining multi-atlas methods with learning-based or deformable approaches. Employing atlases to provide spatial robustness and modeling the structures appearance with supervised classifiers or Active Appearance Models could lead to improved segmentation results, AcknowledgementsS. González-Villà holds a UdG-BRGR2015 grant from the Uni-versity of Girona. This work has been partially supported by “LaFundació la Marató de TV3”, by Retos de Investigación TIN2014-55710-R, and by MPC UdG 2016/022 grant
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Multiple Sclerosis Lesion Synthesis in MRI Using an Encoder-Decoder U-NET

  • Salem, Mostafa
  • Valverde Valverde, Sergi
  • Cabezas Grebol, Mariano
  • Pareto, Deborah
  • Oliver i Malagelada, Arnau
  • Salvi, Joaquim
  • Rovira, Àlex
  • Lladó Bardera, Xavier
In this paper, we propose generating synthetic multiple sclerosis (MS) lesions on MRI images with the final aim to improve the performance of supervised machine learning algorithms, therefore avoiding the problem of the lack of available ground truth. We propose a two-input two-output fully convolutional neural network model for MS lesion synthesis in MRI images. The lesion information is encoded as discrete binary intensity level masks passed to the model and stacked with the input images. The model is trained end-to-end without the need for manually annotating the lesions in the training set. We then perform the generation of synthetic lesions on healthy images via registration of patient images, which are subsequently used for data augmentation to increase the performance for supervised MS lesion detection algorithms. Our pipeline is evaluated on MS patient data from an in-house clinical dataset and the public ISBI2015 challenge dataset. The evaluation is based on measuring the similarities between the real and the synthetic images as well as in terms of lesion detection performance by segmenting both the original and synthetic images individually using a state-of-the-art segmentation framework. We also demonstrate the usage of synthetic MS lesions generated on healthy images as data augmentation. We analyze a scenario of limited training data (one-image training) to demonstrate the effect of the data augmentation on both datasets. Our results significantly show the effectiveness of the usage of synthetic MS lesion images. For the ISBI2015 challenge, our one-image model trained using only a single image plus the synthetic data augmentation strategy showed a performance similar to that of other CNN, This work was supported by the Retos de Investigación from the Ministerio de Ciencia y Tecnología under Grant TIN2014- 55710-R and Grant DPI2017-86696-R
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Automated tissue segmentation of MR brain images in the presence of white matter lesions

  • Valverde Valverde, Sergi
  • Oliver i Malagelada, Arnau
  • Roura Perez, Eloy
  • González Villà, Sandra
  • Pareto, Deborah
  • Vilanova, Joan Carles
  • Ramió i Torrentà, Lluís
  • Rovira, Àlex
  • Lladó Bardera, Xavier
Over the last few years, the increasing interest in brain tissue volume measurements on clinical settings has led to the development of a wide number of automated tissue segmentation methods. However, white matter lesions are known to reduce the performance of automated tissue segmentation methods, which requires manual annotation of the lesions and refilling them before segmentation, which is tedious and time-consuming. Here, we propose a new, fully automated T1-w/FLAIR tissue segmentation approach designed to deal with images in the presence of WM lesions. This approach integrates a robust partial volume tissue segmentation with WM outlier rejection and filling, combining intensity and probabilistic and morphological prior maps. We evaluate the performance of this method on the MRBrainS13 tissue segmentation challenge database, which contains images with vascular WM lesions, and also on a set of Multiple Sclerosis (MS) patient images. On both databases, we validate the performance of our method with other state-of-the-art techniques. On the MRBrainS13 data, the presented approach was at the time of submission the best ranked unsupervised intensity model method of the challenge (7th position) and clearly outperformed the other unsupervised pipelines such as FAST and SPM12. On MS data, the differences in tissue segmentation between the images segmented with our method and the same images where manual expert annotations were used to refill lesions on T1-w images before segmentation were lower or similar to the best state-of-the-art pipeline incorporating automated lesion segmentation and filling. Our results show that the proposed pipeline achieved very competitive results on both vascular and MS lesions. A public version of this approach is available to download for the neuro-imaging community, This work has been partially supported by ”La Fundacióla Maratóde TV3”, by Retos de Investigacin TIN2014-55710-R, and by the MPC UdG 2016/022 grant from the University of Girona
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Multi-channel registration of fractional anisotropy and T1-weighted images in the presence of atrophy: application to multiple sclerosis

  • Roura Perez, Eloy
  • Schneider, Torben
  • Modat, Marc
  • Daga, Pankaj
  • Muhlert, Nils
  • Chard, Declan
  • Ourselin, Sebastien
  • Lladó Bardera, Xavier
  • Wheeler-Kingshott, Claudia Gandini
Co-registration of structural T1-weighted (T1w) scans and diffusion tensor imaging (DTI)-derived fractional anisotropy (FA) maps to a common space is of particular interest in neuroimaging, as T1w scans can be used for brain segmentation while DTI can provide microstructural tissue information. While the effect of lesions on registration has been tackled and solutions are available, the issue of atrophy is still open to discussion. Multi-channel (MC) registration algorithms have the advantage of maintaining anatomical correspondence between different contrast images after registration to any target space. In this work, we test the performance of an MC registration approach applied to T1w and FA data using simulated brain atrophy images. Experimental results are compared with a standard single-channel registration approach. Multi-channel registration of fractional anisotropy and T1-weighted images in the presence of atrophy: application to multiple sclerosis Both qualitative and quantitative evaluations are presented, showing that the MC approach provides better alignment with the target while maintaining better T1w and FA co-alignment, This work has also been partially supported by “La Fundació la Marató de TV3” and by Retos de Investigación TIN2014-55710-R
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Improving automated multiple sclerosis lesion segmentation with a cascaded 3D convolutional neural network approach

  • Valverde Valverde, Sergi
  • Cabezas Grebol, Mariano
  • Roura Perez, Eloy
  • González Villà, Sandra
  • Pareto, Deborah
  • Vilanova, Joan Carles
  • Ramió i Torrentà, Lluís
  • Rovira, Àlex
  • Oliver i Malagelada, Arnau
  • Lladó Bardera, Xavier
In this paper, we present a novel automated method for White Matter (WM) lesion segmentation of Multiple Sclerosis (MS) patient images. Our approach is based on a cascade of two 3D patch-wise convolutional neural networks (CNN). The first network is trained to be more sensitive revealing possible candidate lesion voxels while the second network is trained to reduce the number of misclassified voxels coming from the first network. This cascaded CNN architecture tends to learn well from a small (n≤35) set of labeled data of the same MRI contrast, which can be very interesting in practice, given the difficulty to obtain manual label annotations and the large amount of available unlabeled Magnetic Resonance Imaging (MRI) data. We evaluate the accuracy of the proposed method on the public MS lesion segmentation challenge MICCAI2008 dataset, comparing it with respect to other state-of-the-art MS lesion segmentation tools. Furthermore, the proposed method is also evaluated on two private MS clinical datasets, where the performance of our method is also compared with different recent public available state-of-the-art MS lesion segmentation methods. At the time of writing this paper, our method is the best ranked approach on the MICCAI2008 challenge, outperforming the rest of 60 participant methods when using all the available input modalities (T1-w, T2-w and FLAIR), while still in the top-rank (3rd position) when using only T1-w and FLAIR modalities. On clinical MS data, our approach exhibits a significant increase in the accuracy segmenting of WM lesions when compared with the rest of evaluated methods, highly correlating (r≥0.97) also with the expected lesion volume, This work has been partially supported by “La Fundació la Marató de TV3”, by Retos de InvestigaciónTIN2014-55710-R, and by the MPC UdG 2016/022 grant
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Brain structure segmentation in the presence of multiple sclerosis lesions

  • González Villà, Sandra
  • Oliver i Malagelada, Arnau
  • Huo, Yuankai
  • Lladó Bardera, Xavier
  • Landman, Bennett A.
Intensity-based multi-atlas segmentation strategies have shown to be particularly successful in segmenting brain images of healthy subjects. However, in the same way as most of the methods in the state of the art, their performance tends to be affected by the presence of MRI visible lesions, such as those found in multiple sclerosis (MS) patients. Here, we present an approach to minimize the effect of the abnormal lesion intensities on multi-atlas segmentation. We propose a new voxel/patch correspondence model for intensity-based multi-atlas label fusion strategies that leads to more accurate similarity measures, having a key role in the final brain segmentation. We present the theory of this model and integrate it into two well-known fusion strategies: Non-local Spatial STAPLE (NLSS) and Joint Label Fusion (JLF). The experiments performed show that our proposal improves the segmentation performance of the lesion areas. The results indicate a mean Dice Similarity Coefficient (DSC) improvement of 1.96% for NLSS (3.29% inside and 0.79% around the lesion masks) and, an improvement of 2.06% for JLF (2.31% inside and 1.42% around lesions). Furthermore, we show that, with the proposed strategy, the well-established preprocessing step of lesion filling can be disregarded, obtaining similar or even more accurate segmentation results, S. González-Villà holds a UdG-BRGR2015 grant. This work has been supported by “La Fundació la Marató de TV3”, by Retos de Investigación TIN2014-55710-R and TIN2015-73563-JIN, by DPI2017- 86696-R and by UdG mobility grant MOB17. This research was supported by NSF CAREER 1452485, NIH R01-EB017230, and the National Center for Advancing Translational Sciences, Grant 2 UL1 TR000445- 06. We appreciate the NIH S10 Shared Instrumentation Grant 1S10OD020154-01 (Smith), Vanderbilt IDEAS grant (Holly- Bockelmann, Walker, Meliler, Palmeri, Weller), and ACCRE's Big Data TIPs grant from Vanderbilt University