RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación
Artículo científico (JournalArticle)
Deep learning based MRI contrast synthesis using full volume prediction using full volume prediction
[EN] In Magnetic Resonance Imaging (MRI), depending on the image acquisition settings, a large number
of image types or contrasts can be generated showing complementary information of the same imaged
subject. This multi-spectral information is highly beneficial since can improve MRI analysis tasks such
as segmentation and registration, thanks to pattern ambiguity reduction. However, the acquisition of
several contrasts is not always possible due to time limitations and patient comfort constraints.
Contrast synthesis has emerged recently as an approximate solution to generate other image types
different from those acquired originally. Most of the previously proposed methods for contrast
synthesis are slice-based which result in intensity inconsistencies between neighbor slices when
applied in 3D. We propose the use of a 3D convolutional neural network (CNN) capable of generating
T2 and FLAIR images from a single anatomical T1 source volume. The proposed network is a 3D
variant of the UNet that processes the whole volume at once breaking with the inconsistency in the
resulting output volumes related to 2D slice or patch-based methods. Since working with a full volume
at once has a huge memory demand we have introduced a spatial-to-depth and a reconstruction layer
that allows working with the full volume but maintain the required network complexity to solve the
problem. Our approach enhances the coherence in the synthesized volume while improving the
accuracy thanks to the integrated three-dimensional context-awareness. Finally, the proposed method
has been validated with a segmentation method, thus demonstrating its usefulness in a direct and
relevant application., This research was supported by the Spanish DPI2017-87743-R grant from the Ministerio de Economia, Industria y Competitividad of Spain. This study has been also carried out with financial support from the French State, managed by the French National Research Agency (ANR) in the frame of the Investments for the future Program IdEx Bordeaux (ANR-10-IDEX-03-02, HL-MRI Project) and Cluster of excellence CPU and TRAIL (HR-DTI ANR-10-LABX-57). The authors gratefully acknowledge the support of NVIDIA Corporation with their donation of the TITAN X GPU used in this research.