RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación
Contribución de congreso (ConferenceOutput)
Towards a Low-Rank Approach to Compress Deep Neural Networks
[EN] In this work, we introduce a low-rank approach based on the truncated Singular Value Decomposition (SVD) technique to make deep neural networks (DNNs) smaller. Our method focuses on reducing the overall physical size of a neural network model without losing much in terms of its accuracy or increasing its error noticeably. Specifically, we applied our technique to a modified MobileNetV2 model, in the context of automatic plant diseases detection. We chose two of the biggest layers of the model and compressed them. Our goal was to see how this compression affects the breakdown of the layers, the error in rebuilding the layers, and how well the modified model performs. The results showed that the smaller model still predicts very accurately, even with the reduced physical size of its layers. By making these layers smaller, our approach offers a practical way to handle the deployment of large neural networks, especially in devices with limited resources, without compromising their effectiveness., This work was partially supported with grants TED2021-131295B-C32, PID2021-123673OB-C31 funded by MCIN/AEI/ 10.13039/
501100011033 and by ERDF A way of making Europe , PROMETEO grant CIPROM/2021/077 from the Conselleria de Innovación, Universidades, Ciencia y Sociedad Digital - Generalitat Valenciana, Early Research Project grant PAID-06-23
by the Vice Rectorate Office for Research from Universitat Politècnica de València (UPV)