DualPrune: A Dual Purpose Pruning of Convolutional Neural Networks for Resource-Constrained Devices

Abstract:

Many successful applications of deep learning have been witnessed in various domains. However, the use of deep learning models in edge-devices is still limited. Deploying a large model onto small devices for real-time inference requires an adequate amount of resources. In the last couple of years, pruning has evolved as an important and widely used technique to reduce the inference cost and compress the storage-intensive deep learning models for small devices. In this paper, we proposed a novel dual-purpose pruning approach to accelerate the model performance and reduce the storage requirement of the model. The experiments on the CIFAR10 dataset with AlexNet and VGG16 models show that our proposed approach is effective and can be used to make the deployment of the trained model easier for edge-devices with marginal loss of accuracy. For the VGG16 experiment, our approach reduces parameters from 14.98M to 3.7M resulting in a 74.73% reduction in floating-point operations with only 0.8% loss in the accuracy. Read More

Publication: Communications in Computer and Information Science

Publisher: Springer Link

Authors: Tejalal Choudhary, Vipul Mishra, Anurag Goswami

Keywords: Deep Neural Network, Pruning, Model acceleration and compression, Resource-constrained devices

Meet one of the Author:

Dr Tejalal Choudhary received his Ph.D. in Computer Science Engineering from Bennett University in Greater Noida, India. He has expertise in computer vision, machine learning, deep learning, and model compression. His exceptional ability to think creatively, tackle problems from multiple angles, and generate innovative solutions sets him apart from others.

Dr. Tejalal Choudhary

Affiliations:

Bennett University, Greater Noida, India – Bennett University was established in the year 2016 by the Times Group which is India’s largest media conglomerate, to provide Ivy League quality education to undergraduate and postgraduate students. The six schools with 30+ programs and 70+ leading specialisations in Engineering, Management, Media, Law and Liberal Arts have positioned it as one of the top universities in India.

Missouri University of Science and Technology –Missouri University of Science and Technology (Missouri S&T) is a world-class technological research university. Founded in 1870 as one of the first technological schools west of the Mississippi, Missouri S&T offers a broad array of degrees in engineering, the sciences, business, information technology, the humanities and liberal arts, and education — all in an environment that emphasizes technological literacy.

University College London, London, UK – University College London, which operates as UCL, is a public research university in London, England. It is a member institution of the federal University of London, and is the second-largest university in the United Kingdom by total enrolment and the largest by postgraduate enrolment.