Fast and Accurate Output Error Estimation for Memristor-Based Deep Neural Networks - IMT Atlantique Accéder directement au contenu
Article Dans Une Revue IEEE Transactions on Signal Processing Année : 2024

Fast and Accurate Output Error Estimation for Memristor-Based Deep Neural Networks

Résumé

Memristors allow computing in memory, which may be leveraged by deep neural network (DNN) accelerators to reduce energy footprint. However, such gains in energy efficiency come at the cost of noise on the computation results due to the analog nature of memristors. In this work, we introduce a theoretical framework to estimate the mean squared error (MSE) of a memristor-based DNN. We propose an efficient software implementation of this framework which is shown to be orders of magnitude faster than using Monte-Carlo simulations. Additionally, we study two different techniques for mapping convolutional layers to memristors and compare their relative impact on the mean squared error and its computation time. The accuracy of the proposed analysis is first evaluated on a simple regression problem, and then on a more complex classification task with a network capable of achieving high accuracy on the CIFAR-10 dataset, which shows that our method is efficient over practical up-to-date DNNs. The proposed framework is then used to perform a meta-heuristic optimization of the memristor maximal conductance value so as to minimize the energy usage
Fichier principal
Vignette du fichier
Kern24SP.pdf (716.53 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Licence : CC BY - Paternité

Dates et versions

hal-04516479 , version 1 (22-03-2024)

Licence

Paternité

Identifiants

Citer

Jonathan Kern, Sébastien Henwood, Gonçalo Mordido, Elsa Dupraz, Abdeldjalil Aïssa-El-Bey, et al.. Fast and Accurate Output Error Estimation for Memristor-Based Deep Neural Networks. IEEE Transactions on Signal Processing, 2024, 72, pp.1205-1218. ⟨10.1109/TSP.2024.3369423⟩. ⟨hal-04516479⟩
2 Consultations
1 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More