Optimizing Neural Networks for Embedded Hardware

Domenik Helms, Karl Amende, Saqib Bukhari, Thies de Graaff, Alexander Frickenstein, Frank Hafner, Tobias Hirscher, Sven Mantowsky, Georg Schneider, Manoj-Rohit Vemparala
Proceedings of the 2021 Conference on Synthesis, Modeling, Analysis and Simulation Methods and Applications to Circuit Design
Neural networks are a pervasive technology, whichis, however, still held back in the area of embedded systems bythe high resource requirements, especially memory size, memoryaccess time and power dissipation. In recent years, severaldifferent methods have been proposed to transform given neuralnetworks in such a way that they can get by with much fewerresources while maintaining almost the same accuracy. This workreviews, categorizes and describes the state of the art in adaptingand simplifying neural networks to make them better applicableto embedded systems. Even though we developed this study froma purely automotive context, the techniques described are alsovalid in other areas.
July / 2021