Designing Reconfigurable Large-Scale Deep Learning Systems Using Stochastic Computing
Abstract
Deep Learning, as an important branch of machine learning and neural network, is playing an increasingly important role in a number of fields like computer vision, natural language processing, etc. However, large-scale deep... [ view full abstract ]
Deep Learning, as an important branch of machine learning and neural network, is playing an increasingly important role in a number of fields like computer vision, natural language processing, etc. However, large-scale deep learning systems mainly operate in high-performance server clusters, thus restricting the application extensions to personal or mobile devices. The solution proposed in this paper is taking advantage of the fantastic features of stochastic computing methods. Stochastic computing is a type of data representation and processing technique, which uses a binary bit stream to represent a probability number (by counting the number of ones in this bit stream). In the stochastic computing area, some key arithmetic operations such as additions or multiplications can be implemented with very simple components like AND gates or multiplexers, respectively. Thus it provides an immense design space for integrating a large amount of neurons and enabling fully parallel and scalable hardware implementations of large-scale deep learning systems. In this paper, we present a reconfigurable large-scale deep learning system based on stochastic computing technologies, including the design of the neuron, the convolution function, the back-propagation function and some other basic operations.
Authors
-
Ao Ren
(Syracuse University)
-
Zhe Li
(Syracuse University)
-
Yanzhi Wang
(Syracuse University)
-
Qinru Qiu
(Syracuse University)
-
Bo Yuan
(City University of New York)
Topic Areas
Topics: Neuromorphic, or “brain inspired”, computing , Topics: Error-tolerant logic and circuits , Topics: Approximate and stochastic computing
Session
OS-06B » Neuromorphic 4 (15:30 - Tuesday, 18th October, Del Mar Ballroom AB)
Paper
ID053_ICRC2016_finalpaper.pdf
Presentation Files
The presenter has not uploaded any presentation files.