VOOZH about

URL: https://arxiv.org/abs/1908.11348

⇱ [1908.11348] Survey and Benchmarking of Machine Learning Accelerators

Computer Science > Performance

arXiv:1908.11348 (cs)
[Submitted on 29 Aug 2019]

Title:Survey and Benchmarking of Machine Learning Accelerators

View PDF
Abstract:Advances in multicore processors and accelerators have opened the flood gates to greater exploration and application of machine learning techniques to a variety of applications. These advances, along with breakdowns of several trends including Moore's Law, have prompted an explosion of processors and accelerators that promise even greater computational and machine learning capabilities. These processors and accelerators are coming in many forms, from CPUs and GPUs to ASICs, FPGAs, and dataflow accelerators. This paper surveys the current state of these processors and accelerators that have been publicly announced with performance and power consumption numbers. The performance and power values are plotted on a scatter graph and a number of dimensions and observations from the trends on this plot are discussed and analyzed. For instance, there are interesting trends in the plot regarding power consumption, numerical precision, and inference versus training. We then select and benchmark two commercially-available low size, weight, and power (SWaP) accelerators as these processors are the most interesting for embedded and mobile machine learning inference applications that are most applicable to the DoD and other SWaP constrained users. We determine how they actually perform with real-world images and neural network models, compare those results to the reported performance and power consumption values and evaluate them against an Intel CPU that is used in some embedded applications.
Comments: 9 pages, 3 figures, IEEE-HPEC conference, Waltham, MA, September 24-26, 2019
Subjects: Performance (cs.PF)
ACM classes: B.8; C.4
Cite as: arXiv:1908.11348 [cs.PF]
(or arXiv:1908.11348v1 [cs.PF] for this version)
https://doi.org/10.48550/arXiv.1908.11348
arXiv-issued DOI via DataCite
Related DOI: https://doi.org/10.1109/HPEC.2019.8916327
DOI(s) linking to related resources

Submission history

From: Albert Reuther PhD [view email]
[v1] Thu, 29 Aug 2019 16:54:49 UTC (727 KB)
Full-text links:

Access Paper:

  • View PDF
  • TeX Source

Current browse context:

cs.PF
< prev   |   next >
Change to browse by:
cs

References & Citations

BibTeX formatted citation

Data provided by:

Bibliographic and Citation Tools

Bibliographic Explorer (What is the Explorer?)
Connected Papers (What is Connected Papers?)
Litmaps (What is Litmaps?)
scite Smart Citations (What are Smart Citations?)

Code, Data and Media Associated with this Article

alphaXiv (What is alphaXiv?)
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub (What is DagsHub?)
Gotit.pub (What is GotitPub?)
Hugging Face (What is Huggingface?)
ScienceCast (What is ScienceCast?)

Demos

Replicate (What is Replicate?)
Hugging Face Spaces (What is Spaces?)
TXYZ.AI (What is TXYZ.AI?)

Recommenders and Search Tools

Influence Flower (What are Influence Flowers?)
CORE Recommender (What is CORE?)

arXivLabs: experimental projects with community collaborators

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.