Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Identifying the potential of Near Data Processing for Apache Spark
KTH, School of Information and Communication Technology (ICT), Software and Computer systems, SCS.
KTH, School of Information and Communication Technology (ICT), Software and Computer systems, SCS.
Show others and affiliations
2017 (English)In: ACM International Conference Proceeding Series, Association for Computing Machinery (ACM), 2017, p. 60-67, article id F131197Conference paper, Published paper (Refereed)
Abstract [en]

While cluster computing frameworks are continuously evolving to provide real-time data analysis capabilities, Apache Spark has managed to be at the forefront of big data analytics for being a unified framework for both, batch and stream data processing. There is also a renewed interest in Near Data Processing (NDP) due to technological advancement in the last decade. However, it is not known if NDP architectures can improve the performance of big data processing frameworks such as Apache Spark. In this paper, we build the case of NDP architecture comprising programmable logic based hybrid 2D integrated processing-in-memory and instorage processing for Apache Spark, by extensive profiling of Apache Spark based workloads on Ivy Bridge Server.

Place, publisher, year, edition, pages
Association for Computing Machinery (ACM), 2017. p. 60-67, article id F131197
Keywords [en]
Processing-in-memory, In-storage Processing, Apache Spark
National Category
Electrical Engineering, Electronic Engineering, Information Engineering
Research subject
Information and Communication Technology
Identifiers
URN: urn:nbn:se:kth:diva-211727DOI: 10.1145/3132402.3132427Scopus ID: 2-s2.0-85033586379ISBN: 9781450353359 (print)OAI: oai:DiVA.org:kth-211727DiVA, id: diva2:1130759
Conference
2017 International Symposium on Memory Systems, MEMSYS 2017, Washington, United States, 2 October 2017 through 5 October 2017
Note

QC 20171124

Available from: 2017-08-11 Created: 2017-08-11 Last updated: 2018-06-19Bibliographically approved

Open Access in DiVA

fulltext(726 kB)248 downloads
File information
File name FULLTEXT02.pdfFile size 726 kBChecksum SHA-512
e759bf1a5ae90d7f569c2a4be2b91f318aa1a9e6355da861ed7b4e8eb51a0de2c5e1f01b692b0ccccdf465e7aeb9c55e6eef05db0a65580d4b5725fa91214d38
Type fulltextMimetype application/pdf

Other links

Publisher's full textScopus

Search in DiVA

By author/editor
Awan, Ahsan JavedBrorsson, Mats
By organisation
Software and Computer systems, SCS
Electrical Engineering, Electronic Engineering, Information Engineering

Search outside of DiVA

GoogleGoogle Scholar
Total: 263 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
isbn
urn-nbn

Altmetric score

doi
isbn
urn-nbn
Total: 413 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • harvard1
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf