This event has ended. Create your own event → Check it out
This event has ended. Create your own
Register Now for ApacheCon Europe 2014 - November 17-21 in Budapest, Hungary. 

View analytic
Tuesday, November 18 • 3:50pm - 4:40pm
Improving Spark Application Performance - William Benton, Red Hat

Sign up or log in to save this to your schedule and see who's attending!

Apache Spark presents an elegant and powerful set of high-level abstractions for developing distributed data-processing applications.  Analysts who use Spark can rapidly prototype applications and experiment with new techniques at scale.  However, to make the most of Spark, developers need to understand both the abstractions and how Spark will schedule and execute their code.  

This talk will show you how to improve Spark application performance by working with, not against, Spark's operational model.  We'll start with a real prototype Spark application and apply several simple, generally applicable transformations to make it more efficient and scalable.  For each transformation, we'll look both at *why* it works, considering the relevant details of Spark's internals, and *how well* it works, considering its impact on overall application performance.  You'll leave this talk with an improved understanding of how Spark runs your code and some additional tools to make your big data apps even more efficient.

avatar for William Benton

William Benton

Red Hat, Inc.
William Benton works at Red Hat in the Office of the CTO on distributed computing technologies; his recent efforts include contributing to Apache Spark and integrating Spark into the Fedora ecosystem. His professional expertise includes research and development in the areas of static program analysis, managed language runtimes, logic databases, cluster management, and music technology. Benton holds a PhD in computer sciences from the University... Read More →

Tuesday November 18, 2014 3:50pm - 4:40pm

Attendees (28)