- From www.coursera.org
Big Data Analysis with Scala and Spark
Course
en
English
28 h
This content is rated 0 out of 5
- Self-paced
- Free Access
- Fee-based Certificate
- 4 Sequences
- Introductive Level
Course details
Syllabus
- Week 1 - Getting Started + Spark Basics
Get up and running with Scala on your computer. Complete an example assignment to familiarize yourself with our unique way of submitting assignments. In this week, we'll bridge the gap between data parallelism in the shared memory scenario (learned in the Para... - Week 2 - Reduction Operations & Distributed Key-Value Pairs
This week, we'll look at a special kind of RDD called pair RDDs. With this specialized kind of RDD in hand, we'll cover essential operations on large data sets, such as reductions and joins. - Week 3 - Partitioning and Shuffling
This week we'll look at some of the performance implications of using operations like joins. Is it possible to get the same result without having to pay for the overhead of moving data over the network? We'll answer this question by delving into how we can par... - Week 4 - Structured data: SQL, Dataframes, and Datasets
With our newfound understanding of the cost of data movement in a Spark job, and some experience optimizing jobs for data locality last week, this week we'll focus on how we can more easily achieve similar optimizations. Can structured data help us? We'll look...
Prerequisite
None.
Instructors
Dr. Heather Miller
Research Scientist
EPFL
Editor
The École polytechnique fédérale de Lausanne (EPFL, English: Swiss Federal Institute of Technology in Lausanne) is a research university in Lausanne, Switzerland, that specialises in physical sciences and engineering.
One of the two Swiss Federal Institutes of Technology, the school was founded by the Swiss Federal Government with the stated mission to:
Educate engineers and scientists to the highest international standing
Be a national center of excellence in science and technology
Provide a hub for interaction between the scientific community and the industry
EPFL is considered one of the most prestigious universities in the world for engineering and sciences, ranking 17th overall and 10th in engineering in the 2015 QS World University Rankings; 34th overall and 12th in engineering in the 2015 Times Higher Education World University Rankings.
Platform
Coursera is a digital company offering massive open online course founded by computer teachers Andrew Ng and Daphne Koller Stanford University, located in Mountain View, California.
Coursera works with top universities and organizations to make some of their courses available online, and offers courses in many subjects, including: physics, engineering, humanities, medicine, biology, social sciences, mathematics, business, computer science, digital marketing, data science, and other subjects.
This content is rated 4.5 out of 5
(no review)This content is rated 4.5 out of 5
(no review)Complete this resource to write a review