Big Data Integration and Processing
list 6 séquences
assignment Niveau : Introductif
chat_bubble_outline Langue : Anglais
card_giftcard 160 points
Logo My Mooc Business

Ils choisissent Edflex pour développer les compétences en entreprise.

En savoir plus
Avis de la communauté
-
starstarstarstarstar
Voir l'avis

Les infos clés

credit_card Formation gratuite
verified_user Certification payante
timer 20 heures de cours

En résumé

At the end of the course, you will be able to: *Retrieve data from example database and big data management systems *Describe the connections between data management operations and the big data processing patterns needed to utilize them in large-scale analytical applications *Identify when a big data problem needs data integration *Execute simple big data integration and processing on Hadoop and Spark platforms This course is for those new to data science. Completion of Intro to Big Data is recommended. No prior programming experience is needed, although the ability to install applications and utilize a virtual machine is necessary to complete the hands-on assignments. Refer to the specialization technical requirements for complete hardware and software specifications. Hardware Requirements: (A) Quad Core Processor (VT-x or AMD-V support recommended), 64-bit; (B) 8 GB RAM; (C) 20 GB disk free. How to find your hardware information: (Windows): Open System by clicking the Start button, right-clicking Computer, and then clicking Properties; (Mac): Open Overview by clicking on the Apple menu and clicking “About This Mac.” Most computers with 8 GB RAM purchased in the last 3 years will meet the minimum requirements.You will need a high speed internet connection because you will be downloading files up to 4 Gb in size. Software Requirements: This course relies on several open-source software tools, including Apache Hadoop. All required software can be downloaded and installed free of charge (except for data charges from your internet provider). Software requirements include: Windows 7+, Mac OS X 10.10+, Ubuntu 14.04+ or CentOS 6+ VirtualBox 5+.

more_horiz Lire plus
more_horiz Lire moins
dns

Le programme

  • Week 1 - Welcome to Big Data Integration and Processing
    Welcome to the third course in the Big Data Specialization. This week you will be introduced to basic concepts in big data integration and processing. You will be guided through installing the Cloudera VM, downloading the data sets to be used for this course, ...
  • Week 1 - Retrieving Big Data (Part 1)
    This module covers the various aspects of data retrieval and relational querying. You will also be introduced to the Postgres database.
  • Week 2 - Retrieving Big Data (Part 2)
    This module covers the various aspects of data retrieval for NoSQL data, as well as data aggregation and working with data frames. You will be introduced to MongoDB and Aerospike, and you will learn how to use Pandas to retrieve data from them.
  • Week 3 - Big Data Integration
    In this module you will be introduced to data integration tools including Splunk and Datameer, and you will gain some practical insight into how information integration processes are carried out.
  • Week 4 - Processing Big Data
    This module introduces Learners to big data pipelines and workflows as well as processing and analysis of big data using Apache Spark.
  • Week 5 - Big Data Analytics using Spark
    In this module, you will go deeper into big data processing by learning the inner workings of the Spark Core. You will be introduced to two key tools in the Spark toolkit: Spark MLlib and GraphX.
  • Week 6 - Learn By Doing: Putting MongoDB and Spark to Work
    In this module you will get some practical hands-on experience applying what you learned about Spark and MongoDB to analyze Twitter data.
record_voice_over

Les intervenants

Ilkay Altintas
Chief Data Science Officer
San Diego Supercomputer Center

Amarnath Gupta
Director, Advanced Query Processing Lab
San Diego Supercomputer Center (SDSC)

store

Le concepteur

University of California, San Diego
UC San Diego is an academic powerhouse and economic engine, recognized as one of the top 10 public universities by U.S. News and World Report. Innovation is central to who we are and what we do. Here, students learn that knowledge isn't just acquired in the classroom—life is their laboratory.
assistant

La plateforme

Coursera

Coursera est une entreprise numérique proposant des formations en ligne ouverte à tous fondée par les professeurs d'informatique Andrew Ng et Daphne Koller de l'université Stanford, située à Mountain View, Californie.

Ce qui la différencie le plus des autres plateformes MOOC, c'est qu'elle travaille qu'avec les meilleures universités et organisations mondiales et diffuse leurs contenus sur le web.

Vous êtes le concepteur de ce MOOC ?
Quelle note donnez-vous à cette ressource ?
Contenu
5/5
Plateforme
5/5
Animation
5/5