Spark Scala Coding Framework, Testing, Structured Streaming — Udemy — Last updated 9/2020 — Free download

Spark Scala Framework, Hive, IntelliJ, Maven, Logging, Exception Handling, log4j, ScalaTest, JUnit, Structured Streaming

What you’ll learn

  • Spark Scala industry standard coding practices – Logging, Exception Handling, Reading from Configuration File
  • Unit Testing Spark Scala using JUnit , ScalaTest, FlatSpec & Assertion
  • Building a data pipeline using Hive, Spark and PostgreSQL
  • Spark Scala development with Intellij, Maven
  • Cloudera QuickStart VM setup on GCP

Requirements

  • Basic Big Data, Spark knowledge required
Description

This course will bridge the gap between your academic and real world knowledge and prepare you for an entry level Big Data Spark Scala developer role. You will learn the following

  • Spark Scala coding best practices
  • Logging – log4j, slf4
  • Exception Handling
  • Configuration using Typesafe config
  • Doing development work using IntelliJ, Maven
  • Using your local environment as a Hadoop Hive environment
  • Reading and writing to a Postgres database using Spark
  • Unit Testing Spark Scala using JUnit , ScalaTest, FlatSpec & Assertion
  • Building a data pipeline using Hadoop , Spark and Postgres
  • Bonus – Setting up Cloudera QuickStart VM on Google Cloud Platform (GCP)
  • Structured Streaming

Prerequisites :

  • Basic programming skills
  • Basic database knowledge
  • Big Data and Spark entry level knowledge

Who this course is for:

  • Students looking at moving from Big Data Spark academic background to a real world developer role

DOWNLOAD

Spark_Scala_Coding_Framework__Testing__Structured_Streaming.part2.rar   (download)
494.88 MB

Course content: https://www.udemy.com/course/spark-scala-coding-best-practices-data-pipeline/

  • Sundryshare.COM is our file hosting service, please support us to maintain service by becoming premium membership. Cheers!
  • Please leave a comment to report if files missing or downloaded files don't work by reasons such as: error with errors uncompress/unzip/unrar, broken files... We will check and update new download links ASAP!
  • Archives don’t open, and are corrupt? Don't be worried! Problem was with WinRAR, Used 7-Zip instead.
0 0 vote
Article Rating
Subscribe
Notify of
guest
0 Comments
Inline Feedbacks
View all comments