Part 1 – Introduction to Data Engineering, Scala, and an Environment Setup

In this part, Chapter 1 introduces Scala’s significance in data engineering, emphasizing its type safety and native compatibility with Spark. It covers key concepts such as functional programming, objects, classes, and higher-order functions. Moving to Chapter 2, it contrasts two data engineering environments – a cloud-based setup offering portability and easy access with associated maintenance costs, and a local machine utilization option requiring setup but avoiding cloud expenses.

This part has the following chapters:

• Chapter 1, Scala Essentials for Data Engineers
• Chapter 2, Environment Setup