Summary

In this chapter, we learned about MapReduce processing and overall processing works internally. We also looked into how MapReduce jobs are submitted to YARN and how YARN works to make sure your MapReduce job runs with efficiency and delivers status to you on successful completion. In the latter half of the chapter, we covered different design patterns that are commonly used in the industry and also covered basic templates to use these patterns.

In the next chapter, we will look into various Hadoop components added for efficient processing over HDFS. We will also look into some of the SQL engines used for data analytics and report generation.