Explore Products

Best Sellers

New Releases

Books

Videos

Audiobooks

Learning Hub

Free Learning

You're reading from Mastering Hadoop 3 Big data processing at scale to unlock unique business insights

Product type Paperback

Published in Feb 2019

Publisher Packt

ISBN-13 9781788620444

Length 544 pages

Edition 1st Edition

Languages

Java

Tools

Hadoop

Concepts

Big Data

Authors (3):

Timothy Wong

Manish Kumar

Chanchal Singh

View More author details

Table of Contents (21) Chapters

Preface

1. Section 1: Introduction to Hadoop 3 FREE CHAPTER

2. Journey to Hadoop 3

3. Deep Dive into the Hadoop Distributed File System

4. YARN Resource Management in Hadoop

5. Internals of MapReduce

6. Section 2: Hadoop Ecosystem

7. SQL on Hadoop

8. Real-Time Processing Engines

9. Widely Used Hadoop Ecosystem Components

10. Section 3: Hadoop in the Real World

11. Designing Applications in Hadoop

12. Real-Time Stream Processing in Hadoop

13. Machine Learning in Hadoop

14. Hadoop in the Cloud

15. Hadoop Cluster Profiling

16. Section 4: Securing Hadoop

17. Who Can Do What in Hadoop

18. Network and Data Security

19. Monitoring Hadoop

20. Other Books You May Enjoy

Leave a review - let other readers know what you think

Pig

Hadoop had MapReduce as a processing engine when it first started and Java was the primary language that was used for writing MapReduce jobs. Since Hadoop was mostly used as an analytics processing framework, large chunks of use cases involved data mining on legacy data warehouses. These data warehouse applications were migrated to use Hadoop. Most users using legacy data warehouses had SQL and that was their core expertise. Learning a new programming language was time-consuming. Therefore, it is better to have a framework that can help SQL skilled people to write MapReduce jobs in an SQL-like language. Apache Pig was invented for this purpose. It also solved the complexity of writing multiple MapReduce pipeline jobs where output of one job becomes the input to another. the

Apache Pig is a distributed processing tool that is an abstraction over MapReduce and is used...

The rest of the chapter is locked

A free Packt account unlocks extra newsletters, articles, discounted offers, and much more. Start advancing your knowledge today.

Unlock this book and the full library FREE for 7 days

Get unlimited access to 7000+ expert-authored eBooks and videos courses covering every tech area you can think of

Start free trial

Renews at $19.99/month. Cancel anytime

Authors (3)

Singh

Contacted on 12/01/18 by Davis Anto

See other products by Singh

Wong

Dr. Timothy Wong is a 30 years IT veteran. He holds a PhD in networking from University of Manchester Institute of Science and Technology, UK. He has deep experience in wireless and wireline networking, digital a/v, software development, sales and consulting. He frequently works with telcos, banks, governments and enterprises. He is also a professor on Big Data, Wireless and IoT at Humber College, Toronto, Canada. As an entrepreneur, he co-founded a number of companies in the past 20 years. He infuses business and technical knowledge to pursue successes.

See other products by Wong

Kumar

Ashish Kumar is a seasoned data science professional, a publisher author and a thought leader in the field of data science and machine learning. An IIT Madras graduate and a Young India Fellow, he has around 7 years of experience in implementing and deploying data science and machine learning solutions for challenging industry problems in both hands-on and leadership roles. Natural Language Procession, IoT Analytics, R Shiny product development, Ensemble ML methods etc. are his core areas of expertise. He is fluent in Python and R and teaches a popular ML course at Simplilearn. When not crunching data, Ashish sneaks off to the next hip beach around and enjoys the company of his Kindle. He also trains and mentors data science aspirants and fledgling start-ups.

See other products by Kumar