Explore Products

Best Sellers

New Releases

Books

Videos

Audiobooks

Learning Hub

Free Learning

You're reading from Learning AWS Design, build, and deploy responsive applications using AWS Cloud components

Product type Paperback

Published in Feb 2018

Publisher Packt

ISBN-13 9781787281066

Length 412 pages

Edition 2nd Edition

Tools

AWS

Concepts

Cloud Computing

Authors (2):

Amit Shah

Aurobindo Sarkar

View More author details

Table of Contents (12) Chapters

Preface

1. Cloud 101 – Understanding the Basics

2. Designing Cloud Applications FREE CHAPTER

3. Introducing AWS Components

4. Designing for and Implementing Scalability

5. Designing for and Implementing High Availability

6. Designing for and Implementing Security

7. Deploying to Production and Going Live

8. Designing a Big Data Application

9. Implementing a Big Data Application

10. Deploying a Big Data System

11. Other Books You May Enjoy

Leave a review - let other readers know what you think

Configuring and using EMR-Spark clusters

In this section, we will present two simple examples of EMR clusters suitable for basic Spark development. In the first example, we will spin up an EMR cluster, start the Spark shell, and do some Spark-Scala work. In the second example, we will spin up an EMR cluster and run a simple Spark program.

Follow the step-by-step instructions specified next for this hands-on exercise:

We will use the Create Cluster - Quick Options for selecting the options for our cluster. Specify a name for the cluster (FirstEMRSparkClusterUsingQuickOptions). Choose Launch mode as Cluster:

In the Software configuration section, ensure you have selected the latest available version of EMR and select the Spark option:

Leave the defaults for Hardware...

The rest of the chapter is locked

A free Packt account unlocks extra newsletters, articles, discounted offers, and much more. Start advancing your knowledge today.

Unlock this book and the full library FREE for 7 days

Get unlimited access to 7000+ expert-authored eBooks and videos courses covering every tech area you can think of

Start free trial

Renews at $19.99/month. Cancel anytime

Authors (2)

Sarkar

Aurobindo Sarkar leads a team of data scientists and engineers at Session AI, developing cloud-based ML models for in-session marketing in e-commerce and retail. As a former CTO at multiple SaaS startups, he has architected secure, scalable, and highly available AWS cloud applications. His research interests now focus on AWS-based large-scale transformer models for NLP and HFT models for the futures and options market. Aurobindo holds a bachelor's degree in engineering from IIT Delhi, a master's in management from the Indian Institute of Science Bangalore, and a master's in computer science from New York University.

See other products by Sarkar

Shah

Snehal Shah has extensive experience in implementing enterprise web applications using J2EE technologies. He is the co-founder of Techforce Infotech where he has worked on various J2EE based solutions, various open source product customizations, and worked on business expansion. He was also involved in building a team and finalizing the technology path for the organization. At his previous employer, CIGNEX Datamatics, he rolled out numerous Alfresco deployments worldwide in the areas of document management, web content management, and Share. He has also worked on application-based Liferay and Moodle products. Prior to CIGNEX, he has worked on various J2EE-based solutions using cutting edge technologies. He has worked with clients in education, legal, and marketing domains across the world. He has worked on defining architecture for various projects, which involves multiple product integrations. In his previous organizations, he was involved in deciding the technology path of the organization and was also involved in various internal technical training. He holds a Bachelors Degree in Computer Engineering from Deemed University, DDIT India. He has also worked as a Technical Reviewer for the books Alfresco 3 Cookbook and Alfresco Share.

See other products by Shah