You're reading from Cloud Scale Analytics with Azure Data Services Build modern data warehouses on Microsoft Azure

Product type Paperback

Published in Jul 2021

Publisher Packt

ISBN-13 9781800562936

Length 520 pages

Edition 1st Edition

Tools

Azure

Concepts

Data Streaming

Author (1):

Patrik Borosch

View More author details

Table of Contents (20) Chapters

Preface

1. Section 1: Data Warehousing and Considerations Regarding Cloud Computing

2. Chapter 1: Balancing the Benefits of Data Lakes Over Data Warehouses FREE CHAPTER

3. Chapter 2: Connecting Requirements and Technology

4. Section 2: The Storage Layer

5. Chapter 3: Understanding the Data Lake Storage Layer

6. Chapter 4: Understanding Synapse SQL Pools and SQL Options

7. Section 3: Cloud-Scale Data Integration and Data Transformation

8. Chapter 5: Integrating Data into Your Modern Data Warehouse

9. Chapter 6: Using Synapse Spark Pools

10. Chapter 7: Using Databricks Spark Clusters

11. Chapter 8: Streaming Data into Your MDWH

12. Chapter 9: Integrating Azure Cognitive Services and Machine Learning

13. Chapter 10: Loading the Presentation Layer

14. Section 4: Data Presentation, Dashboarding, and Distribution

15. Chapter 11: Developing and Maintaining the Presentation Layer

16. Chapter 12: Distributing Data

17. Chapter 13: Introducing Industry Data Models

18. Chapter 14: Establishing Data Governance

19. Other Books You May Enjoy

Setting up your Cloud Big Data Storage

When you want Azure Data Lake to provision a service within your Azure subscription and you search for it, you will find a service with that exact name. We are not going to use that service, as it is the Generation 1 version of Data Lake Storage and is only there for continuity reasons.

Microsoft added the Data Lake Store Gen2 in kind of a hidden fashion. As this new version of the Data Lake is based on the standard Azure storage account, you will provision it exactly like that: an Azure storage account with an option set for Azure Data Lake Gen2 or, even better, with the Hierarchical Namespace enabled. We will look at this option shortly.

Provisioning a standard storage account instead

When you examine the Azure storage account limits, you might ask yourself, why should I go for a Data Lake Store when the standard Storage Account already has these wide volume boundaries and possibilities?

Well, the standard storage account has it...