You're reading from Azure Data Engineering Cookbook Get well versed in various data engineering techniques in Azure using this recipe-based guide

Product type Paperback

Published in Sep 2022

Publisher Packt

ISBN-13 9781803246789

Length 608 pages

Edition 2nd Edition

Languages

SQL

Tools

Azure

Concepts

Data Engineering

Authors (3):

Ahmad Osama

Nagaraj Venkatesan

Luca Zanna

View More author details

Table of Contents (16) Chapters

Preface

1. Chapter 1: Creating and Managing Data in Azure Data Lake

2. Chapter 2: Securing and Monitoring Data in Azure Data Lake FREE CHAPTER

3. Chapter 3: Building Data Ingestion Pipelines Using Azure Data Factory

4. Chapter 4: Azure Data Factory Integration Runtime

5. Chapter 5: Configuring and Securing Azure SQL Database

6. Chapter 6: Implementing High Availability and Monitoring in Azure SQL Database

7. Chapter 7: Processing Data Using Azure Databricks

8. Chapter 8: Processing Data Using Azure Synapse Analytics

9. Chapter 9: Transforming Data Using Azure Synapse Dataflows

10. Chapter 10: Building the Serving Layer in Azure Synapse SQL Pool

11. Chapter 11: Monitoring Synapse SQL and Spark Pools

12. Chapter 12: Optimizing and Maintaining Synapse SQL and Spark Pools

13. Chapter 13: Monitoring and Maintaining Azure Data Engineering Pipelines

14. Index

Why subscribe?

15. Other Books You May Enjoy

Using Kusto queries to monitor SQL and Spark pools

In the previous two recipes (Configuring a Log Analytics workspace for Synapse dedicated SQL pools and Configuring a Log Analytics workspace for Synapse Spark pools), we created a Log Analytics workspace and configured the diagnostics logs of Synapse-dedicated SQL and Spark pools to be written to it. In this recipe, we will use Kusto queries to query a Log Analytics workspace to gain insights into the diagnostic logs collected.

Getting ready

To get started, log in to https://portal.azure.com using your Azure credentials:

Complete the Configuring a Log Analytics workspace for Synapse dedicated SQL Pools and Configuring a Log Analytics workspace for Synapse Spark pools recipes covered earlier in this chapter to configure a Log Analytics workspace for Synapse SQL and Spark pool.
Complete the Loading data into a dedicated SQL pool using PolyBase and T-SQL recipe of Chapter 10, Building the Serving Layer in Azure Synapse...

The rest of the chapter is locked

You're reading from Azure Data Engineering Cookbook Get well versed in various data engineering techniques in Azure using this recipe-based guide

Table of Contents (16) Chapters

Using Kusto queries to monitor SQL and Spark pools

Getting ready

Authors (2)

Personalised recommendations for you

You're reading from Azure Data Engineering Cookbook Get well versed in various data engineering techniques in Azure using this recipe-based guide

Table of Contents (16) Chapters

Using Kusto queries to monitor SQL and Spark pools

Getting ready

Unlock this book and the full library FREE for 7 days

Authors (2)

Personalised recommendations for you