You're reading from Infrastructure Monitoring with Amazon CloudWatch Effectively optimize resource allocation, detect anomalies, and set automated actions on AWS

Product type Paperback

Published in Apr 2021

Publisher Packt

ISBN-13 9781800566057

Length 314 pages

Edition 1st Edition

Tools

Amazon CloudWatch

Concepts

Infrastructure Management

Author (1):

Ewere Diagboya

View More author details

Table of Contents (16) Chapters

Preface

1. Section 1: Introduction to Monitoring and Amazon CloudWatch

2. Chapter 1: Introduction to Monitoring FREE CHAPTER

3. Chapter 2: CloudWatch Events and Alarms

4. Chapter 3: CloudWatch Logs, Metrics, and Dashboards

5. Section 2: AWS Services and Amazon CloudWatch

6. Chapter 4: Monitoring AWS Compute Services

7. Chapter 5: Setting Up Container Insights on Amazon CloudWatch

8. Chapter 6: Performance Insights for Database Services

9. Chapter 7: Monitoring Serverless Applications

10. Chapter 8: Using CloudWatch for Maintaining Highly Available Big Data Services

11. Chapter 9: Monitoring Storage Services with Amazon CloudWatch

12. Chapter 10: Monitoring Network Services

13. Chapter 11: Best Practices and Conclusion

14. Assessments

15. Other Books You May Enjoy

Monitoring AWS Glue jobs with CloudWatch alarms

AWS Glue is a serverless service used to perform ETL operations in AWS. Glue connects to multiple data sources to retrieve and transform data into different structures and formats. AWS Glue is easy to use and makes it faster to perform a transformation using Python or Scala, which are the two main options within Glue. Glue also has a very deep integration with Athena. The tables in Athena can be read within Glue and used for further ETL processes.

We shall do a simple example of transforming the data we queried previously in Athena: using a CloudTrail trail. We will create a Glue job that transforms the original data, compresses it to a different data format (Parquet), and writes it to another S3 bucket. Then, we can see the logs and activities and the different metrics used to measure the success or failure of a Glue job. These are the steps to create a Glue job: