Understanding the data ingestion pipeline in Azure Monitor

Azure Monitor offers a unified data platform that aggregates data from various sources, as previously discussed. To address the complexity of differing data delivery methods and separate configurations, Azure Monitor is evolving its original ingestion architecture into a new extract, transform, and load (ETL)-like data collection pipeline. This latest development unifies data source destinations, allows initial transformation before ingestion, simplifies the configuration process across data sources, and eases integration with infrastructure management solutions built on the infrastructure-as-code paradigm.

In the previous section, we introduced the main concepts of the new ETL-like platform. In this section, we’ll analyze in more detail the fundamental components and their configuration.

Data collection pipeline and DCRs

At the beginning of this chapter, we described how Azure Monitor consolidates data from...