Monitoring Databricks
Azure Monitor is the Azure-wide log collection service that enables you to collect, analyze, and correlate logs from Azure, but also from on-premises applications. With Azure Monitor, you will be able to analyze not just one particular service, but bring together information from a wider context, and with this, develop a new level of understanding and insights.
As Azure Databricks is not (yet) natively integrated with Azure Monitor, your applications will need to use an additional library to inject your log events into the Log Analytics workspace of Azure Monitor. Microsoft provides a GitHub repository where you can download and build the required library to be used in your code. You can find the link to the documentation in the Further reading, Monitoring Databricks, section.
