Monitoring

We have our metrics flowing into Prometheus. We also have a way of exploring and visualizing them. The next step should probably be to configure some sort of alerts, so that we show other people we are doing real work.

Alerting with Prometheus

	ALERTING OVERVIEW Alerting with Prometheus is separated into two parts. Alerting rules in Prometheus servers send alerts to an Alertmanager. The Alertmanager then manages those alerts, including silencing, inhibition, aggregation and sending out notifications via methods such as e-mail, PagerDuty and HipChat. The main steps to setting up alerting and notifications are: - Setup and configure the Alertmanager - Configure Prometheus to talk to the Alertmanager with the-alertmanager.url flag - Create alerting rules in Prometheus
	--https://prometheus.io/docs/alerting/overview/

Let us break this down.

We already have Alertmanager running with some minimal configuration in /opt/prometheus/alertmanager/alertmanager.yml.

Our Prometheus instance...