Prometheus Alerting Gotchas - Detecting No Events

Prometheus has become our de facto monitoring tool at Fresh8 for a number of reasons; it’s built in golang and open source, it’s built by SoundCloud, and it has a concept of labels which, in my mind, makes it far superior to statsd. There are some areas, however, that seem a bit more tricky to work with. Prometheus allows you to set up a number of alerts using rulesets, and has a separate Alert Manager to monitor these alerts separate to Prometheus itself. »