Get notified when a metric reaches a certain threshold

Seyren is available here:http://graphite.omamatic.com:8080/

It is a simple mechanism to monitor metrics from http://graphite.omamatic.com/ and send messages when they go above or below a certain threshold.

Example

Goal: We wan't to make sure we get notified into slack alerts if Facebook Mention(s) being retreived.

Mentions come fromOpportunityPipeline::Retriever::Facebookand since this is a standard worker that has methods fromOma::Resque::Queuethere exist a metric that counts how many times it ran.

stats.counters.oma_processors.production.opportunity_pipeline.retriever.facebook.process_iteration.success.count

Note how OpportunityPipeline::Retriever::Facebook is represented in the metrics name.

Explaining check's fields

Sum all the count events that happened in the last 24 hours. When the value is below 500 changes state to WARN if below 100 change the state to 100.

• Target: integral(counted_metric)

• From: -24h

• Warn: 500

• Error: 100

Subscription

See how the subscription is defined it's quite self explanatory the only part to understand there is how to write down the channel to which it should notify to.