Waking People Up for Nothing: The Hidden Cost of Bad Alerting
Let’s set the scene. Your company has asked your team to implement alerting. You added monitoring, and now the product owner wants the on-call engineer to be notified whenever something goes wrong. You implemented an alert that triggers whenever a Kubernetes pod fails. However, pod failures can occur for