Steadybit logoResilience Hub
Try SteadybitGitHub icon
Steadybit logoResilience Hub

Datadog Alerts when a Kubernetes Pod Is in Crash Loop

Use Template

Datadog Alerts when a Kubernetes Pod Is in Crash Loop

Use Template

Datadog Alerts when a Kubernetes Pod Is in Crash Loop

Use Template

Datadog Alerts when a Kubernetes Pod Is in Crash Loop

Use Template
Go back to list

Verify that a Datadog monitor alerts you when pods are not ready to accept traffic for a certain time.

Motivation

Kubernetes features a readiness probe to determine whether your pod is ready to accept traffic. If it isn't becoming ready, Kubernetes tries to solve it by restarting the underlying container and hoping to achieve its readiness eventually. If this isn't working, Kubernetes will eventually back off to restart the container, and the Kubernetes resource remains non-functional.

Structure

First, check that the Datadog monitor responsible for tracking non-ready containers is in an 'okay' state. As soon as one of the containers is crash looping, caused by the crash loop attack, the Datadog monitor should alert and escalate it to your on-call team.

Solution Sketch


Tags
Crash loop
Harden Observability
Datadog
Restart
Kubernetes
GitHub
steadybit/reliability-hub-db/tree/main/templates/datadog.monitor-alerts-on-pod-crash-loop
License
MIT
MaintainerSteadybit
Use Template

How to use this template?

Import via Hub Connection

Steadybit’s Reliability Hub is already connected to your platform. If you are an admin, you can just easily import templates with just one click.

Import template

Are you on-prem?

This is how you import Templates

Import as Experiment

Simply download the template and upload it as an experiment to use it once. Perfect if you are no administrator in the platform and just want to use the template once.

.json (4KB)

Cause Crash Loop

Causes a crash loop in a pod

Attack

Attack

Kubernetes pods

>_ boost your chaos journey Connect Your Hub to Steadybit

Maximise Steadybit potential! Connect your own Hub to the platform and smoothly import your own templates: using them it’s never been this easy!

Steadybit logoResilience Hub
Try Steadybit
© 2024 Steadybit GmbH. All rights reserved.
Twitter iconLinkedIn iconGitHub icon