Visualize Dead Letter Counts in RabbitMQ Deployed in AKS

 Using the prometheus data obtained by "Enabling Prometheus Data Scraping for RabbitMQ Cluster Deployed with RabbitMQ Cluster Operator on AKS with Managed Prometheus", let's create grafana chart to view any messages land in dead letter queues in the RabbitMQ cluster deployed in AKS.

The expection is to have a chart as shown below.

First the naming pattern of your dead letter queues is important. You can name a dead letter queue for a given queue with a suffix such as .dlq  or .deadletter.

For example if queue has name queuename then dead letter queue of it can be named as below.

queuename.deadletter or queuename.dlq  

Refer to "Setup Managed Prometheus for AKS via Terraform" to see how to allow selecting prometheus datasource dynamically in an Azure managed grafana dashboard.

We can create a grafana chart with below query using the prometheus data source to get the dead letter counts. queue=~".*\\.deadletter$" filters all ques have name ending with .deadletter

rabbitmq_detailed_queue_messages {

  cluster="ch-demo-dev-eus-001-aks-green",

  namespace="rabbitmq",

  service="rabbitmq-cluster",

  queue=~".*\\.deadletter$"

}

For legend use the queue and we will be able to get queue names as legend in the chart.