Kafka Monitoring Dashboards in Grafana
Budget: $250 – $750 USD
Prometheus is already running in my environment, and I now want to visualise key Kafka application metrics—specifically throughput, latency and consumer lag—in Grafana. I need you to wire the two systems together, expose the right Kafka exporters (JMX-Exporter or the Prometheus Kafka-Exporter, whichever you prefer), configure scraping jobs, and then build a set of Grafana panels that give me an at-a-glance picture of how each broker and consumer group is behaving.
Please structure the dashboards so that I can filter by cluster, topic and consumer group, and keep them tidy enough for operations staff to understand at a glance. If any alerts make sense for the same metrics, outline them; I can wire the notification channels later.
Acceptance will be simple: once the dashboards pull live data for throughput, latency and consumer lag without errors for at least one hour, and the queries stay under reasonable load (<5 s response time), the job is done.
Please structure the dashboards so that I can filter by cluster, topic and consumer group, and keep them tidy enough for operations staff to understand at a glance. If any alerts make sense for the same metrics, outline them; I can wire the notification channels later.
Acceptance will be simple: once the dashboards pull live data for throughput, latency and consumer lag without errors for at least one hour, and the queries stay under reasonable load (<5 s response time), the job is done.