Migrate Kafka to AWS MSK
Budget: ₹1,500 – ₹12,500 INR
I’m ready to retire our self-managed Apache Kafka dev cluster and move everything onto AWS Managed Streaming for Kafka. The driving factor is cost-efficiency, but I must not sacrifice performance or reliability along the way. Automatic scaling and high availability are therefore non-negotiable parts of the build.
Here is what I need from you:
• Plan and provision a new AWS MSK environment that supports automatic scaling and HA out of the box.
• Migrate topics, configurations, and data streams from the existing Kafka nodes with minimal downtime.
• Tune broker, partition, and storage settings so we gain the cost savings MSK promises without hitting performance bottlenecks later.
• Hand over clear documentation (or Terraform/CloudFormation templates if you prefer) so the team can reproduce the setup for other stages.
Acceptance will be based on a clean cut-over: producers and consumers must point to the MSK endpoints, latency metrics should match or beat the current numbers, and cluster scaling events need to occur automatically under load tests.
If you have recent, production-level MSK migration experience, let’s talk specifics and set up a timeline.
Here is what I need from you:
• Plan and provision a new AWS MSK environment that supports automatic scaling and HA out of the box.
• Migrate topics, configurations, and data streams from the existing Kafka nodes with minimal downtime.
• Tune broker, partition, and storage settings so we gain the cost savings MSK promises without hitting performance bottlenecks later.
• Hand over clear documentation (or Terraform/CloudFormation templates if you prefer) so the team can reproduce the setup for other stages.
Acceptance will be based on a clean cut-over: producers and consumers must point to the MSK endpoints, latency metrics should match or beat the current numbers, and cluster scaling events need to occur automatically under load tests.
If you have recent, production-level MSK migration experience, let’s talk specifics and set up a timeline.