Kafka Confluent PoC Optimization
Budget: $30 – $250 USD
I have an API-driven workload that must move through Kafka Connect and Confluent Cloud with the lowest possible friction, so I’m looking for someone who can design and implement a focused proof-of-concept that showcases best-practice data-streaming optimisation.
Here’s what I need from the engagement:
• Stand-up of a small Confluent Cloud environment (or local Confluent Platform if you prefer for the PoC) configured for API source data.
• Kafka Connect configuration that reliably ingests and routes those API events.
• Demonstrable optimisation techniques—partitioning strategy, producer/consumer tuning, and any relevant connector tweaks—that highlight measurable latency and throughput gains.
• A concise walkthrough of the architecture decisions, plus scripts or Terraform/Ansible (if used) so I can recreate the setup afterward.
I’ll supply API credentials and sample payloads; you bring the Kafka and Confluent expertise to make the stream fly. A short video or live session at the end to prove the PoC meets the stated goals will close out the project.
Here’s what I need from the engagement:
• Stand-up of a small Confluent Cloud environment (or local Confluent Platform if you prefer for the PoC) configured for API source data.
• Kafka Connect configuration that reliably ingests and routes those API events.
• Demonstrable optimisation techniques—partitioning strategy, producer/consumer tuning, and any relevant connector tweaks—that highlight measurable latency and throughput gains.
• A concise walkthrough of the architecture decisions, plus scripts or Terraform/Ansible (if used) so I can recreate the setup afterward.
I’ll supply API credentials and sample payloads; you bring the Kafka and Confluent expertise to make the stream fly. A short video or live session at the end to prove the PoC meets the stated goals will close out the project.