Real-time Data Ingestion Pipeline Development
Budget: ₹12,500 – ₹37,500 INR
I'm in need of a skilled professional to assist with the construction of data ingestion pipelines during Phase 1 of my project.
Key responsibilities:
- Set up of Kafka, Redis, and ClickHouse infrastructure
- Development of real-time data ingestion from external APIs and internal databases
- Implementation of WebSocket streaming
- Creation of working APIs: /ticks, /candles, /instruments
The ideal candidate for this job should have substantial experience with Kafka, Redis, ClickHouse, and WebSocket. They should also be comfortable working with external APIs and internal databases to set up real-time data ingestion. Strong API development skills are also required.
Please note, the primary focus of this phase is on building data ingestion pipelines, so a deep understanding of data streaming and ingestion processes will be beneficial.
Key responsibilities:
- Set up of Kafka, Redis, and ClickHouse infrastructure
- Development of real-time data ingestion from external APIs and internal databases
- Implementation of WebSocket streaming
- Creation of working APIs: /ticks, /candles, /instruments
The ideal candidate for this job should have substantial experience with Kafka, Redis, ClickHouse, and WebSocket. They should also be comfortable working with external APIs and internal databases to set up real-time data ingestion. Strong API development skills are also required.
Please note, the primary focus of this phase is on building data ingestion pipelines, so a deep understanding of data streaming and ingestion processes will be beneficial.