Dynamic JSON data ingestion from Apacke Kafka into Apache Kudu
Budget: $750 – $1,500 AUD
Develop a Java daemon based on OpenJDK11 to run on CentOS7.
4 stages - the initial stage is to read JSON data from a Kafka topic and profile this data - building schema, cardinality and lookup information as data arrives. Storing this in a Kudu table.
Milestone delivery with quotes for each stage.
This is a Java Data project - this is NOT a web project. Strong knowledge of data processing, JSON, parsing and ideally big data engines using Java is required.
More detailed specifications can be shared after initial screening questions.
4 stages - the initial stage is to read JSON data from a Kafka topic and profile this data - building schema, cardinality and lookup information as data arrives. Storing this in a Kudu table.
Milestone delivery with quotes for each stage.
This is a Java Data project - this is NOT a web project. Strong knowledge of data processing, JSON, parsing and ideally big data engines using Java is required.
More detailed specifications can be shared after initial screening questions.