kafka streaming in Scala
Budget: €8 – €30 EUR
Create an Ingestion MicroService that will allows us to integrate JSON format file look at some statistics and visualize the entering of data inflows
details :
You are asked to use a JSON file named "generated.json" in the folder datasets and to write each elements of the said in a kafka topic however the "ingested data" need to be valid
the following are the criteria of a valid data :
the name of the person has to be of at least 5 characters
the person has to be legal and 75 at the upmost
the person email has to be valid
if the data does not meet at one of those criteria it shall be written in a topic of rejection , with the reason of its rejection
You are expected to use a kafka-docker for the kafka instance and named your topics as followed :
validation topic = ingestion-valid
rejection topic = ingestion-reject
your MicroServices will have to be deployable through a docker container and is expected to connect and have the interactions with the kafka-docker previously set for the data discrimination
details :
You are asked to use a JSON file named "generated.json" in the folder datasets and to write each elements of the said in a kafka topic however the "ingested data" need to be valid
the following are the criteria of a valid data :
the name of the person has to be of at least 5 characters
the person has to be legal and 75 at the upmost
the person email has to be valid
if the data does not meet at one of those criteria it shall be written in a topic of rejection , with the reason of its rejection
You are expected to use a kafka-docker for the kafka instance and named your topics as followed :
validation topic = ingestion-valid
rejection topic = ingestion-reject
your MicroServices will have to be deployable through a docker container and is expected to connect and have the interactions with the kafka-docker previously set for the data discrimination