JSON Processing and Delta Table Mapping
Budget: ₹600 – ₹1,500 INR
I'm in need of a data engineer with strong skills in JSON parsing and Delta Lake. The task involves reading from an Azure Event Hub, traversing through a 4-5 levels deep nested JSON, and mapping the JSON columns to target delta table columns. The mapping should be meta-data driven, and able to accommodate changes in the JSON structure.
Key Requirements:
- Proficiency in working with Azure Event Hubs
- Extensive experience with multi-level JSON processing
- Strong skills in Delta Lake
- Ability to create and implement a schema or data dictionary
I do not have a detailed schema for the JSON structure, so part of the job will involve helping me create one. The ideal candidate for this project would be someone who can not only execute the technical aspects, but also provide guidance and support in schema creation.
Key Requirements:
- Proficiency in working with Azure Event Hubs
- Extensive experience with multi-level JSON processing
- Strong skills in Delta Lake
- Ability to create and implement a schema or data dictionary
I do not have a detailed schema for the JSON structure, so part of the job will involve helping me create one. The ideal candidate for this project would be someone who can not only execute the technical aspects, but also provide guidance and support in schema creation.