ETL of JSON Telemetry with PySpark -- 2
Budget: $250 – $750 USD
I'm looking for a skilled data engineer with experience in Azure Event Hub and PySpark to help with the ETL process of JSON telemetry data.
Key requirements:
- Transform flat JSON objects gathered via an existing Azure Event Hub EventStream.
- Filter the data as per project needs.
- Load the transformed data into a KQL Database.
Ideal skills include:
- Proficiency in PySpark.
- Experience with Azure Fabric Real Time Intelligence.
- Strong understanding of data filtering techniques.
The project involves working with flat JSON objects, so familiarity with this type of data structure is crucial. Please provide examples of similar projects you've worked on in your bid.
Key requirements:
- Transform flat JSON objects gathered via an existing Azure Event Hub EventStream.
- Filter the data as per project needs.
- Load the transformed data into a KQL Database.
Ideal skills include:
- Proficiency in PySpark.
- Experience with Azure Fabric Real Time Intelligence.
- Strong understanding of data filtering techniques.
The project involves working with flat JSON objects, so familiarity with this type of data structure is crucial. Please provide examples of similar projects you've worked on in your bid.