PySpark Developer for Kafka Streaming Program
Budget: ₹200 – ₹400 INR
I need an experienced Azure, PySpark, and Databricks developer to help me create a real-time analytics Kafka Streaming WordCount program using PySpark.
Key Requirements:
- Modify and adapt my existing PySpark streaming code (which works in my Jupyter notebook) to work with Kafka.
- Ensure the program can consume data from file storage via Kafka streams.
- Handle input data in CSV format from file storage.
Ideal Skills and Experience:
- Extensive experience with Azure, PySpark, and Databricks.
- Proven track record of creating real-time analytics programs.
- Familiarity with Kafka and its streaming capabilities.
- Proficient in handling CSV data and modifying PySpark code.
Key Requirements:
- Modify and adapt my existing PySpark streaming code (which works in my Jupyter notebook) to work with Kafka.
- Ensure the program can consume data from file storage via Kafka streams.
- Handle input data in CSV format from file storage.
Ideal Skills and Experience:
- Extensive experience with Azure, PySpark, and Databricks.
- Proven track record of creating real-time analytics programs.
- Familiarity with Kafka and its streaming capabilities.
- Proficient in handling CSV data and modifying PySpark code.