Migrate Airflow to Databricks

Job ID: 38767123

Budget: $15 – $25 USD

I'm looking for a professional who can help me migrate my existing Airflow setup to Databricks. I have 4 data workshops that need to be migrated as soon as possible.

Key Project Details:
- The main focus of this migration is the data pipeline.
- The data integration involved primarily consists of batch processing.
- My current Airflow setup is hosted on AWS.

Your responsibilities will include:
- Tweaking existing Python templates to fit the Databricks environment.
- Mocking data scenarios for testing purposes.

Ideal candidates for this project should have:
- Extensive experience with both Airflow and Databricks.
- Proficiency in Python, particularly in the context of data pipeline construction.
- Familiarity with AWS cloud services.
- Prior experience with batch processing data integration.

I am looking to start this project immediately, so prompt responses will be appreciated. Thank you.
Related categories: Python PySpark