Looking for an Experienced Software Engineer, Data Platform
Budget: $20 – $40 USD
Looking for an experienced Software Engineer for a long-term project, 6 months +. This contract includes multiple sub-projects. Must be experienced in Python, Linux and Bash scripting, Docker & AWS. Experience or desire and ability to learn Apache Spark, Airflow, Snowflake, and dbt is highly desirable.
Some of the projects you'll be working on in order of priority, include but not limited to
Automate dbt docs generation.
Airflow is used to schedule dbt job runs. After each run will need to generate dbt docs and host a static site on s3
We’d also need to use Route 53 to create a DNS
Build a command-line tool to launch spark jobs, both python and java/scala.
Create build files - jars/zip/egg/pip - for CI/CD deployment and productionizing of Spark jobs
These are some of the initial projects you'd be working on, with more to come in the future.
Although I have a preference for someone who'll be available during US Central time zone I'm open to any time zone as long as you're very very responsive in communicating. We'll be using Slack for any and all conversations.
If you are interested in this project, please reply with your prior experience.
Some of the projects you'll be working on in order of priority, include but not limited to
Automate dbt docs generation.
Airflow is used to schedule dbt job runs. After each run will need to generate dbt docs and host a static site on s3
We’d also need to use Route 53 to create a DNS
Build a command-line tool to launch spark jobs, both python and java/scala.
Create build files - jars/zip/egg/pip - for CI/CD deployment and productionizing of Spark jobs
These are some of the initial projects you'd be working on, with more to come in the future.
Although I have a preference for someone who'll be available during US Central time zone I'm open to any time zone as long as you're very very responsive in communicating. We'll be using Slack for any and all conversations.
If you are interested in this project, please reply with your prior experience.
Related categories:
DevOps