Data engineer Task -- 2
Budget: $30 – $250 USD
Data engineering task,
1. You must import data into a minimally-processed form first, not directly into the data warehouse. This should be on the local filesystem.
2. You must code your solution in Python (and, of course, SQL where appropriate!)
3. We use AWS Redshift as our data warehouse, so please use PostgreSQL, since it is most similar to Redshift.
4. Please make it easy for us to configure which database to write the final transformed data into.
1. You must import data into a minimally-processed form first, not directly into the data warehouse. This should be on the local filesystem.
2. You must code your solution in Python (and, of course, SQL where appropriate!)
3. We use AWS Redshift as our data warehouse, so please use PostgreSQL, since it is most similar to Redshift.
4. Please make it easy for us to configure which database to write the final transformed data into.