Data Engineer with AWS and Snowflake Experience
Budget: €750 – €1,500 EUR
Task:
Looking for a Data Engineer with AWS and Snowflake Experience for one of our consulting projects.
The mission is to offer a replacement architecture with a Cloud data platform (and related Data Integration pipelines) that is scalable, performing, and easy to maintain.
Details:
Start: asap
1st Contract: 10 days POC plus Extension
Budget: 100€ /day
Location: remote
Project
Client is a service provider specializing in Logistic / Supply Chain consulting / process optimization (logistic, production, distribution) as well as software / digitalization solutions.
Client is therefore consolidating a lot of data inflows in their DWH for reporting purpose. Their technology is based on PostGreSQL database for DWH, Talend ETL and JasperReports for Reporting. This architecture is becoming too tedious, slow and expensive to maintain.
Technology
The solution picked after some auditing and testing is the following:
AWS Cloud Server with Tableau Server for Reporting part and Snowflake for the DWH part.
Snowflake with DBT scripts layer for the ETL part will take care of importing Flat files delivered on S3 buckets.
AWS Glue will be used for the Smart Booking API integration.
Deliverables
Target DWH schema modeling is rudimentary at this point. So there is some Data Engineering DWH modeling orientated also needed as it is an empty shell.
The client will deliver on a regular basis zipped flat files on S3 buckets to be imported in Snowflake using DBT scripts.
The first task is to develop the DataHub as an end to end Proof of Concept for a limited set of file data exports (one customer) and selected dashboards (already provided by client)
Looking for a Data Engineer with AWS and Snowflake Experience for one of our consulting projects.
The mission is to offer a replacement architecture with a Cloud data platform (and related Data Integration pipelines) that is scalable, performing, and easy to maintain.
Details:
Start: asap
1st Contract: 10 days POC plus Extension
Budget: 100€ /day
Location: remote
Project
Client is a service provider specializing in Logistic / Supply Chain consulting / process optimization (logistic, production, distribution) as well as software / digitalization solutions.
Client is therefore consolidating a lot of data inflows in their DWH for reporting purpose. Their technology is based on PostGreSQL database for DWH, Talend ETL and JasperReports for Reporting. This architecture is becoming too tedious, slow and expensive to maintain.
Technology
The solution picked after some auditing and testing is the following:
AWS Cloud Server with Tableau Server for Reporting part and Snowflake for the DWH part.
Snowflake with DBT scripts layer for the ETL part will take care of importing Flat files delivered on S3 buckets.
AWS Glue will be used for the Smart Booking API integration.
Deliverables
Target DWH schema modeling is rudimentary at this point. So there is some Data Engineering DWH modeling orientated also needed as it is an empty shell.
The client will deliver on a regular basis zipped flat files on S3 buckets to be imported in Snowflake using DBT scripts.
The first task is to develop the DataHub as an end to end Proof of Concept for a limited set of file data exports (one customer) and selected dashboards (already provided by client)