Experienced Data Warehouse Engineer Needed
Budget: $1,500 – $3,000 USD
I’m ready to move our analytics stack to a robust, production-grade data warehouse and need someone with 6+ years of hands-on data engineering experience to lead the effort. The core platform will be Amazon Redshift, so deep familiarity with its architecture, best-practice table design, and performance tuning is essential.
Scope of work
• Design and implement the Redshift schema, including proper distribution and sort keys for optimal query speed.
• Build reliable ingestion pipelines that pull data from both relational databases and NoSQL databases, transforming and loading it into Redshift on a scheduled basis.
• Establish monitoring, alerting, and automated maintenance routines (vacuuming, resize, snapshot strategies).
• Document the end-to-end flow and deliver clean SQL and orchestration scripts (e.g., AWS Glue, Airflow, or a comparable tool).
• Provide knowledge transfer and a short hand-off session so my internal team can own routine operations.
Success looks like a fully operational Redshift warehouse populated with our existing datasets, consistent refresh cycles, and query times that enable our BI layer to perform without bottlenecks. If you thrive on data modeling, ETL craftsmanship, and AWS-centric solutions, I’d love to see how you can make this transition smooth and future-proof.
Scope of work
• Design and implement the Redshift schema, including proper distribution and sort keys for optimal query speed.
• Build reliable ingestion pipelines that pull data from both relational databases and NoSQL databases, transforming and loading it into Redshift on a scheduled basis.
• Establish monitoring, alerting, and automated maintenance routines (vacuuming, resize, snapshot strategies).
• Document the end-to-end flow and deliver clean SQL and orchestration scripts (e.g., AWS Glue, Airflow, or a comparable tool).
• Provide knowledge transfer and a short hand-off session so my internal team can own routine operations.
Success looks like a fully operational Redshift warehouse populated with our existing datasets, consistent refresh cycles, and query times that enable our BI layer to perform without bottlenecks. If you thrive on data modeling, ETL craftsmanship, and AWS-centric solutions, I’d love to see how you can make this transition smooth and future-proof.
Related categories:
SQL
NoSQL Couch & Mongo
Big Data Sales
Hadoop
Elasticsearch
ETL
Data Modeling
Performance Tuning