AWS Native Data Platform Build - Native AWS Data Engineer
Budget: $8 – $15 USD
I’m looking for a Data Engineer with strong AWS native services experience to help build and support an event-driven data platform.
This project focuses on automated batch data pipelines, data governance, and making data available in a secure and scalable way. This is not ad-hoc ETL — it’s a platform-style setup.
Tech stack involved:
• AWS: S3, SQS, Lambda, MWAA (Airflow), EMR Serverless
• Data Processing: PySpark, Apache Spark
• Data Lake: Apache Iceberg, AWS Glue Catalog
• Governance & Security: Lake Formation, IAM, KMS
• Querying: Amazon Athena
This project focuses on automated batch data pipelines, data governance, and making data available in a secure and scalable way. This is not ad-hoc ETL — it’s a platform-style setup.
Tech stack involved:
• AWS: S3, SQS, Lambda, MWAA (Airflow), EMR Serverless
• Data Processing: PySpark, Apache Spark
• Data Lake: Apache Iceberg, AWS Glue Catalog
• Governance & Security: Lake Formation, IAM, KMS
• Querying: Amazon Athena
Related categories:
Amazon Web Services
Aws Lambda
Continuous Integration
Data Governance
PySpark
Apache Spark