ETL pipeline using Airflow or Glue

Data in S3 needs to be shifted to a relational database.S3 has varying schema and needs to handle this.



Data transfer has to happen using

1)Glue Jobs and Crawler

or

2)Airflow

whichever is efficient.