Create Pyspark ETL pipeline on AWS
Budget: ₹600 – ₹1,500 INR
Hi,
I am looking for help in creating a pipeline to read a large dataset (2TB), create a transformation (1 grouby and 1 UDF) and write subsequent small files to s3.
I am looking for help in creating a pipeline to read a large dataset (2TB), create a transformation (1 grouby and 1 UDF) and write subsequent small files to s3.