Wrapper to convert csv to parquet and avro formats
Budget: $30 – $250 USD
1. Build a wrapper
2. Wrapper should have a python file.
3. That python file should ask us arguments for input for file names then pick the file from location and then load csv file to hive table, then after loading the csv file to hive, read from hive table and write into another table. Convert csv to parquet and compare storage sizes of the table.
4, Do the same for AVRO formats as well.
2. Wrapper should have a python file.
3. That python file should ask us arguments for input for file names then pick the file from location and then load csv file to hive table, then after loading the csv file to hive, read from hive table and write into another table. Convert csv to parquet and compare storage sizes of the table.
4, Do the same for AVRO formats as well.