python data engineering
Budget: $30 – $250 USD
Looking for someone to write a python function or bit of code that can unzip many files from different folders and combine like files into csv files.
The image provided is the file structure of historical crypto data from an exchange. Within the trades folder are folders that represent a date(the first folder being 2020/11/01). Within each date folder are zipped files that contain all of trades made for each currency pair on that date. The code would need to loop through all of the folders and unzip the files. Then it would need to combine all of the like csv files into a single csv file that represents each currency pair. For example, the ada_btc file in the folder 2020/11/01 would be combined with the ada_btc file in the folder 2020/11/02 and so on for each currency pair. The result of the code would create a folder inside the trades folder called trades_csv that contained a single csv file for each currency pair which would contained all of the trades data for that currency pair.
The image provided is the file structure of historical crypto data from an exchange. Within the trades folder are folders that represent a date(the first folder being 2020/11/01). Within each date folder are zipped files that contain all of trades made for each currency pair on that date. The code would need to loop through all of the folders and unzip the files. Then it would need to combine all of the like csv files into a single csv file that represents each currency pair. For example, the ada_btc file in the folder 2020/11/01 would be combined with the ada_btc file in the folder 2020/11/02 and so on for each currency pair. The result of the code would create a folder inside the trades folder called trades_csv that contained a single csv file for each currency pair which would contained all of the trades data for that currency pair.