Python multiprocessing database parser and uloader
Budget: $30 – $250 USD
I need a python script that runs on a server and does following:
- auto starts on system boot
- processes 3 different type of files and uploads the data to a time series database (Influxdb)
- watches a predefined folder with watchdog and processes any new file
- keeps track of all the processed file in an sql db
- all three file processing class run in parallel on a thread pool, mine gets stuck so you have to figure out how to fix or implement your own
- figure out how to puch data from 3 different processes to the same DB or pass data in a multiprocessing queue
- auto starts on system boot
- processes 3 different type of files and uploads the data to a time series database (Influxdb)
- watches a predefined folder with watchdog and processes any new file
- keeps track of all the processed file in an sql db
- all three file processing class run in parallel on a thread pool, mine gets stuck so you have to figure out how to fix or implement your own
- figure out how to puch data from 3 different processes to the same DB or pass data in a multiprocessing queue