! PYTHON Job in Airflow ! -- 2

Job ID: 30889498

Budget: $10 – $40 USD

-- Fixed Price Task --

-> Python existing Code already attached here
-> if needed Airflow manual step-by-step guide attached
(Bid your price within max defined budget range)

1. Use the existing python code attached to make necessary changes to the code.
2. Schedule a daily job in Airflow that store files in database
* Implement DAG and Orchestration functions and schedule the job in Airflow.

3. Today, the existing python code creates and stores the web-scrapped files into different folders and also inside a dataframe
- Keep that logic
But implement also the logic, where:
- It stores the files into a database (Postgree)
- check first if the file exists in the database
- if it doesn't, than store the new record

** If you don't have Airflow environment installed
- we advise to put the environment up in docker
- simply docker-compose up from the official build here in the official website
https://github.com/apache/airflow/blob/main/docs/apache-airflow/start/docker-compose.yaml

This is a closed scope, bid once, don't try negotiating price after it
** You will be responsible to guide our team on job deployment after **
*** Partials executions of this task wont be accepted.
- We wont be able to fix or continue any implementation.
** So please don't bid if you cant execute it from beginning to the end.