Adjustment to python crawler. Instead of crawling and display the info at same time, i need to make the script save the data in mysql once a day and then loads the data as a website so it loads faster
Budget: $30 – $250 AUD
Adjustment to Python Crawler to Save Data in MySQL and Load as Website Daily
I need a Python developer with experience in web crawling and MySQL to make a few adjustments to my existing crawler. Instead of displaying the information at the same time it crawls, I need the script to save the data in MySQL once a day and then load the data as a website so it loads faster. Here are the project details:
Information to be crawled and saved:
- Football stats
Previous stats and display in html
Frequency of scraping data by script:
- Every 24 hours
Ideal skills and experience:
- Strong Python skills
- Experience with web crawling and MySQL databases
- Knowledge of web development and website loading optimization
If you have the necessary skills and experience, please submit your proposal with relevant work samples.
I need a Python developer with experience in web crawling and MySQL to make a few adjustments to my existing crawler. Instead of displaying the information at the same time it crawls, I need the script to save the data in MySQL once a day and then load the data as a website so it loads faster. Here are the project details:
Information to be crawled and saved:
- Football stats
Previous stats and display in html
Frequency of scraping data by script:
- Every 24 hours
Ideal skills and experience:
- Strong Python skills
- Experience with web crawling and MySQL databases
- Knowledge of web development and website loading optimization
If you have the necessary skills and experience, please submit your proposal with relevant work samples.