Stock Price Crawler Optimization(speed up)
Budget: $30 – $250 USD
I need an experienced Python developer to optimize my existing stock price crawler. The goal is to fetch 4000 stock prices and store the price and time into a MySQL database every 5-6 minutes.
Requirements:
- Optimize current crawler to handle 4000 stocks in 5-6 minutes.
- Use MySQL Connector/Python for database operations.
- Maintain current setup using asyncio, aiohttp, and proxies.(or use your code completely)
- Ensure new prices are fetched every 5-6 minutes for all stocks.
- Make a detailed vps setup guide to show how to install all the modules needed by the program(until i created a new clone according to your guide).
Ideal Skills:
- Proficiency in Python, especially with asyncio and aiohttp.
- Experience with MySQL and MySQL Connector/Python.
- Background in developing and optimizing web crawlers.
- Proven track record in similar projects.
Please provide evidence of similar project experience. Payment is contingent on successfully meeting the target.
Requirements:
- Optimize current crawler to handle 4000 stocks in 5-6 minutes.
- Use MySQL Connector/Python for database operations.
- Maintain current setup using asyncio, aiohttp, and proxies.(or use your code completely)
- Ensure new prices are fetched every 5-6 minutes for all stocks.
- Make a detailed vps setup guide to show how to install all the modules needed by the program(until i created a new clone according to your guide).
Ideal Skills:
- Proficiency in Python, especially with asyncio and aiohttp.
- Experience with MySQL and MySQL Connector/Python.
- Background in developing and optimizing web crawlers.
- Proven track record in similar projects.
Please provide evidence of similar project experience. Payment is contingent on successfully meeting the target.