Enhance Python Crawler with New Features
Budget: $10 – $30 USD
I'm looking for a Python expert who can add new functionalities to my existing web crawler.
Key Requirements:
- Adding support for additional websites
- Implementing automated data formatting
- Enhancing error handling and retries capabilities
The ideal candidate should have:
- Extensive experience in Python programming
- Proven track record in web crawling
- Ability to develop and implement new features
- Skills in improving error handling and data formatting processes.
know how to use "asyncio" and "aiohttp" .
Preject Requirement:
1. get prices of tickers by using proxies.
2. get the size of each webpage in kb,and print it to log file.
3. change ip when current crawling cycle is done AND having using this ip for 30 minutes(Add timing function).
4. Sometimes Some tickers' prices could not be fetched,find out the reason and fix it to make sure all prices could be fetched.
Key Requirements:
- Adding support for additional websites
- Implementing automated data formatting
- Enhancing error handling and retries capabilities
The ideal candidate should have:
- Extensive experience in Python programming
- Proven track record in web crawling
- Ability to develop and implement new features
- Skills in improving error handling and data formatting processes.
know how to use "asyncio" and "aiohttp" .
Preject Requirement:
1. get prices of tickers by using proxies.
2. get the size of each webpage in kb,and print it to log file.
3. change ip when current crawling cycle is done AND having using this ip for 30 minutes(Add timing function).
4. Sometimes Some tickers' prices could not be fetched,find out the reason and fix it to make sure all prices could be fetched.