Developing Web scraping project
Budget: ₹1,500 – ₹12,500 INR
I need to build a web scraping project in Scrapy Framework, which covers more complex use cases like -
- Access sites that recognize bot behavior. For example: [login to view URL]
- Incase of complex bot detection, access the APIs using appropriate request headers used in Web or App platforms and extract data. (I have a use case to extract data from a popular classifieds website ).
- Learn best practices how quickly to scrape different sites
- Automate pipeline which currently has a few different steps
- Access sites that recognize bot behavior. For example: [login to view URL]
- Incase of complex bot detection, access the APIs using appropriate request headers used in Web or App platforms and extract data. (I have a use case to extract data from a popular classifieds website ).
- Learn best practices how quickly to scrape different sites
- Automate pipeline which currently has a few different steps