Asynchronous web scraping for dynamic JS site with python
Budget: $30 – $250 USD
Hi,
Need the following:
1. logging with AsyncHTMLSession session with CSRF token bypass (synchronously)
2. retrieve responses to numerous links under the same server (asynchronously)
3. render responses to all html's since site is dynamic (asynchronously)
4. parse all data (could be synchronously)
preferably using requests-html package as pages do have to render as mentioned above.
Further details will be disclosed upon granting the project.
Looking for someone who knows asyncio/aiohttp libraries and can write fast asynchronous code as I do need fast results.
Total pages to scrape is about 50, would rather not use selenium but if someone with skills can write asynchronous code with selenium to get fast results I will consider.
Need the following:
1. logging with AsyncHTMLSession session with CSRF token bypass (synchronously)
2. retrieve responses to numerous links under the same server (asynchronously)
3. render responses to all html's since site is dynamic (asynchronously)
4. parse all data (could be synchronously)
preferably using requests-html package as pages do have to render as mentioned above.
Further details will be disclosed upon granting the project.
Looking for someone who knows asyncio/aiohttp libraries and can write fast asynchronous code as I do need fast results.
Total pages to scrape is about 50, would rather not use selenium but if someone with skills can write asynchronous code with selenium to get fast results I will consider.