Python Web Scraping Expert Needed

Job ID: 39409932

Budget: $30 – $250 USD

I'm looking for an expert in building comprehensive python web scraping tools. Someone that can take a specific site and build a comprehensive local database AND retrieve the various assets that we are looking to store. The scraping must be extremely robust with error handlers, logging capabilities and the ability to "spider" or "crawl" throughout a site. Python is our tool of choice, and the database will be postgreSQL, while store of retrieved assets will be done on our AWS S3 account. You MUST have prior experience in this space.

Given the requirements, to be considered, your bid MUST contain the following:
1. Your technical "stack" recommendations (which tools will you use)
2. How you would approach the process.
3. An estimate of how long it will take you to complete the scaper.
4. Sharing of your GitHub ID. (No ID? you should not bid it 2025, get one)

If your bid does not answer these questions it will be deleted. You also must be able to do regular github check-ins and be actively connected to the internet through Slack.

Best Regards! READ AND FOLLOW THE INSTRUCTIONS PEOPLE... Do NOT bombard us with useless bids, fix those autobids to conform with what has been asked.