Build Web Scraping Scraping

We want to get a scraper built for scconline.com that we can use to scrape all previous cases as well as scrape new cases on a daily basis. The database is huge with over 2.3M entries, we had already been Abel to scrape 2.1M entries but didn't have any data on which cases were missed out.

This functionality should include:
- Storing all the cases into Postgres with proper indexes/partitions to allow FTS(Full text search)
- Scraping only new cases and not re-scraping previously scraped cases.
- Progress on which cases were successfully scraped and which ones were left out.


We would prefer having a scraper built from scratch rather than fixing the existing one , unless you can make use of it.

Existing repo: https://github.com/Tejaswgupta/votum-scc-scraper and issues:
- The CSS selectors and database mapping is correct, as it is scraping data for some cases(needs verification)
- It crashes for some cases with the following errors (https://pastebin.com/E5ujCbX9)
- Some logic needs to be added to store the total number of cases(per day) along with pass/failed cases so we can retry scraping for specific dates.

Budget: 10,000 - 15,000