Web Scraper for Perimeter X Protected Site
Budget: $30 – $250 USD
So I want a script that downloads all public files(the ones in green), from a given case number from the website: https://hover.hillsclerk.com/html/case/caseSearch.html
It has Perimeter X as bot protection
So the steps to get the documents are just inserting the case number into "Search by Case Number" going to the results and get all public files(the ones in green), these are some examples you can try:
- 26-CC-003970
- 26-CC-003965
- 26-CC-004007
Important:
- I don't want the files themselves but the script to download them without manual intervention
- Solution could be either in Golang(prefer) or python
- Solution could be either raw http requests(prefer) or browser automation tools like playwright
- I'm open to use any third party service but prefer local solutions
- I'm open to try a proxy provider, I'm currently have one, but if you think another service will solve it then I can try it
- on the script I need to be able to get the files from memory so later I can save it into a database
It has Perimeter X as bot protection
So the steps to get the documents are just inserting the case number into "Search by Case Number" going to the results and get all public files(the ones in green), these are some examples you can try:
- 26-CC-003970
- 26-CC-003965
- 26-CC-004007
Important:
- I don't want the files themselves but the script to download them without manual intervention
- Solution could be either in Golang(prefer) or python
- Solution could be either raw http requests(prefer) or browser automation tools like playwright
- I'm open to use any third party service but prefer local solutions
- I'm open to try a proxy provider, I'm currently have one, but if you think another service will solve it then I can try it
- on the script I need to be able to get the files from memory so later I can save it into a database