Web scraping and browser automation
Budget: $250 – $750 USD
I have a maintenance company, and I want to be able to quickly find technicians in different US cities to contact them.
I want INPUT (1) a profession, and (2) an address; and I want the OUTPUT to be a .csv list of businesses with their location and contact info.
For example, if I Input (1) "Plumber", and (2) "1510 Tutt Blvd, Colorado Springs, CO 80922". Then I want the script to
1- Go on Craigslist look up the top 20 plumbers that come out and extract their phone numbers, description, and location (if available)
2- Then do the same on Yelp
3- Then do the on Google maps
4- Then do the same on Facebook (optional)
The system will compile all the above and OUTPUT 1 .csv so that I can call these businesses.
(Bonus, optional): the system would also calculate the driving times of all these ~50-80 businesses and sort them by proximity to the address that I entered.
Notes:
-I care mainly about Craigslist and yelp. Craigslist is more challenging given that the ad is typically text, and the system would need to dig out the phone numbers and addresses from the text. (while Yelp has structured fields)
-"20 results" is an example, we could have that also as an input parameter
- I am planning on running the script locally on a couple of laptops, 3-4 times a day.
- Can you also confirm the expected costs to have rotating proxies to make this work?
-This process is mechanical, repeatable and can be automated. Please see attached video to show how it works step by step
- Timeline: I have 2 months for this.
Can I please get a quote for the cost of developing this? I am checking with several developers for a good offer
Here's the demo video link:
https://www.dropbox.com/s/kaodxs6ve7u5kx6/Demo2.mp4?dl=0
I want INPUT (1) a profession, and (2) an address; and I want the OUTPUT to be a .csv list of businesses with their location and contact info.
For example, if I Input (1) "Plumber", and (2) "1510 Tutt Blvd, Colorado Springs, CO 80922". Then I want the script to
1- Go on Craigslist look up the top 20 plumbers that come out and extract their phone numbers, description, and location (if available)
2- Then do the same on Yelp
3- Then do the on Google maps
4- Then do the same on Facebook (optional)
The system will compile all the above and OUTPUT 1 .csv so that I can call these businesses.
(Bonus, optional): the system would also calculate the driving times of all these ~50-80 businesses and sort them by proximity to the address that I entered.
Notes:
-I care mainly about Craigslist and yelp. Craigslist is more challenging given that the ad is typically text, and the system would need to dig out the phone numbers and addresses from the text. (while Yelp has structured fields)
-"20 results" is an example, we could have that also as an input parameter
- I am planning on running the script locally on a couple of laptops, 3-4 times a day.
- Can you also confirm the expected costs to have rotating proxies to make this work?
-This process is mechanical, repeatable and can be automated. Please see attached video to show how it works step by step
- Timeline: I have 2 months for this.
Can I please get a quote for the cost of developing this? I am checking with several developers for a good offer
Here's the demo video link:
https://www.dropbox.com/s/kaodxs6ve7u5kx6/Demo2.mp4?dl=0