Simple Google Scraper Tool
Budget: $30 – $250 CAD
NO PLACEHOLDER BIDS
----------
READ THE PROJECT REQUIREMENT CAREFULLY. SEE THE MOCKUP OF THE FRONT END REQUIREMENT, IN THE FILES SECTION OF THIS PROJECT.
MUST BE DELIVERED IN 5 DAYS
--------
I’m looking to add a lightweight, server-hosted scraper that lets me type a keyword (e.g., “lawyers”) and a city, rely on Google Autocomplete for the final query, and then pull back the first-page business results.
Core workflow
• Front end: match the attached mock-up—two input fields (keyword + city) and a “Run” button.
• Scraping: hit Google Search, respect reasonable delays, capture each result’s URL, business name, email address, phone number, mailing address, and any social-media link that appears on the page.
• Storage: write everything to our MySQL database.
• Data quality: run only basic validation—remove obvious duplicates, trim whitespace, keep field formats consistent.
• Export: one-click download to XLS or CSV.
• Deployment: install on our Linux server and document the steps so I can redeploy if needed.
Preferred stack
Python with BeautifulSoup, Scrapy, or Selenium is fine, as long as it’s cleanly modular. Use pandas or a similar library for the export.
Deliverables
1. Source code and requirements.txt (or equivalent).
2. SQL script to create/update the necessary tables.
3. README covering setup, cron scheduling, and how to adjust throttling.
4. Working front-end files matching the mock-up.
Keep it simple, reliable, and ready to run on our own hardware.
----------
READ THE PROJECT REQUIREMENT CAREFULLY. SEE THE MOCKUP OF THE FRONT END REQUIREMENT, IN THE FILES SECTION OF THIS PROJECT.
MUST BE DELIVERED IN 5 DAYS
--------
I’m looking to add a lightweight, server-hosted scraper that lets me type a keyword (e.g., “lawyers”) and a city, rely on Google Autocomplete for the final query, and then pull back the first-page business results.
Core workflow
• Front end: match the attached mock-up—two input fields (keyword + city) and a “Run” button.
• Scraping: hit Google Search, respect reasonable delays, capture each result’s URL, business name, email address, phone number, mailing address, and any social-media link that appears on the page.
• Storage: write everything to our MySQL database.
• Data quality: run only basic validation—remove obvious duplicates, trim whitespace, keep field formats consistent.
• Export: one-click download to XLS or CSV.
• Deployment: install on our Linux server and document the steps so I can redeploy if needed.
Preferred stack
Python with BeautifulSoup, Scrapy, or Selenium is fine, as long as it’s cleanly modular. Use pandas or a similar library for the export.
Deliverables
1. Source code and requirements.txt (or equivalent).
2. SQL script to create/update the necessary tables.
3. README covering setup, cron scheduling, and how to adjust throttling.
4. Working front-end files matching the mock-up.
Keep it simple, reliable, and ready to run on our own hardware.
Related categories:
Python
Linux
Web Scraping
Google App Engine
MySQL
Elasticsearch
Scrapy
BeautifulSoup
Documentation
Selenium