Bulk Email and Offer Scraping
Budget: ₹1,500 – ₹12,500 INR
I have two source spreadsheets that I need merged and enriched through automated scraping:
• “File 1” – 170 k Spanish local businesses with emails
• “File 2” – 65 k additional businesses with websites only
Phase 1 – Email extraction
Using a Python script and well-known libraries (requests, BeautifulSoup, Scrapy or similar), scan every site listed in File 2, capture all working email addresses you can locate, then append them to the corresponding rows so I can produce a unified “File 3”.
Phase 2 – Offer harvesting
Next, visit each live site in File 3. Where an offer, deal or promotion is publicly displayed, record the details in a fresh Excel sheet with these exact columns:
Business ID | Business Name | Offer Title | Offer Description | Offer Price | Offer Image Filename
Save every referenced image to a separate folder, naming each file exactly as logged in the sheet.
Deliverables
1. Cleaned File 3 (emails filled in)
2. Offers spreadsheet matching the column spec above
3. Folder of offer images, one image per row, filenames synced with the sheet
4. All Python source code and a brief README so I can rerun or extend the process
Accuracy, deduplication and respectful crawl speeds are essential; please observe robots.txt where present and randomise requests to avoid throttling. Let me know if you foresee rate-limit issues or need proxy support.
• “File 1” – 170 k Spanish local businesses with emails
• “File 2” – 65 k additional businesses with websites only
Phase 1 – Email extraction
Using a Python script and well-known libraries (requests, BeautifulSoup, Scrapy or similar), scan every site listed in File 2, capture all working email addresses you can locate, then append them to the corresponding rows so I can produce a unified “File 3”.
Phase 2 – Offer harvesting
Next, visit each live site in File 3. Where an offer, deal or promotion is publicly displayed, record the details in a fresh Excel sheet with these exact columns:
Business ID | Business Name | Offer Title | Offer Description | Offer Price | Offer Image Filename
Save every referenced image to a separate folder, naming each file exactly as logged in the sheet.
Deliverables
1. Cleaned File 3 (emails filled in)
2. Offers spreadsheet matching the column spec above
3. Folder of offer images, one image per row, filenames synced with the sheet
4. All Python source code and a brief README so I can rerun or extend the process
Accuracy, deduplication and respectful crawl speeds are essential; please observe robots.txt where present and randomise requests to avoid throttling. Let me know if you foresee rate-limit issues or need proxy support.