Web Scraping & Automation Developer -- 3

Job ID: 39179741

Budget: $30 – $250 USD

? Job Overview:
We need a coder/programmer to build an automated web scraping and messaging tool. This tool will:
1️⃣ Scrape user data from a specific website.
2️⃣ Check for duplicate entries in a Google Sheet.
3️⃣ Send automated messages to selected users.
4️⃣ Run automatically every 15 minutes, 24/7.

Our current process is done using Browserflow, but this tool will be **custom-built**—you don’t need experience with Browserflow, just the ability to replicate the workflow.

---

?️ What We’re Looking For:
✅ Experience in Web Scraping & Automation (Python, Puppeteer, Selenium, or similar tools).
✅ Ability to work with Google Sheets API (to store & update data).
✅ Knowledge of scheduling scripts to run every 15 minutes (Cron jobs, AWS Lambda, etc.).

---

? How to Apply:
If you’re interested, send us:
1️⃣ A brief message explaining why you’re a good fit.
2️⃣ Examples of web scraping/automation projects you’ve done.
3️⃣ Your expected payment rate for this project.

————
Job description (not on listing, but will be sent by direct message to applicants)

? What You’ll Do (Your Tasks):
✅ Web Scraping & Data Collection
- Open a specific website.
- Search for users in North Carolina, USA.
- Apply filters to exclude vendors and show only online users.
- Extract and store the following details:
- Username
- User Type (Vendor or Consumer)
- Location
- Status (Online now, last seen X minutes ago)
- Save the collected data into a Google Sheet.

✅ Duplicate Check in Google Sheets
- Scan the spreadsheet to detect duplicate usernames.
- Use a simple formula to mark duplicates in a new column.

✅ Automate Messaging to Users
- Loop through the collected users in the spreadsheet.
- Skip users marked as "Duplicate" or "Vendors".
- Send a pre-written message to the rest.
- If messaging is blocked, update the Google Sheet as "Blocked".
- If the message is sent successfully, update it as "Messaged".

✅ Run Automatically Every 15 Minutes
- The tool should run 24/7 without manual input.
- Set up a scheduler (cron job, task runner, or cloud function) to run the program every 15 minutes.
Related categories: Data Entry Web Scraping Data Mining Programming