SaaS Web Scraping & Workflow Automation Platform/Product
Budget: $1,500 – $3,000 AUD
### **Project Overview:**
We are building a **SaaS-style web scraping and automation platform** that enables customers to visually design and manage their own scraping workflows. The system will allow users to:
* Configure which website to scrape data from (including login flows).
* Pass through authentication (login forms, cookies, sessions, CAPTCHAs).
* Use a **drag-and-drop low-code interface** to design scraping workflows.
* Map scraped fields to destination systems (APIs, databases, CSV/Excel, etc.).
* Schedule recurring scraping jobs.
* Monitor job status, logs, and errors in a web dashboard.
* Must be hosted in Australia
The product must **feel like a modern SaaS platform** with clean UX/UI.
---
### Key Requirement:
**Before development begins, the freelancer must deliver UX/UI mockups (wireframes + high-fidelity designs in Figma or Sketch).**
* Web-based interface (desktop-first, responsive).
* Key screens: Login, Dashboard, Workflow Builder, Job History, Mapping UI.
* Mockups must be approved before coding.
---
### Responsibilities:
* **Phase 1: UX/UI Design**
* Create wireframes + Figma mockups for approval.
* Design intuitive, modern SaaS-style UI (similar to Zapier/Integromat).
* **Phase 2: Frontend Development**
* Build drag-and-drop workflow builder (React + React Flow or similar).
* Develop responsive web app with TailwindCSS (or equivalent).
* **Phase 3: Backend Development**
* Architect and develop the scraping engine (Python + Playwright/Scrapy).
* Handle authentication flows (cookies, tokens, CAPTCHA solving).
* Implement data mapping and export (CSV, API, database).
* Build job scheduling system (Celery/Redis).
* Create monitoring & logging system.
* **Phase 4: Deployment**
* Deploy with Docker (Kubernetes later in Phase 2/3).
* Set up cloud hosting (AWS/GCP/Azure).
---
### **Required Skills:**
* **Frontend:** React, React Flow (or similar), TailwindCSS, UX/UI implementation.
* **Design:** Strong experience with Figma/Sketch for SaaS UI mockups.
* **Backend:** Python (FastAPI/Django), Celery/Redis, Postgres.
* **Scraping:** Playwright, Scrapy, Selenium (dynamic websites, logins).
* **Workflow Engines:** Celery, Airflow, or similar experience.
* **Databases:** Postgres/MySQL.
* **APIs:** REST/GraphQL integration.
* **DevOps:** Docker, basic Kubernetes.
* **Bonus:** Proxy rotation, anti-captcha integration, ETL pipeline experience.
---
### **Deliverables:**
1. UX/UI Mockups (Figma/Sketch) → Approval.
2. Web SaaS frontend (drag-drop builder, dashboards).
3. Scraping backend with login/session support.
4. Data mapping engine (source → destination).
5. Export options (CSV, JSON, Webhook).
6. Scheduler + job monitoring dashboard.
7. Documentation + code handover.
---
### **Budget & Duration:**
* Open to proposals (please suggest timeline + cost per phase).
* Preference for freelancers who can **work in phased milestones (Design → MVP → Beta → SaaS Launch)**.
---
We are building a **SaaS-style web scraping and automation platform** that enables customers to visually design and manage their own scraping workflows. The system will allow users to:
* Configure which website to scrape data from (including login flows).
* Pass through authentication (login forms, cookies, sessions, CAPTCHAs).
* Use a **drag-and-drop low-code interface** to design scraping workflows.
* Map scraped fields to destination systems (APIs, databases, CSV/Excel, etc.).
* Schedule recurring scraping jobs.
* Monitor job status, logs, and errors in a web dashboard.
* Must be hosted in Australia
The product must **feel like a modern SaaS platform** with clean UX/UI.
---
### Key Requirement:
**Before development begins, the freelancer must deliver UX/UI mockups (wireframes + high-fidelity designs in Figma or Sketch).**
* Web-based interface (desktop-first, responsive).
* Key screens: Login, Dashboard, Workflow Builder, Job History, Mapping UI.
* Mockups must be approved before coding.
---
### Responsibilities:
* **Phase 1: UX/UI Design**
* Create wireframes + Figma mockups for approval.
* Design intuitive, modern SaaS-style UI (similar to Zapier/Integromat).
* **Phase 2: Frontend Development**
* Build drag-and-drop workflow builder (React + React Flow or similar).
* Develop responsive web app with TailwindCSS (or equivalent).
* **Phase 3: Backend Development**
* Architect and develop the scraping engine (Python + Playwright/Scrapy).
* Handle authentication flows (cookies, tokens, CAPTCHA solving).
* Implement data mapping and export (CSV, API, database).
* Build job scheduling system (Celery/Redis).
* Create monitoring & logging system.
* **Phase 4: Deployment**
* Deploy with Docker (Kubernetes later in Phase 2/3).
* Set up cloud hosting (AWS/GCP/Azure).
---
### **Required Skills:**
* **Frontend:** React, React Flow (or similar), TailwindCSS, UX/UI implementation.
* **Design:** Strong experience with Figma/Sketch for SaaS UI mockups.
* **Backend:** Python (FastAPI/Django), Celery/Redis, Postgres.
* **Scraping:** Playwright, Scrapy, Selenium (dynamic websites, logins).
* **Workflow Engines:** Celery, Airflow, or similar experience.
* **Databases:** Postgres/MySQL.
* **APIs:** REST/GraphQL integration.
* **DevOps:** Docker, basic Kubernetes.
* **Bonus:** Proxy rotation, anti-captcha integration, ETL pipeline experience.
---
### **Deliverables:**
1. UX/UI Mockups (Figma/Sketch) → Approval.
2. Web SaaS frontend (drag-drop builder, dashboards).
3. Scraping backend with login/session support.
4. Data mapping engine (source → destination).
5. Export options (CSV, JSON, Webhook).
6. Scheduler + job monitoring dashboard.
7. Documentation + code handover.
---
### **Budget & Duration:**
* Open to proposals (please suggest timeline + cost per phase).
* Preference for freelancers who can **work in phased milestones (Design → MVP → Beta → SaaS Launch)**.
---
Related categories:
PHP
Python
Website Design
Graphic Design
Web Scraping
User Interface / IA
UX / User Experience
Scrapy
Figma
SaaS