SaaS Web Scraping & Workflow Automation Platform/Product

Job ID: 39778676

Budget: $1,500 – $3,000 AUD

### **Project Overview:**

We are building a **SaaS-style web scraping and automation platform** that enables customers to visually design and manage their own scraping workflows. The system will allow users to:

* Configure which website to scrape data from (including login flows).
* Pass through authentication (login forms, cookies, sessions, CAPTCHAs).
* Use a **drag-and-drop low-code interface** to design scraping workflows.
* Map scraped fields to destination systems (APIs, databases, CSV/Excel, etc.).
* Schedule recurring scraping jobs.
* Monitor job status, logs, and errors in a web dashboard.
* Must be hosted in Australia

The product must **feel like a modern SaaS platform** with clean UX/UI.

---

### Key Requirement:

**Before development begins, the freelancer must deliver UX/UI mockups (wireframes + high-fidelity designs in Figma or Sketch).**

* Web-based interface (desktop-first, responsive).
* Key screens: Login, Dashboard, Workflow Builder, Job History, Mapping UI.
* Mockups must be approved before coding.

---

### Responsibilities:

* **Phase 1: UX/UI Design**

* Create wireframes + Figma mockups for approval.
* Design intuitive, modern SaaS-style UI (similar to Zapier/Integromat).

* **Phase 2: Frontend Development**

* Build drag-and-drop workflow builder (React + React Flow or similar).
* Develop responsive web app with TailwindCSS (or equivalent).

* **Phase 3: Backend Development**

* Architect and develop the scraping engine (Python + Playwright/Scrapy).
* Handle authentication flows (cookies, tokens, CAPTCHA solving).
* Implement data mapping and export (CSV, API, database).
* Build job scheduling system (Celery/Redis).
* Create monitoring & logging system.

* **Phase 4: Deployment**

* Deploy with Docker (Kubernetes later in Phase 2/3).
* Set up cloud hosting (AWS/GCP/Azure).

---

### **Required Skills:**

* **Frontend:** React, React Flow (or similar), TailwindCSS, UX/UI implementation.
* **Design:** Strong experience with Figma/Sketch for SaaS UI mockups.
* **Backend:** Python (FastAPI/Django), Celery/Redis, Postgres.
* **Scraping:** Playwright, Scrapy, Selenium (dynamic websites, logins).
* **Workflow Engines:** Celery, Airflow, or similar experience.
* **Databases:** Postgres/MySQL.
* **APIs:** REST/GraphQL integration.
* **DevOps:** Docker, basic Kubernetes.
* **Bonus:** Proxy rotation, anti-captcha integration, ETL pipeline experience.

---

### **Deliverables:**

1. UX/UI Mockups (Figma/Sketch) → Approval.
2. Web SaaS frontend (drag-drop builder, dashboards).
3. Scraping backend with login/session support.
4. Data mapping engine (source → destination).
5. Export options (CSV, JSON, Webhook).
6. Scheduler + job monitoring dashboard.
7. Documentation + code handover.

---

### **Budget & Duration:**

* Open to proposals (please suggest timeline + cost per phase).
* Preference for freelancers who can **work in phased milestones (Design → MVP → Beta → SaaS Launch)**.

---