Web Scraper Development

Job ID: 39280161

Budget: $25 – $35 USD

I'm looking to have a existing project rebuilt with more modern and efficient web technologies so that the project can grow and scale as new features are envisioned.

The project in its current state is a web scraper that scrapes an online marketplace for product listings, which organizes and tracks that data in meaningful ways.

Currently, the project exists in two versions:

Version 1.0 - Aesthetically primitive, is generally complete and working, aside from a few things that have stopped working - likely to API changes.

Version 1.0 Codebase Info:

- Frontend and Backend are currently coupled.
- PHP / JSON
- No DB
- LOC: 1850

Version 2.0 - An attempt to modernize the project but was not completed and core functions do not work.

Version 2.0 Codebase Info:

- Tailwind
- MySQL
- PHP / JS / jQuery
- Hosted on Linode

What's Needed:

- Codebase decoupling and rebuild
- Frontend will interact with backend via API
- Decide to:
a. Stick with current server-side language (PHP) and decouple the server-side code into its own codebase and repo on GitHub
b. Rewrite the codebase from PHP to JavaScript using Node.js
- Ensure all core features and functionality in the current version are working in the rebuild.
- New UI
- CI/CD pipeline
- Source control / GitHub
- Develop additional features as planned in the “roadmap”. (further details to be provided)
Related categories: PHP Web Scraping MySQL Node.js React.js