Web Application with User Logins and Web Scraping Integration
Budget: £750 – £1,500 GBP
I have a project that involves the creation of a web application with the following features:
- User Logins: The application should have a secure user login system, allowing registered users to access specific content.
- Stripe Packages: I require the integration of Stripe payment packages into the application. There will be set packages that limit the number of 'IDs' that a user can enter that will be scraped.
- Database Integration: The application should store user data in a secure database. Scraped information should also be stored in a database, along with the IDs that are to be scraped.
In addition, I need a separate web scraping backend (I can provide code which queries the API and returns all of the information). It can be run separately from the frontend and just store the details in the database. It will perform the following tasks:
- Monitor Specific Fields from a BRCGS certificate ID. Check this link for example, https://directory.brcgs.com/site/1104309
The web scraping backend should be able to check for updates to specific fields. These fields include:
- Contact Email
- Certificate Issue Date
- Certificate Details
A user will provide a list of IDs to be monitored. These pages will be scraped at regular intervals e.g. 8am and 4pm. Any changes will be stored and displayed to the user on the web application, and then also emailed to them.
I already have scraping code that gets all of the necessary information from the API. However this will need to be made into a robust program with the emailing and the storing of data and updates correctly.
I am looking for a professional who can handle both the front-end and back-end aspects of this project. Please provide examples of your previous work in your bid.
- User Logins: The application should have a secure user login system, allowing registered users to access specific content.
- Stripe Packages: I require the integration of Stripe payment packages into the application. There will be set packages that limit the number of 'IDs' that a user can enter that will be scraped.
- Database Integration: The application should store user data in a secure database. Scraped information should also be stored in a database, along with the IDs that are to be scraped.
In addition, I need a separate web scraping backend (I can provide code which queries the API and returns all of the information). It can be run separately from the frontend and just store the details in the database. It will perform the following tasks:
- Monitor Specific Fields from a BRCGS certificate ID. Check this link for example, https://directory.brcgs.com/site/1104309
The web scraping backend should be able to check for updates to specific fields. These fields include:
- Contact Email
- Certificate Issue Date
- Certificate Details
A user will provide a list of IDs to be monitored. These pages will be scraped at regular intervals e.g. 8am and 4pm. Any changes will be stored and displayed to the user on the web application, and then also emailed to them.
I already have scraping code that gets all of the necessary information from the API. However this will need to be made into a robust program with the emailing and the storing of data and updates correctly.
I am looking for a professional who can handle both the front-end and back-end aspects of this project. Please provide examples of your previous work in your bid.
Related categories:
Python
Web Scraping
Software Architecture
MySQL
Database Programming
Web Application