Interactive Procurement Website with Scraping
Budget: £250 – £750 GBP
I’m building a procurement-focused site where buyers can quickly locate and purchase industrial materials. The core of the project is a smart search that reaches beyond an internal catalog: whenever a user enters a product type or key specification, the system should automatically scrape up-to-date information from relevant supplier and manufacturer websites, then display consolidated results in real time.
The scraper needs to collect and store:
• product details and full technical specifications
• current pricing (including tiered or volume-based rates)
• supplier contact information
• compliance or testing certificates
• available volumes / quantities
Filtered and predictive search behaviours (e.g., dynamic suggestions, spec-based faceting) should feel instantaneous to the user even though fresh data is being pulled behind the scenes.
Once a product is selected, the site must support a streamlined checkout with a secure payment gateway. Please factor in typical e-commerce elements such as cart management, tax and shipping calculations, order history and automated email notifications.
Deliverables
1. Responsive web front end (desktop & mobile) with the smart search interface
2. Back-end scraping engine that targets supplier and manufacturer domains and updates the database on a schedule or on-demand query
3. Relational database structure that stores the scraped data and ties it to user orders
4. Payment-processing integration (Stripe, PayPal, or a comparable PCI-compliant solution)
5. Admin dashboard for product data review, manual overrides and order management
6. Deployment documentation and brief hand-off session
Acceptance criteria
• Search returns relevant results in under two seconds for common queries
• Scraper captures 95 %+ of the specified data fields across target sites without breaking layout or ToS rules
• Successful end-to-end purchase flow verified with test payments in both sandbox and live environments
• All source code, instructions and credentials delivered before final sign-off
If you have experience blending real-time web scraping, fast search indexing (Elastic, Solr or similar) and secure payments, I’d like to hear how you’d architect the solution and an estimated timeline.
The scraper needs to collect and store:
• product details and full technical specifications
• current pricing (including tiered or volume-based rates)
• supplier contact information
• compliance or testing certificates
• available volumes / quantities
Filtered and predictive search behaviours (e.g., dynamic suggestions, spec-based faceting) should feel instantaneous to the user even though fresh data is being pulled behind the scenes.
Once a product is selected, the site must support a streamlined checkout with a secure payment gateway. Please factor in typical e-commerce elements such as cart management, tax and shipping calculations, order history and automated email notifications.
Deliverables
1. Responsive web front end (desktop & mobile) with the smart search interface
2. Back-end scraping engine that targets supplier and manufacturer domains and updates the database on a schedule or on-demand query
3. Relational database structure that stores the scraped data and ties it to user orders
4. Payment-processing integration (Stripe, PayPal, or a comparable PCI-compliant solution)
5. Admin dashboard for product data review, manual overrides and order management
6. Deployment documentation and brief hand-off session
Acceptance criteria
• Search returns relevant results in under two seconds for common queries
• Scraper captures 95 %+ of the specified data fields across target sites without breaking layout or ToS rules
• Successful end-to-end purchase flow verified with test payments in both sandbox and live environments
• All source code, instructions and credentials delivered before final sign-off
If you have experience blending real-time web scraping, fast search indexing (Elastic, Solr or similar) and secure payments, I’d like to hear how you’d architect the solution and an estimated timeline.
Related categories:
PHP
Website Design
Web Scraping
HTML
Web Development
Database Management
API Development
Payment Processing