Amazon.in Free Gifts Scraper Optimization

Hi,
I hope you're doing well.
I’m looking for a developer to enhance and optimize an existing script that identifies brands offering “free gifts with purchase” on Amazon.in.
I already have a working base script and documentation, which I will share for reference:
The script is developed using Playwright and currently:
Searches brands on Amazon.in
Scans search result pages and product detail pages
Detects gift offers using keywords
Uses proxy rotation and basic anti-detection
Exports results to Excel
Includes logging for debugging
This is not a from-scratch project — it’s an optimization and scaling task.
My Current Setup
Ryzen 7 5825U (8 cores / 16 threads)
16GB RAM
Windows system
The script will initially run on this machine, so optimization should be done within these limits.
What I Need From You
Performance Optimization
Current approach is sequential (slow but stable)
Need to implement parallel processing / multithreading, but optimized for my system (not overloading CPU/RAM)
Category-Based Scraping
We will maintain a manual list of ~40 category URLs inside the code
This is intentional due to Amazon’s structure
Should be easy to update in future
Captcha / Blocking Handling
For now, basic/manual handling is enough
No need to integrate paid proxy or captcha services yet
We will upgrade this later based on actual issues
Scalability (Future-Ready)
Code should be written in a way that can later run on a VPS/server for higher scaling
Stability & Monitoring
Proper logging
Error handling
Easy debugging when Amazon changes structure
Code Quality
Clean, modular, and maintainable code
Easy for future updates and improvements
Expected Output
An Excel file containing:
Brand Name
Gift Available (Yes/No)
Before We Proceed, Please Share:
Your experience with Amazon scraping / anti-bot handling
Your approach to safe parallel scraping (without getting blocked)
Whether you recommend Playwright or Selenium for scaling
Estimated timeline and cost
Work Approach
We will proceed using milestones for security.
You can first improve the script and share initial results, and then we will continue further.
Looking forward to working with you.
Thanks!