Data Automation: Scraping, Consolidation & Matching
Budget: ₹1,500 – ₹12,500 INR
Project Title: Data Consolidation, Web Scraping & Product Matching Automation
Project Description:
I am looking for a skilled freelancer to automate and execute the following tasks efficiently:
1️⃣ Data Consolidation & Duplicate Removal
I have 25+ Excel sheets containing product details (part number, description, price, HSN code, GST rate, etc.).
Some products are repeated across multiple sheets.
I need a single consolidated sheet with all unique products.
The sheet must eliminate duplicate entries and retain only one entry per product.
2️⃣ Web Scraping – Competitor’s Website
I need to scrape product data from a competitor’s website.
The scraped data should include part number, description, price, and any available product details.
Data should be formatted and saved in Excel/Google Sheets.
3️⃣ Cross-Referencing with Another Website
The consolidated sheet should be compared against another website’s product database.
The goal is to find and extract cross-reference numbers for each part number.
The final output should be a complete list of part numbers and their cross-references in Excel.
Requirements:
✔️ Experience in Python, Web Scraping (BeautifulSoup/Scrapy/Selenium)
✔️ Proficiency in Excel Automation (Pandas, OpenPyXL, VBA, or Google Sheets API)
✔️ Ability to handle large datasets efficiently
✔️ Experience with data matching & comparison techniques
Deliverables:
✅ Consolidated Excel Sheet (cleaned & de-duplicated)
✅ Scraped Product Data (structured in an Excel file)
✅ Final Cross-Reference Sheet with matched part numbers
Additional Notes:
Need to automate this process for future use.
The project needs to be completed within a 1 week
Project Description:
I am looking for a skilled freelancer to automate and execute the following tasks efficiently:
1️⃣ Data Consolidation & Duplicate Removal
I have 25+ Excel sheets containing product details (part number, description, price, HSN code, GST rate, etc.).
Some products are repeated across multiple sheets.
I need a single consolidated sheet with all unique products.
The sheet must eliminate duplicate entries and retain only one entry per product.
2️⃣ Web Scraping – Competitor’s Website
I need to scrape product data from a competitor’s website.
The scraped data should include part number, description, price, and any available product details.
Data should be formatted and saved in Excel/Google Sheets.
3️⃣ Cross-Referencing with Another Website
The consolidated sheet should be compared against another website’s product database.
The goal is to find and extract cross-reference numbers for each part number.
The final output should be a complete list of part numbers and their cross-references in Excel.
Requirements:
✔️ Experience in Python, Web Scraping (BeautifulSoup/Scrapy/Selenium)
✔️ Proficiency in Excel Automation (Pandas, OpenPyXL, VBA, or Google Sheets API)
✔️ Ability to handle large datasets efficiently
✔️ Experience with data matching & comparison techniques
Deliverables:
✅ Consolidated Excel Sheet (cleaned & de-duplicated)
✅ Scraped Product Data (structured in an Excel file)
✅ Final Cross-Reference Sheet with matched part numbers
Additional Notes:
Need to automate this process for future use.
The project needs to be completed within a 1 week