Python Developer Needed for Etsy Web Scraping Project
Budget: €30 – €250 EUR
Description:
We are looking for an experienced Python developer to build a web scraping script that extracts data from Etsy.com. This project is part of a broader initiative to analyze product trends, seller performance, and customer reviews using Power BI. The script must extract structured data from different types of Etsy pages (search results, listings, seller profiles, and reviews) and organize it into interconnected tables.
Project Scope:
The script must:
- Accept a search keyword or Etsy search page URL as input.
- Navigate through the Etsy search results and extract data about products, sellers, and reviews.
- Generate 4 structured datasets (Search Page, Listing Page, Seller, Reviews) with primary and foreign keys to link the tables.
- Export the data in a format compatible with Power BI (CSV or TXT).
- Include automatic reference IDs (e.g. Searchpage00001, Listingpage00001, etc.).
Required Tables & Fields:
1. Search Page Table
Fields: Searchpage_ref, Keyword, Link, Title, Rating, Reviews_number, Price, Page_number, Link_to_the_listing
2. Listing Page Table
Fields: Listingpage_ref, Link_to_the_listing, Title, Price, Listed_on, Seller_name, Link_to_the_seller_page, Rating, Reviews_number_to_this_item, Reviews_number_to_other_items
3. Seller Table
Fields: Seller_ref, Link_to_the_seller_page, Seller_name, Location, Status_on_etsy, Number_of_sales, On_etsy_since, Seller_rating, Seller_Reviews_number
4. Reviews Table
- Fields: Review_ref, Link_to_the_listing, Review_page_number, Reviewer_name, Review_date, Review_rating, Review_text, Recommand_this_item?, Item_quality_rating, Delivery_rating, Customer_service_rating
- Ideal Candidate Should Have
Solid experience in Python and web scraping (requests, BeautifulSoup, Selenium, or Scrapy).
- Knowledge of data structuring and foreign key relationships.
- Understanding of anti-bot mechanisms and how to bypass them responsibly.
-Experience with Power BI or similar tools is a plus.
Timeline & Budget:
Please provide:
- Estimated timeline to complete the first functional version.
- Your proposed budget (we are looking for affordable but reliable work).
To Apply:
- Share relevant scraping projects you've done (preferably with e-commerce platforms).
- Confirm your ability to structure data into relational tables.
- Suggest your approach briefly (tool choice, how you’ll handle pagination, etc.).
We are looking for an experienced Python developer to build a web scraping script that extracts data from Etsy.com. This project is part of a broader initiative to analyze product trends, seller performance, and customer reviews using Power BI. The script must extract structured data from different types of Etsy pages (search results, listings, seller profiles, and reviews) and organize it into interconnected tables.
Project Scope:
The script must:
- Accept a search keyword or Etsy search page URL as input.
- Navigate through the Etsy search results and extract data about products, sellers, and reviews.
- Generate 4 structured datasets (Search Page, Listing Page, Seller, Reviews) with primary and foreign keys to link the tables.
- Export the data in a format compatible with Power BI (CSV or TXT).
- Include automatic reference IDs (e.g. Searchpage00001, Listingpage00001, etc.).
Required Tables & Fields:
1. Search Page Table
Fields: Searchpage_ref, Keyword, Link, Title, Rating, Reviews_number, Price, Page_number, Link_to_the_listing
2. Listing Page Table
Fields: Listingpage_ref, Link_to_the_listing, Title, Price, Listed_on, Seller_name, Link_to_the_seller_page, Rating, Reviews_number_to_this_item, Reviews_number_to_other_items
3. Seller Table
Fields: Seller_ref, Link_to_the_seller_page, Seller_name, Location, Status_on_etsy, Number_of_sales, On_etsy_since, Seller_rating, Seller_Reviews_number
4. Reviews Table
- Fields: Review_ref, Link_to_the_listing, Review_page_number, Reviewer_name, Review_date, Review_rating, Review_text, Recommand_this_item?, Item_quality_rating, Delivery_rating, Customer_service_rating
- Ideal Candidate Should Have
Solid experience in Python and web scraping (requests, BeautifulSoup, Selenium, or Scrapy).
- Knowledge of data structuring and foreign key relationships.
- Understanding of anti-bot mechanisms and how to bypass them responsibly.
-Experience with Power BI or similar tools is a plus.
Timeline & Budget:
Please provide:
- Estimated timeline to complete the first functional version.
- Your proposed budget (we are looking for affordable but reliable work).
To Apply:
- Share relevant scraping projects you've done (preferably with e-commerce platforms).
- Confirm your ability to structure data into relational tables.
- Suggest your approach briefly (tool choice, how you’ll handle pagination, etc.).