Python Web Scraping Expert Needed for Product Information Extraction
Budget: $30 – $250 AUD
We are seeking a skilled Python developer with expertise in web scraping to create a script that extracts product information from websites. The solution must be efficient, reliable, and capable of handling diverse website structures.
Project Requirements:
Domain Extraction: Start with a large array of email addresses and extract their respective domains.
PDF Search: For each domain, search for downloadable product sheets in PDF format.
HTML Product Extraction: If PDFs are unavailable, extract product information directly from the HTML content of the website.
Robustness: Ensure the script is adaptable to handle varying formats and structures of product information across different websites.
Desired Qualifications:
Proven experience in Python web scraping (e.g., using libraries such as BeautifulSoup, Scrapy, or Selenium).
Familiarity with handling complex website structures.
Ability to develop error-handling mechanisms for non-standard cases.
Examples of similar projects delivered successfully.
Deliverables:
A well-documented Python script.
Instructions on how to run the script.
Sample output from a test run to verify functionality.
Project Requirements:
Domain Extraction: Start with a large array of email addresses and extract their respective domains.
PDF Search: For each domain, search for downloadable product sheets in PDF format.
HTML Product Extraction: If PDFs are unavailable, extract product information directly from the HTML content of the website.
Robustness: Ensure the script is adaptable to handle varying formats and structures of product information across different websites.
Desired Qualifications:
Proven experience in Python web scraping (e.g., using libraries such as BeautifulSoup, Scrapy, or Selenium).
Familiarity with handling complex website structures.
Ability to develop error-handling mechanisms for non-standard cases.
Examples of similar projects delivered successfully.
Deliverables:
A well-documented Python script.
Instructions on how to run the script.
Sample output from a test run to verify functionality.