E-Commerce Focused Web Crawler Development
Budget: $10 – $30 USD
I am in search of a proficient freelance developer to create a specialized web crawler focused on extracting vital data from e-commerce websites, primarily targeting 'hungerstation.com'.
Key Requirements:
The web crawler must adeptly parse text-based content and efficiently navigate the site's structure to extract pertinent information and links.
Extensive expertise in Web crawling, Web scraping, and Data mining is essential for this project's success.
Prior successful engagements in web scraping projects centered on e-commerce platforms would be greatly advantageous.
Proficiency in programming Python is required.
Familiarity with web scraping frameworks and libraries like BeautifulSoup, Scrapy, or Selenium is highly desirable.
While the initial focus is on 'hungerstation.com', the developed crawler should be adaptable enough to accommodate potential future websites with minimal adjustments.
Additional Considerations:
Given the likelihood of encountering website blocks during scraping attempts, the developer must possess experience in effectively utilizing proxies to mitigate this issue.
Additional Resources:
To aid in understanding the required data structure and selectors, I have prepared a Python script for your reference (Please note: I lack experience in Python). This script will offer insights into the necessary elements for efficient data extraction.
Submission Guidelines:
In your proposal, please showcase examples of previous web crawling projects you've completed, particularly those involving e-commerce sites. Additionally, I have attached a sample of the desired output for your review.
Let's Collaborate:
I am enthusiastic about the potential ahead and eager to collaborate with a skilled developer to achieve our objectives. I look forward to reviewing your proposals and embarking on this journey together!
Key Requirements:
The web crawler must adeptly parse text-based content and efficiently navigate the site's structure to extract pertinent information and links.
Extensive expertise in Web crawling, Web scraping, and Data mining is essential for this project's success.
Prior successful engagements in web scraping projects centered on e-commerce platforms would be greatly advantageous.
Proficiency in programming Python is required.
Familiarity with web scraping frameworks and libraries like BeautifulSoup, Scrapy, or Selenium is highly desirable.
While the initial focus is on 'hungerstation.com', the developed crawler should be adaptable enough to accommodate potential future websites with minimal adjustments.
Additional Considerations:
Given the likelihood of encountering website blocks during scraping attempts, the developer must possess experience in effectively utilizing proxies to mitigate this issue.
Additional Resources:
To aid in understanding the required data structure and selectors, I have prepared a Python script for your reference (Please note: I lack experience in Python). This script will offer insights into the necessary elements for efficient data extraction.
Submission Guidelines:
In your proposal, please showcase examples of previous web crawling projects you've completed, particularly those involving e-commerce sites. Additionally, I have attached a sample of the desired output for your review.
Let's Collaborate:
I am enthusiastic about the potential ahead and eager to collaborate with a skilled developer to achieve our objectives. I look forward to reviewing your proposals and embarking on this journey together!