Indefinite Web Scraping using Python
Budget: $30 – $250 USD
I am searching for an experienced Python developer who can assist in a web scraping project. The specific site to scrape is undecided, however, it will be of large scale, like Amazon or eBay or informational like Wikipedia. Given the undefined nature of the project, flexibility and adaptability will be key.
Here are the potential tasks I'm expecting to be delivered:
1. Data Extraction: The ability to extract various data elements such as product names, prices and, descriptions is critical. However, the specific data points remain undefined, giving room for negotiation and adjustments.
2. Page Navigation: The project might involve scraping diverse pages or sections of websites such as the homepage, product pages, or category pages. Understanding of structured site navigation and ability to implement it in a scraping code is essential.
The ideal applicant should have proven experience in web scraping, be proficient in Python and possess the flexibility to adapt to shifting requirements. Knowledge of various scraping frameworks, and ability to handle potential site restrictions like CAPTCHAs, are added advantages.
Please take note the specifics of the project are indeterminate and may involve numerous edits and adjustments post-hiring. If interested, kindly submit your proposal with prior work examples, proposed methodologies and potential obstacles you might think of. Your comprehension capacity and problem-solving abilities are as substantive as your technical skills in this case.
Here are the potential tasks I'm expecting to be delivered:
1. Data Extraction: The ability to extract various data elements such as product names, prices and, descriptions is critical. However, the specific data points remain undefined, giving room for negotiation and adjustments.
2. Page Navigation: The project might involve scraping diverse pages or sections of websites such as the homepage, product pages, or category pages. Understanding of structured site navigation and ability to implement it in a scraping code is essential.
The ideal applicant should have proven experience in web scraping, be proficient in Python and possess the flexibility to adapt to shifting requirements. Knowledge of various scraping frameworks, and ability to handle potential site restrictions like CAPTCHAs, are added advantages.
Please take note the specifics of the project are indeterminate and may involve numerous edits and adjustments post-hiring. If interested, kindly submit your proposal with prior work examples, proposed methodologies and potential obstacles you might think of. Your comprehension capacity and problem-solving abilities are as substantive as your technical skills in this case.