Web Scraping Enhancement onto 2 Half-Baked Python Scripts, with Automation
Budget: $30 – $250 USD
I have two half-written / half-baked Python scripts for web scraping that need enhancement and completion. The aim is to scrape image-sharing websites for both images and accompanying text. Need to automatically register/ sign in and automatically login , as well as automatically identify the right html fields on each site to target the right content to be scraped, usually images and accompanying text. Likewise, need the corresponding field on each site to post images and text back to the corresponding sites. So willingness to research for these relevant fields is compulsory.
Key Responsibilities:
- Improve and complete the existing Python scripts using Selenium or Scrapy
- Conduct research to select the appropriate fields for content extraction
- Implement functionalities for user registration, login, and content retrieval
- Incorporate 3rd party service to automatically answer SPAM-CATCHA questions whenever SPAM-CATCHA prompt arises during the scraping. Script will automatically allocate 3rd Party service's real-human to answer the SPAM-CATCHA and go through successfully. => You have to research the right vendor and incorporate their code onto the script. Our side will pay on per-use case.
I will provide the specific platforms to be scraped, which are indicated in the partially written scripts, ie the half-baked python scripts.
Ideal Skills and Experience:
- Extensive experience with Python, Selenium, and Scrapy
- Proven track record in web scraping, particularly from image-sharing websites
- Strong research skills to identify relevant content fields
- Ability to work independently with minimal supervision
Please note: Milestones may be created upfront but will not be released until the project is fully delivered. No requests for upfront milestone release will be accepted.
Also, the Bid Price must be Authentic and Fully Representative of the total price of the project, such that there will be no subsequent request to ask for more fees or additional price.
When you bid, you agree to these terms and conditions
Key Responsibilities:
- Improve and complete the existing Python scripts using Selenium or Scrapy
- Conduct research to select the appropriate fields for content extraction
- Implement functionalities for user registration, login, and content retrieval
- Incorporate 3rd party service to automatically answer SPAM-CATCHA questions whenever SPAM-CATCHA prompt arises during the scraping. Script will automatically allocate 3rd Party service's real-human to answer the SPAM-CATCHA and go through successfully. => You have to research the right vendor and incorporate their code onto the script. Our side will pay on per-use case.
I will provide the specific platforms to be scraped, which are indicated in the partially written scripts, ie the half-baked python scripts.
Ideal Skills and Experience:
- Extensive experience with Python, Selenium, and Scrapy
- Proven track record in web scraping, particularly from image-sharing websites
- Strong research skills to identify relevant content fields
- Ability to work independently with minimal supervision
Please note: Milestones may be created upfront but will not be released until the project is fully delivered. No requests for upfront milestone release will be accepted.
Also, the Bid Price must be Authentic and Fully Representative of the total price of the project, such that there will be no subsequent request to ask for more fees or additional price.
When you bid, you agree to these terms and conditions