Experienced Developer for Web Scraping System
Budget: $250 – $750 USD
I am in need of a highly experienced programmer and software developer to create a system that automates the process of logging into an app daily, gathering unique article links, and scraping their full content. The content should be stored in JSON format in the cloud. The articles will be sourced from a specified list of 204 websites, which I will provide. This system should be reliable and efficient for everyday use.
Key Requirements:
- Develop a system to log in to an app and scrape article content daily
- Extract full content from unique article links in JSON format
- Store the scraped data in a cloud service (choice of service is open)
- The system should be compatible with a Windows PC environment
Ideal Skills and Experience:
- Proficiency in JavaScript and Puppeteer for web scraping tasks. it can be done in any language.
- Experience in developing automated systems for data extraction
- Familiarity with cloud storage solutions for data management
- Strong problem-solving skills and attention to detail
I am looking forward to working with a developer who can deliver a robust and user-friendly solution for my daily scraping needs.
Key Requirements:
- Develop a system to log in to an app and scrape article content daily
- Extract full content from unique article links in JSON format
- Store the scraped data in a cloud service (choice of service is open)
- The system should be compatible with a Windows PC environment
Ideal Skills and Experience:
- Proficiency in JavaScript and Puppeteer for web scraping tasks. it can be done in any language.
- Experience in developing automated systems for data extraction
- Familiarity with cloud storage solutions for data management
- Strong problem-solving skills and attention to detail
I am looking forward to working with a developer who can deliver a robust and user-friendly solution for my daily scraping needs.