Puppeteer Developer for Web scraping Project
Budget: $30 – $250 USD
We're looking for a talented developer with extensive experience in Puppeteer, web scraping, and backend development. The successful candidate will work on a project that involves generating and managing headers for various websites, and providing a REST API endpoint to retrieve the stored data.
Responsibilities:
Develop a generalized Puppeteer script to browse websites and log in using account details.
Manage account username/password in a database.
Create a routine to generate and store headers retrieved from the websites in a database.
Provide a REST API endpoint to retrieve the stored data.
Monitor the performance of the developed scripts and optimize as necessary.
Ensure the developed solution is compliant with all relevant laws and terms of service.
Conduct comprehensive testing to ensure the system operates correctly, including under different loads.
Requirements:
Proven experience in Puppeteer and web scraping.
Strong knowledge of backend development, especially in Node.js or similar frameworks.
Experience in managing databases.
Strong understanding of REST API design and implementation.
Ability to write clean, well-documented code.
Excellent problem-solving skills and attention to detail.
Strong understanding of web security and data protection.
Familiarity with rate-limiting issues in web scraping and ways to work around them is a plus.
If you are a driven developer who loves challenges and is eager to work on an exciting project, please apply with your resume and a cover letter detailing your relevant experiences. We look forward to hearing from you!
Responsibilities:
Develop a generalized Puppeteer script to browse websites and log in using account details.
Manage account username/password in a database.
Create a routine to generate and store headers retrieved from the websites in a database.
Provide a REST API endpoint to retrieve the stored data.
Monitor the performance of the developed scripts and optimize as necessary.
Ensure the developed solution is compliant with all relevant laws and terms of service.
Conduct comprehensive testing to ensure the system operates correctly, including under different loads.
Requirements:
Proven experience in Puppeteer and web scraping.
Strong knowledge of backend development, especially in Node.js or similar frameworks.
Experience in managing databases.
Strong understanding of REST API design and implementation.
Ability to write clean, well-documented code.
Excellent problem-solving skills and attention to detail.
Strong understanding of web security and data protection.
Familiarity with rate-limiting issues in web scraping and ways to work around them is a plus.
If you are a driven developer who loves challenges and is eager to work on an exciting project, please apply with your resume and a cover letter detailing your relevant experiences. We look forward to hearing from you!