Web Scraping Developer Needed - Zyte API & Automation Expertise
Budget: ₹400 – ₹750 INR
Seeking a Web Scraping Developer to optimize and expand our scraping infrastructure using Zyte.com. Tasks include code migration, script improvements, scheduling, unit testing, and WordPress integration.
Key Responsibilities:
-Migrate app to our GitHub/server, update passwords.
-Fix scraping issues, improve CSV exports.
-Enable script settings via dashboard/config file.
-Implement unit testing, automate error alerts.
-Develop API for WordPress integration.
-Optimize data management, track updates.
Requirements:
-Python, Scrapy, Selenium, Zyte API experience.
-Database management (PostgreSQL, MySQL).
-API development, WordPress integration.
-GitHub proficiency, automation & scheduling.
Full milestone details will be provided via Google Doc.
The app already exists, we just need someone to fix issues, improve it, and complete the project.
Communication Expectations:
- 24 hr response to inquiries (Monday-Friday)
- Deadlines will be set for work products and agreed upon deadlines will be kept.
- 24 hr Response for small changes (Monday-Friday)
Notification in advance of any times you will not be available to respond within 24 hours (holidays) or meet a deadline. Also, any notification in advance if you are sick and will not be able to hit a deadline. When a deadline is missed we'll re-negotiate any deadlines and try to resolve difficulties that prevented hitting the deadline.
- Weekly updates on the project with drafts submitted to show progress.
- 3 Day Draft Completion: Each project iteration will be completed within 3 days from assigning the list of changes that need to be addresses
Key Responsibilities:
-Migrate app to our GitHub/server, update passwords.
-Fix scraping issues, improve CSV exports.
-Enable script settings via dashboard/config file.
-Implement unit testing, automate error alerts.
-Develop API for WordPress integration.
-Optimize data management, track updates.
Requirements:
-Python, Scrapy, Selenium, Zyte API experience.
-Database management (PostgreSQL, MySQL).
-API development, WordPress integration.
-GitHub proficiency, automation & scheduling.
Full milestone details will be provided via Google Doc.
The app already exists, we just need someone to fix issues, improve it, and complete the project.
Communication Expectations:
- 24 hr response to inquiries (Monday-Friday)
- Deadlines will be set for work products and agreed upon deadlines will be kept.
- 24 hr Response for small changes (Monday-Friday)
Notification in advance of any times you will not be available to respond within 24 hours (holidays) or meet a deadline. Also, any notification in advance if you are sick and will not be able to hit a deadline. When a deadline is missed we'll re-negotiate any deadlines and try to resolve difficulties that prevented hitting the deadline.
- Weekly updates on the project with drafts submitted to show progress.
- 3 Day Draft Completion: Each project iteration will be completed within 3 days from assigning the list of changes that need to be addresses