Programmer for Scraping and Web Crawling

Job ID: 38149279

Budget: €12 – €18 EUR

Role Description:
Looking for a developer with experience in designing and maintaining online data-scraping systems. He will develop and maint tools for extracting data from web pages and have proven ability to use and configure major data collection services such as Smartproxy, Bright Data, and virtual browsers.

Responsibilities:
Development and maintenance of web applications dedicated to online data collection
Versioning and archiving on Github
Deployment on servers via CI/CD
Collaboration to design and implement new features
Troubleshooting and performance optimization

Requirements:
In-depth knowledge of at least one language used for scraping: NodeJs, Python, etc.
Specific frameworks and libraries for data collection (e.g., Puppeteer for Node.js)
Knowledge of relational and non-relational DBMS (e.g., MySQL, MongoDB)
Experience with API integration and external services
Strong problem-solving skills and attention to detail
Ability to work both independently and as part of a team
Additional Skills (optional but appreciated): experience with Agile/Scrum methodologies