Programmer for Web scraping and Web Crawling v.2
Budget: $5 – $15 USD
THIS PROJECT IS THE SAME I HAVE PUBLISHED YESTERDAY, WHICH FOR SOME REASON DIDN'T PASS THE FREELANCER CHECK: SO I'M REPUBLISHING IT.
Role Description:
Looking for a developer with experience in designing and maintaining online data-scraping systems. The ideal candidate will be responsible for developing and maintaining tools for extracting data from web pages and have proven ability to use and configure major data collection services such as Smartproxy, Bright Data, and virtual browsers.
Responsibilities:
Development and maintenance of web applications dedicated to online data collection
Versioning and archiving on Github
Deployment on servers via CI/CD
Development of new features
Troubleshooting and performance optimization
Requirements:
In-depth knowledge of at least one language used for scraping: NodeJs, Python, etc.
Specific frameworks and libraries for data collection (e.g., Puppeteer for Node.js)
Knowledge of relational and non-relational DBMS (e.g., MySQL, MongoDB)
Experience with API integration and external services
Strong problem-solving skills and attention to detail
Ability to work both independently and as part of a team
Additional Skills (optional but appreciated):
Role Description:
Looking for a developer with experience in designing and maintaining online data-scraping systems. The ideal candidate will be responsible for developing and maintaining tools for extracting data from web pages and have proven ability to use and configure major data collection services such as Smartproxy, Bright Data, and virtual browsers.
Responsibilities:
Development and maintenance of web applications dedicated to online data collection
Versioning and archiving on Github
Deployment on servers via CI/CD
Development of new features
Troubleshooting and performance optimization
Requirements:
In-depth knowledge of at least one language used for scraping: NodeJs, Python, etc.
Specific frameworks and libraries for data collection (e.g., Puppeteer for Node.js)
Knowledge of relational and non-relational DBMS (e.g., MySQL, MongoDB)
Experience with API integration and external services
Strong problem-solving skills and attention to detail
Ability to work both independently and as part of a team
Additional Skills (optional but appreciated):