Looking for Scrapping developer
Budget: $30 – $250 USD
I am looking for a scrapping developer who can help me with a project that requires daily scraping of specific websites. The ideal candidate should have experience in web scraping and data extraction.
Requirements:
Scrapping Target:
Retrieve profile information from Twitter profiles, including profile picture, title, name, bio, followers, etc whilst bypassing secure systems on the Twitter.
Existing API Scrapping Script:
An API scrapping script is available but has limitations on request volume.
Each API key allows a maximum of 10,000 requests per day.
Script Development:
Build the scraping script using Python version 3.10.6.
Performance Test:
Validate the script's performance by scraping profile information from 4000 usernames.
Ensure the script can handle 500 searches within one hour, meeting the testing requirements (each search has to contain 4,000 usernames - implying an hourly capacity of 2m usernames per hour).
Deadline:
You have 23 hours to complete the script development.
After submission, the script will undergo testing for one hour to assess its functionality and performance.
If you have the necessary skills and experience, please submit your proposal along with examples of similar projects you have worked on.
Requirements:
Scrapping Target:
Retrieve profile information from Twitter profiles, including profile picture, title, name, bio, followers, etc whilst bypassing secure systems on the Twitter.
Existing API Scrapping Script:
An API scrapping script is available but has limitations on request volume.
Each API key allows a maximum of 10,000 requests per day.
Script Development:
Build the scraping script using Python version 3.10.6.
Performance Test:
Validate the script's performance by scraping profile information from 4000 usernames.
Ensure the script can handle 500 searches within one hour, meeting the testing requirements (each search has to contain 4,000 usernames - implying an hourly capacity of 2m usernames per hour).
Deadline:
You have 23 hours to complete the script development.
After submission, the script will undergo testing for one hour to assess its functionality and performance.
If you have the necessary skills and experience, please submit your proposal along with examples of similar projects you have worked on.