Scraping a dynamically updated website
Budget: $30 – $250 USD
Introduction:
We are seeking a skilled and experienced freelancer to assist us in scraping data from a real estate website. The purpose of this project is to gather relevant information for market research and analysis. The successful candidate will be responsible for developing a robust and efficient web scraping script that can be easily handed over to our team for future use.
Project Scope:
The freelancer will be required to extract specific data fields from the target real estate website. The data should be organized and saved in a JSON file format for easy analysis.
Technical Requirements:
Scraping Code:
Develop a Python-based web scraping script using a library like BeautifulSoup or Scrapy.
Ensure the script is easily customizable for future modifications by our team.
Data Fields:
Extract a comprehensive set of data fields relevant to our research objectives.
Property details, pricing, location, and amenities are key fields of interest.
IP Rotation:
Implement IP rotation using a service to be purchased by us (please specify any preferred service you recommend).
Provide documentation on how to integrate and configure the purchased IP rotation service within the code.
Error Handling:
Include robust error-handling mechanisms to ensure the script continues to run smoothly even in the event of disruptions.
Deliverables:
Python script for web scraping with clear documentation.
Organized dataset in a JSON file with extracted data fields.
Timeline:
The project is expected to be completed within one day from the start date, with regular updates provided to our team.
Budget:
Please submit your proposed budget for the entire project, excluding the cost of the IP rotation service, as we will purchase it separately.
Proposal Submission:
Interested freelancers are invited to submit their proposals by. Proposals should include details on relevant experience, a sample of previous work (if available), and a breakdown of the proposed budget.
Selection Criteria:
Proposals will be evaluated based on the freelancer's experience in web scraping, ability to meet technical requirements, and overall cost-effectiveness.
Thank you for your prompt response and interest in working with us.
Sincerely,
We are seeking a skilled and experienced freelancer to assist us in scraping data from a real estate website. The purpose of this project is to gather relevant information for market research and analysis. The successful candidate will be responsible for developing a robust and efficient web scraping script that can be easily handed over to our team for future use.
Project Scope:
The freelancer will be required to extract specific data fields from the target real estate website. The data should be organized and saved in a JSON file format for easy analysis.
Technical Requirements:
Scraping Code:
Develop a Python-based web scraping script using a library like BeautifulSoup or Scrapy.
Ensure the script is easily customizable for future modifications by our team.
Data Fields:
Extract a comprehensive set of data fields relevant to our research objectives.
Property details, pricing, location, and amenities are key fields of interest.
IP Rotation:
Implement IP rotation using a service to be purchased by us (please specify any preferred service you recommend).
Provide documentation on how to integrate and configure the purchased IP rotation service within the code.
Error Handling:
Include robust error-handling mechanisms to ensure the script continues to run smoothly even in the event of disruptions.
Deliverables:
Python script for web scraping with clear documentation.
Organized dataset in a JSON file with extracted data fields.
Timeline:
The project is expected to be completed within one day from the start date, with regular updates provided to our team.
Budget:
Please submit your proposed budget for the entire project, excluding the cost of the IP rotation service, as we will purchase it separately.
Proposal Submission:
Interested freelancers are invited to submit their proposals by. Proposals should include details on relevant experience, a sample of previous work (if available), and a breakdown of the proposed budget.
Selection Criteria:
Proposals will be evaluated based on the freelancer's experience in web scraping, ability to meet technical requirements, and overall cost-effectiveness.
Thank you for your prompt response and interest in working with us.
Sincerely,