Real Estate Web Scraping Expert Needed
Budget: ₹600 – ₹1,500 INR
I'm seeking a seasoned web scraper to extract real estate data from a couple of major websites. The aim is to compile a comprehensive dataset of property listings, capturing details such as prices, locations, descriptions, images, and agent contact information.
Key Requirements:
- Target Websites: The scraping task will focus on 1 to 3 selected real estate platforms.
- Critical Data Points: The most important details to capture include prices, locations, and descriptions. Additional data such as images and agent contact information, property types, and amenities will be beneficial.
- Automation & Scaling: The freelancer must be able to efficiently scrape multiple pages, including dynamic content and large datasets.
- Data Format: The scraped data needs to be delivered in JSON format.
- Error Handling: The implementation of retry mechanisms and strategies to bypass anti-scraping measures is crucial.
Skills Required:
- Proficiency in Python (Scrapy, BeautifulSoup, Selenium) or JavaScript (Puppeteer).
- Prior experience with web scraping large sites and managing challenges such as CAPTCHAs and IP blocks.
- Competence in data processing and storage, particularly with SQL and NoSQL databases.
The ideal candidate will have a proven track record in web scraping with the ability to deliver structured data efficiently and effectively.
Key Requirements:
- Target Websites: The scraping task will focus on 1 to 3 selected real estate platforms.
- Critical Data Points: The most important details to capture include prices, locations, and descriptions. Additional data such as images and agent contact information, property types, and amenities will be beneficial.
- Automation & Scaling: The freelancer must be able to efficiently scrape multiple pages, including dynamic content and large datasets.
- Data Format: The scraped data needs to be delivered in JSON format.
- Error Handling: The implementation of retry mechanisms and strategies to bypass anti-scraping measures is crucial.
Skills Required:
- Proficiency in Python (Scrapy, BeautifulSoup, Selenium) or JavaScript (Puppeteer).
- Prior experience with web scraping large sites and managing challenges such as CAPTCHAs and IP blocks.
- Competence in data processing and storage, particularly with SQL and NoSQL databases.
The ideal candidate will have a proven track record in web scraping with the ability to deliver structured data efficiently and effectively.