Web Scraper for Dubizzle Car Listings
Budget: $1,500 – $3,000 USD
Job Description
We are seeking an experienced freelancer to develop a web scraper and tracking bot to monitor car listings on Dubizzle and DubiCars The project involves creating a system to automatically track when cars are added, updated, and deleted from the Dubizzle marketplace. The key requirements are:
#### Key Responsibilities:
1. **Web Scraping**:
- Develop a web scraper to extract car listing data from Dubizzle, including car ID, title, description, price, and timestamps.
- Ensure the scraper runs periodically to check for new, updated, and deleted listings.
2. **Database Management**:
- Design and implement a database to store the scraped data.
- Track the addition and deletion timestamps of each car listing.
3. **Backend Development**:
- Build a backend using a suitable framework (e.g., Django, Flask) to handle data storage, processing, and API requests.
- Implement an API to access the tracked data with filtering options.
4. **Frontend Development**:
- Create a user interface to display the tracked data.
- Implement features like search, filter, and notifications for changes in listings.
5. **Automation**:
- Schedule the scraper to run at regular intervals using cron jobs or another task scheduler.
- Ensure the system can handle frequent updates efficiently.
6. **Notification System**:
- Set up a notification system (email, SMS) to alert users about changes in listings.
#### Skills Required:
- Proficiency in web scraping tools (e.g., BeautifulSoup, Scrapy).
- Strong knowledge of backend frameworks (e.g., Django, Flask).
- Experience with database design and management.
- Frontend development skills (HTML, CSS, JavaScript).
- Familiarity with task scheduling (e.g., cron jobs).
- Good understanding of API development and integration.
- Attention to detail and ability to handle dynamic web content.
#### Additional Information:
- Ensure compliance with Dubizzle's terms of service regarding data scraping.
- Provide documentation for the developed system.
- Be available for ongoing maintenance and updates as needed.
If you have the expertise to build this system and are interested in this project, please apply with your relevant experience and examples of similar work you have completed.
We are seeking an experienced freelancer to develop a web scraper and tracking bot to monitor car listings on Dubizzle and DubiCars The project involves creating a system to automatically track when cars are added, updated, and deleted from the Dubizzle marketplace. The key requirements are:
#### Key Responsibilities:
1. **Web Scraping**:
- Develop a web scraper to extract car listing data from Dubizzle, including car ID, title, description, price, and timestamps.
- Ensure the scraper runs periodically to check for new, updated, and deleted listings.
2. **Database Management**:
- Design and implement a database to store the scraped data.
- Track the addition and deletion timestamps of each car listing.
3. **Backend Development**:
- Build a backend using a suitable framework (e.g., Django, Flask) to handle data storage, processing, and API requests.
- Implement an API to access the tracked data with filtering options.
4. **Frontend Development**:
- Create a user interface to display the tracked data.
- Implement features like search, filter, and notifications for changes in listings.
5. **Automation**:
- Schedule the scraper to run at regular intervals using cron jobs or another task scheduler.
- Ensure the system can handle frequent updates efficiently.
6. **Notification System**:
- Set up a notification system (email, SMS) to alert users about changes in listings.
#### Skills Required:
- Proficiency in web scraping tools (e.g., BeautifulSoup, Scrapy).
- Strong knowledge of backend frameworks (e.g., Django, Flask).
- Experience with database design and management.
- Frontend development skills (HTML, CSS, JavaScript).
- Familiarity with task scheduling (e.g., cron jobs).
- Good understanding of API development and integration.
- Attention to detail and ability to handle dynamic web content.
#### Additional Information:
- Ensure compliance with Dubizzle's terms of service regarding data scraping.
- Provide documentation for the developed system.
- Be available for ongoing maintenance and updates as needed.
If you have the expertise to build this system and are interested in this project, please apply with your relevant experience and examples of similar work you have completed.