Daily Web Scraping and Database Development Open

Job ID: 38290526

Budget: €250 – €750 EUR

We are looking for someone who can help us extract data from a real estate property listings website and organize it into an internal database that we can then use to match our customers to the right property. This external property listings page gets updated everyday with many new properties, many of them are repeated as they get added many times to get exposure. We need a database that can be constantly updated with the new properties that are added and taken off from the listings website. It needs to be easy to do this import/update and we need to be able to filter this database by some of the categories available from the properties. Ideal candidates should demonstrate expertise in: • Data Scraping: The project requires gathering text, image and numeric data from the target site. The ability to fetch and process different data types is essential. • Database Development: To handle the captured data, we need a robust database solution, capable of neatly storing less than 1GB data on a daily basis. • Automated Tasks: The data collection process needs to be executed daily. Your ability to automate tasks to ensure regular, undisrupted data capture is a must. Please ensure you understand these specific needs before placing your bid. Experience with similar tasks will be a plus.
Related categories: PHP Web Scraping MySQL Data Mining Database Programming