Website Data Extractor

I am looking to build a website data extractor. Specifically, I need to be able to extract text and information from websites as well as from databases. The data should be organized into a spreadsheet format, so that I can more easily analyze and use the data I obtain. The data extractor needs to be thorough and able to collect data from a variety of different websites sources in an efficient manner. It should be able to identify and capture text, images, or both - whichever is necessary for the project. It should also be able to search databases and identify the relevant data.

I need something reliable and efficient, as I am depending on it to gather data quickly for a variety of purposes. If you are confident in your ability to create this data extractor, I would welcome your help in this project.

My description of the task is as follows:




I am looking for posibly an MS Excel VBA script or Excel Web Queries to go to a set of pre-determined web sites and pull out ALL the current product data like name, description, part code, price etc and then put this into an excel sheet in different tabs based on the website name. I want to be able to run this script periodically to refresh the data in my excel sheet (& tabs).

I may possibly need an html piece of code to go to the website and access the sql database behind the website and extract all the data from there. Hope this makes sense.

Example from the shoe site.
I want to pull all the data about their shoes into a CSV file or MS Excel.

Make Product code Description Size Price
Jones Jn234r Red Slip on shoes Size 7 £9.99
Smith Sm987t White Flip Flops Size 5 £4.99

I am looking to get data from approx. 10 sites.