Web Content Crawler and Exporter
Budget: $30 – $250 USD
I need an expert to crawl a list of 15,000 URLs, extract text content from specific pages, and deliver the data in a .csv file.
Key Project Details:
- I require the text content from multiple web pages across different sites.
- The data should be organized and structured within a CSV file.
Key Requirements:
- Ability to crawl and extract text content from URLs.
- Proficiency in data exporting and organization.
- Expertise in creating and handling CSV files.
Process:
- I will provide you 15 .csv files. Each has about 1000 URLs.
- Crawl the URLs in each file to gather specific text elements on each page.
- Save the contents of each page on a row in a different .csv file.
- For example the contents from the URLs in URL_Links_001.csv will be saved into a .csv file called URL_Contents_001.csv
Key Project Details:
- I require the text content from multiple web pages across different sites.
- The data should be organized and structured within a CSV file.
Key Requirements:
- Ability to crawl and extract text content from URLs.
- Proficiency in data exporting and organization.
- Expertise in creating and handling CSV files.
Process:
- I will provide you 15 .csv files. Each has about 1000 URLs.
- Crawl the URLs in each file to gather specific text elements on each page.
- Save the contents of each page on a row in a different .csv file.
- For example the contents from the URLs in URL_Links_001.csv will be saved into a .csv file called URL_Contents_001.csv