Online travel agency worldwide database build scraping
Budget: $10 – $150 USD
Purpose: Automatically find online travel agencies that sell flight tickets. Steps: List of keywords: "buy flight tickets online" "online travel agency" "cheap flights booking" cheap flight online travel agency Use of search engines: Write a script that queries the above keywords in Google Custom Search API or Bing Search API.Collect Results:Collect the URLs of the first 10000 results for each keyword.Analyze Pages:Use NLP and text classification models to identify pages that actually sell airline tickets.Data Structure:Identify and save the following data from pages:Agency NameWebsite URLServicesContact InformationAutomated Update:Set up a weekly update to repeat the search process and scraping.