Website Help Files Scraper
Budget: $30 – $250 USD
I need every page in a website’s public Help/Support site copied down into individual .txt files. The goal is a clean, offline archive I can search locally.
Scope of work
• Crawl the entire Help area I’ll provide, automatically following internal links until every link is reached.
• Capture full page content—headings, paragraphs, lists, code snippets, tables, anything that carries text. No sections are to be skipped.
• Write each article to its own UTF-8 plain-text file, naming the file exactly after the page title (sanitise characters that aren’t allowed in filenames).
Preferred workflow
Use whatever stack suits you—Python with requests/BeautifulSoup or Scrapy, Node with Cheerio, etc.—as long as I receive:
1. A ready-to-run script (with a brief README) so I can repeat the scrape later.
2. A zipped folder of all generated .txt files.
Acceptance criteria
• Every live help article is present once and only once.
• Filenames mirror page titles correctly.
• No encoding glitches or HTML tags left in the output.
Let me know your approach and turnaround time, and feel free to ask for the target URL right away.
Scope of work
• Crawl the entire Help area I’ll provide, automatically following internal links until every link is reached.
• Capture full page content—headings, paragraphs, lists, code snippets, tables, anything that carries text. No sections are to be skipped.
• Write each article to its own UTF-8 plain-text file, naming the file exactly after the page title (sanitise characters that aren’t allowed in filenames).
Preferred workflow
Use whatever stack suits you—Python with requests/BeautifulSoup or Scrapy, Node with Cheerio, etc.—as long as I receive:
1. A ready-to-run script (with a brief README) so I can repeat the scrape later.
2. A zipped folder of all generated .txt files.
Acceptance criteria
• Every live help article is present once and only once.
• Filenames mirror page titles correctly.
• No encoding glitches or HTML tags left in the output.
Let me know your approach and turnaround time, and feel free to ask for the target URL right away.
Related categories:
JavaScript
Python
Web Scraping
Django
Node.js
Web Development
Scrapy
Data Extraction
BeautifulSoup
Automation