Website Help Files Scraper

Job ID: 39708357

Budget: $30 – $250 USD

I need every page in a website’s public Help/Support site copied down into individual .txt files. The goal is a clean, offline archive I can search locally.

Scope of work
• Crawl the entire Help area I’ll provide, automatically following internal links until every link is reached.
• Capture full page content—headings, paragraphs, lists, code snippets, tables, anything that carries text. No sections are to be skipped.
• Write each article to its own UTF-8 plain-text file, naming the file exactly after the page title (sanitise characters that aren’t allowed in filenames).

Preferred workflow
Use whatever stack suits you—Python with requests/BeautifulSoup or Scrapy, Node with Cheerio, etc.—as long as I receive:
1. A ready-to-run script (with a brief README) so I can repeat the scrape later.
2. A zipped folder of all generated .txt files.

Acceptance criteria
• Every live help article is present once and only once.
• Filenames mirror page titles correctly.
• No encoding glitches or HTML tags left in the output.

Let me know your approach and turnaround time, and feel free to ask for the target URL right away.