Scrape Text & Create Questions

I’m building a new assessment platform and need two tightly-linked tasks handled end-to-end.

Task 1 – Text extraction
You’ll scrape raw text only (no images, no tables) from a list of public websites plus several PDF documents I supply. Consolidate everything into a clean UTF-8 CSV with these columns: Source (URL or file name), Section/Heading, Paragraph text.

Task 2 – Question generation
From that corpus, create multiple-choice questions ready for bulk upload to the platform. For each question include: Question stem, Option A-D, Correct option, and a short explanation—all in the same CSV format.

Acceptance criteria
• Scraper reliably pulls every assigned page and PDF without omissions or duplicates.
• Final CSV imports without errors and respects the column order above.
• Questions are clear, unambiguous, and factually drawn from the scraped content.

Feel free to use your preferred stack—Python with BeautifulSoup, Scrapy, PyPDF2, or any equivalent tools work for me—as long as the deliverables meet the format and quality stated.