News Site Scraping Bot

I need a reliable web-scraping bot that automatically pulls fresh content from a specific news site on a schedule I can adjust. At minimum the script should capture the headline and full article text; if author name, publication date, and embedded image URLs can be extracted too, that’s a welcomed bonus.

Build it in Python using a well-supported stack such as Requests/BeautifulSoup, Scrapy, or Selenium—whatever you feel is most robust for handling pagination and occasional layout changes. The bot should:

• Navigate through the latest articles section (and subsequent pages if present)
• Respect robots.txt and reasonable rate-limits
• Output clean, de-duplicated data to CSV or JSON and optionally push to a simple SQLite file

For acceptance I’ll run the script, point it at the live site, and expect a sample file containing at least 100 recent articles with the agreed fields correctly populated. Include clear setup instructions plus comments in the code so I can tweak XPaths or CSS selectors later if the site redesigns.

Let me know your preferred toolset, estimated turnaround, and any clarifying questions about the target domain.