Website & Instagram Data Scraping

I’m putting together an automated pipeline to pull information from one or more public-facing websites as well as Instagram. The precise fields are still being finalised, but they are likely to include a mix of text (e.g., product descriptions or captions), images, basic profile details, and engagement statistics. Because the targets may change as the project evolves, I need code that is clean, modular, and easy to extend.

Here’s what I’m after:
• A set of Python scripts (Scrapy, BeautifulSoup, Selenium, or an equivalent approach) that can extract the requested data without hitting rate limits or getting accounts blocked.
• A separate module or function for Instagram that works with either the official Graph API or a reliable workaround, returning JSON or CSV ready for analysis.
• Clear instructions so I can update target URLs, hashtags, or user handles myself and rerun the scraper on demand.
• A small sample run to confirm everything is working before scaling up.

If you’ve handled rotating proxies, headless browsers, or API authentication in previous scraping projects, that experience will be valuable here. I’d like to see concise, well-commented code and a quick hand-off so I can start experimenting with the data right away.