Automated Transfermarkt Scraper to PowerBI

I need a robust script that can go to Transfermarkt each week, pull match-by-match data for a list of footballers and feed it straight into Power BI for reporting. The dataset must include every appearance, the exact minutes played, whether the player scored or kept a clean sheet, plus the opposition team and match date.

Core flow I’m picturing
• The script (Python is ideal, but I’m open) scrapes the required fields from Transfermarkt pages—handling pagination, dynamic content, captchas or cookies where necessary.
• It transforms the raw HTML into a tidy table ready for Power BI. If you prefer, create a Power BI REST push dataset; otherwise write to a file that Power BI can refresh seamlessly.
• A scheduled job (Azure Function, Windows Task Scheduler, GitHub Action—whatever you find reliable) runs the scraper once a week and refreshes the dataset automatically.

Deliverables
1. Source code with clear in-line comments.
2. A repeatable setup guide (environment, dependencies, credentials).
3. Proof-of-concept refresh inside Power BI showing the columns: Player, Match Date, Opposition Team, Minutes Played, Goals, Clean Sheet.
4. Brief note on how you handle site-structure changes and polite scraping practices.

Once I can hit “Refresh” in Power BI and see up-to-date weekly stats, the job is done.