Data Scraper

https://www.oddsportal.com/results/#football

Requirements:

- Collect all of the competition URLs from https://www.oddsportal.com/results/#football
- For each competition, the current season will be selected by default. Only data from the current season is required.
- For each competition, collect all of the match URLs from each page.
- For each match URL scrape the following information:
- home team
- away team
- match result
- match kick off date and time
- the average 1X2 odds for Pinnacle and Dafabet (you may need to create a login to view odds from these bookies)
- The Asian handicap line with odds closest to 2.0, e.g. for this match https://www.oddsportal.com/football/england/premier-league/luton-west-ham-zF0205Qb/#ah;2, the line would be +0.75
- The Asian handicap odds for Pinnacle and Dafabet (average of the two) for the line mentioned above
- The Over/Under line with odds closest to 2.0, e.g. for this match https://www.oddsportal.com/football/england/premier-league/luton-west-ham-zF0205Qb/#ah;2, the line would be 2.75
- The Over/Under line odds for Pinnacle and Dafabet for the line mentioned above


Example Output:

- One row per match with the following columns:
- Home: Luton
- Away: West Ham
- Date: 01/09/2023 20:00
- Home_Goals: 1
- Away_Goals: 2
- odds_1: 4.56
- odds_x: 4.02
- odds_2: 1.755
- AH_line: 0.75
- AH_home: 1.95
- AH_away: 1.98
- OU_line: 2.75
- OU_over: 1.965
- OU_under: 1.945