problem fix in python selenium
Budget: £10 – £20 GBP
I am looking for a Python developer with experience in Selenium to fix an issue with incorrect data extraction from a website. The specific problem is that the data being extracted is not accurate or complete.
I am scraping historic results from OddsPortal’s darts page (https://www.oddsportal.com/darts/results/). The program works fine, except that it only ever identifies a maximum of twenty matches, even if there are more matches in the event (all of which are displayed on the same page, incidentally).
Here is the actual line causing the problem :
rowList = driver.find_elements(By.CLASS_NAME,'eventRow')
rowTotal = len(rowList)
If I print rowTotal if there are more than 20 items, it still says ‘20’. If I do an inspect I can see clearly that there are more ‘eventRow’s there, and the HTML doesn’t seem to do anything odd after the twentieth occurrence. Hence I’m mystified. I’m not sure if it might be caused by some popup that I’m unaware of, but I’m stuck.
I thought other people might possibly have had similar problems, but when I searched nothing helpful came up.
This is only the second Selenium program I have written, so I may well be doing something silly and which is simple to fix. Hopefully an experienced programmer could sort it quickly, if I send them the full program code. It’s about 150 lines and I can highlight the part that is going wrong. It would be a no fix no fee basis, and I’d imagine it should be fixable quite quickly, assuming it actually is fixable.
I would need to see it working on my machine to confirm this.
Skills and Experience:
- Proficiency in Python and Selenium
- Experience with web scraping and data extraction
- Strong understanding of HTML and CSS
- Familiarity with website structure and elements
- Ability to troubleshoot and debug code
-Experience with Oddsportal helpful
Requirements:
- The solution should be provided in the form of corrected code with an explanation/comment explaining the fix.
I am scraping historic results from OddsPortal’s darts page (https://www.oddsportal.com/darts/results/). The program works fine, except that it only ever identifies a maximum of twenty matches, even if there are more matches in the event (all of which are displayed on the same page, incidentally).
Here is the actual line causing the problem :
rowList = driver.find_elements(By.CLASS_NAME,'eventRow')
rowTotal = len(rowList)
If I print rowTotal if there are more than 20 items, it still says ‘20’. If I do an inspect I can see clearly that there are more ‘eventRow’s there, and the HTML doesn’t seem to do anything odd after the twentieth occurrence. Hence I’m mystified. I’m not sure if it might be caused by some popup that I’m unaware of, but I’m stuck.
I thought other people might possibly have had similar problems, but when I searched nothing helpful came up.
This is only the second Selenium program I have written, so I may well be doing something silly and which is simple to fix. Hopefully an experienced programmer could sort it quickly, if I send them the full program code. It’s about 150 lines and I can highlight the part that is going wrong. It would be a no fix no fee basis, and I’d imagine it should be fixable quite quickly, assuming it actually is fixable.
I would need to see it working on my machine to confirm this.
Skills and Experience:
- Proficiency in Python and Selenium
- Experience with web scraping and data extraction
- Strong understanding of HTML and CSS
- Familiarity with website structure and elements
- Ability to troubleshoot and debug code
-Experience with Oddsportal helpful
Requirements:
- The solution should be provided in the form of corrected code with an explanation/comment explaining the fix.