Web Scraping comments from 9gag website

Job ID: 34141865

Budget: €8 – €30 EUR

Hello,

Attached below are two files that aim to scrape all the comments from 9gag website. test-1 file works better in extracting the comments, but test-2 has extra code for functionalities that you can use. The program currently scrapes all of the text main comments but not all sub comments are being scraped.

Aim: Edit the program such that it can scrape every single comments and sub comments (of all types) in the order of their appearance.

Kindly only bid if you are sure that you can finish the project. I recommend you to execute the code once, see the output and also have a look at the 9gag website DOM to get an idea.

Thank you.
Related categories: Python Web Scraping Selenium Webdriver Selenium