Delicious Soup scraping script
Budget: $250 – $750 USD
Extract data from https://www.ferrarilife.com/forums/ferrari-knowledge-base.134/
into a simple .txt file
The Python script should go down the page, click on each link and extract the information in the following format:
Create a paragraph with as a title, the topic of the conversation and on the next line immediately below, all the answers and comments. Quoted text should be ignored to avoid duplication of content. If there are multiple pages of comments, keep going to the next page.
There will be a double space between each paragraph.
So after drilling down into the first link on the url above, move to the next link and repeat and once at the bottom of the first page, go to the next page.
Here is a sample of a paragraph in the .txt file
360 Spider reliability question
Can someone educate me on the 360 Spider? I like them and I'm looking to buy. I live 6 hrs from a dealership. How reliable are they? How tough are the engines? What is high mileage? Is there anything I need to know?
Hello There.
Ferrari's are unreliable at the best of times so be warned... The best advise that I can give you should you go ahead with your purchase is......Make sure that the battery is always at full charge, never try and start with a dud battery.
Good Luck
I have two customers with over 100K and 120K who drive their cars pretty much every week . 3-6 K miles per year . they require maintenance . Surely keep the battery charged and read the manual . be educated about your car or suffer extra costs . having a good (fair/honest$) shop that you can call is part of the entry to the beautiful car . see cars 18mths / $2k-5. Lastly and most importantly please have a PPI . caveat emptor . hope this helps .
(etc....)
into a simple .txt file
The Python script should go down the page, click on each link and extract the information in the following format:
Create a paragraph with as a title, the topic of the conversation and on the next line immediately below, all the answers and comments. Quoted text should be ignored to avoid duplication of content. If there are multiple pages of comments, keep going to the next page.
There will be a double space between each paragraph.
So after drilling down into the first link on the url above, move to the next link and repeat and once at the bottom of the first page, go to the next page.
Here is a sample of a paragraph in the .txt file
360 Spider reliability question
Can someone educate me on the 360 Spider? I like them and I'm looking to buy. I live 6 hrs from a dealership. How reliable are they? How tough are the engines? What is high mileage? Is there anything I need to know?
Hello There.
Ferrari's are unreliable at the best of times so be warned... The best advise that I can give you should you go ahead with your purchase is......Make sure that the battery is always at full charge, never try and start with a dud battery.
Good Luck
I have two customers with over 100K and 120K who drive their cars pretty much every week . 3-6 K miles per year . they require maintenance . Surely keep the battery charged and read the manual . be educated about your car or suffer extra costs . having a good (fair/honest$) shop that you can call is part of the entry to the beautiful car . see cars 18mths / $2k-5. Lastly and most importantly please have a PPI . caveat emptor . hope this helps .
(etc....)