forum scraping

Write and test a python script to perform this process:
* Log in to the target website
* Go to the khoros community page
* Read the posts starting from the most recent
- Check to see if this post is already in our database
- If not, pull the post and the metadata (including the conversation it's in, the tags, images, text, likes, status, and everything else) and store it
* Keep going back in time until we hit the time where we already have all of the posts in the database
* This should include all posts in all conversations

The result is a functional and tested script that will fill the database with the appropriate information, and the we can run periodically to ensure the database is complete.

Specifically this is to scrape http://www.infineon.com

This page uses javascript extensively, and many of the links are behind <span> tags.

The project is to scrape all of the web pages and download all of the pdf files.

We will verify the work by looking at specific pages and ensuring the page and all of the files are downloaded from that page.