Python web scraper using ec2 and S3. Files rewritten by a text rewriter api.

Create a python scraper that scrapes web pages, stores scraped files on S3 as text. The files are then rewritten by a rewriter api tool.

key steps are:
- Scrape links based on keywords, dates and number of requested articles from specfic websites
- Create the a source list of urls on a text file from this
- From this source list of urls on the text file extract the text contents of the web pages and output in text format
- Write these source articles to an S3 bucket folder

Once all article are retrieved
- run article through an text rewriter api
- place rewritten articles into a different S3 bucket and folder.


The article text file will have in its content
* The article url
* content of the article

The rewritten article text file will have just
* rewritten content of the article

The format of rewriting article should be
s3/folder/article-name.txt
eg. s3/20230912/article-name.txt

Required implementation tools:
Use a scraping api such as scrapfly.io to act as a proxy to grab links and articles.
Use an article paraphrase api such as tinq.ai to rewrite articles.

These have free trial or low cost options for development

You need expertise in:
Python
EC2
S3
IAM
Linux

You will use your AWS account for development


On conclusion of the project you will supply:
1. Python code for the solution
2. Documentation describing how to implement the solution
3. Demonstration of code working
4. Assist with any implementation issues