Python project

We need to build a Python script with the following flow.

1. Fetch articles from web source
2. Save them in MySQL db. Fields:
1. Source of the article
2. Title
3. Body
4. Keywords
5. Original url
3. Paraphrase it with NLP tools.
4. Save the new body in database. It should be somehow connected to the original, in order to match them in future
5. Perform a similarity check
6. Save the similarity score in db
7. Repeat the flow.


Specifications:

1. For fetching the articles you can use this tool. You just need to install it.
https://github.com/flickz/newspaperjs
I will provide the sources of news

2. Database will be MySQL

3. This is the tricky part. I’ve selected 3 tools that you can use for this:

https://github.com/PrithivirajDamodaran/Parrot_Paraphraser
https://github.com/Vamsi995/Paraphrase-Generator
https://github.com/vsuthichai/paraphraser

You can use only one, two of them or all of them. I tested and they’re working all good, but maybe doing more then one step is necessary for a best result. NOTE: you’ll have to paraphrase one sentence per time and not all the process.

4. As 2.

5. Plagiarism checker is simple. You will use this tool, that will make use of Google Search APIs.

https://github.com/architshukla/Plagiarism-Checker

6. As per 2 and 4

7. Frequency will be set up by user of this flow.


I don’t need user interface for this. I will create it based on the Database.

Server will be provided according to the needs.

Thanks