extract relevant unique articles from a dataset

Job ID: 36005714

Budget: $30 – $250 USD

I need a project done in python where I have a list of news items and I need to filter them in terms of uniqueness and relevancy and remove duplicates