Remove duplicates from all excel files in a folder -- 2

Job ID: 36777959

Budget: $10 – $30 USD

I have 40 excel files from those file I need to remove duplicates and if possible merge all files in one.
I need urgent this donen like in next 2 hours. the files are larger like each files has 0.2 - 1 million rows
I need a freelancer to remove duplicates from all excel files in a folder. I want to keep the original files and have the duplicates removed based on a specific column. The freelancer can choose which column to use for identifying duplicates, as long as it's not column A or B.

Ideal Skills and Experience:
- Advanced knowledge of python, SQL
- Experience in data cleaning and manipulation
- Attention to detail
- Ability to work efficiently and accurately
- Good communication skills

Deliverables:
- All excel files in the folder with duplicates removed based on the specified column
- Original files kept intact
- Clear documentation of which column was used for identifying duplicates

Timeline:
- Project should be completed within 3 days of being awarded
- Regular updates on progress expected
Related categories: Python Excel SQL MySQL Database Programming