CSV Data Filtering – Deduplication and Merging (3 Files)
Budget: $30 – $250 USD
CSV Data Filtering – Deduplication and Merging (3 Files)
I have 3 separate CSV files with product data. I need help cleaning and merging them in a specific way:
File #1 – the main (primary) database – contains around XXk records.
File #2 – contains entries that partially overlap with File #1.
File #3 – also contains entries that overlap with both File #1 and File #2.
What needs to be done (in this exact order):
1. First, deduplicate File #2 and File #3 – if the same product appears in both, keep only the version from File #2.
2. Next, go through File #1 and:
- If a product from File #1 exists in the cleaned File #2/3, replace it with the newer/better version from File #2 or #3 (again, give priority to File #2).
- If a product from File #1 doesn’t appear in File #2 or #3, leave it unchanged.
3. The result should be one final file, with:
- No duplicates,
- The best possible version of each product (preferably from File #2),
- Complete and clean structure.
Matching logic can be based on product name or any consistent unique field (like ID or title).
I’m looking for someone who:
- Has strong experience with large CSV datasets,
- Understands deduplication and record replacement logic,
- Can deliver a polished, final CSV file ready to use.
If anything’s unclear – feel free to ask!
Thanks in advance.
I have 3 separate CSV files with product data. I need help cleaning and merging them in a specific way:
File #1 – the main (primary) database – contains around XXk records.
File #2 – contains entries that partially overlap with File #1.
File #3 – also contains entries that overlap with both File #1 and File #2.
What needs to be done (in this exact order):
1. First, deduplicate File #2 and File #3 – if the same product appears in both, keep only the version from File #2.
2. Next, go through File #1 and:
- If a product from File #1 exists in the cleaned File #2/3, replace it with the newer/better version from File #2 or #3 (again, give priority to File #2).
- If a product from File #1 doesn’t appear in File #2 or #3, leave it unchanged.
3. The result should be one final file, with:
- No duplicates,
- The best possible version of each product (preferably from File #2),
- Complete and clean structure.
Matching logic can be based on product name or any consistent unique field (like ID or title).
I’m looking for someone who:
- Has strong experience with large CSV datasets,
- Understands deduplication and record replacement logic,
- Can deliver a polished, final CSV file ready to use.
If anything’s unclear – feel free to ask!
Thanks in advance.