Convert 490GB JSON To Excel
Budget: ₹600 – ₹1,500 INR
I have a single 490 GB JSON file containing mixed text and numerical fields. I need every record moved into one Excel worksheet, with field names becoming column headers and data types preserved—no summaries, no pivots, just a clean row-by-row transfer.
Because the file is so large and my budget is tight, a lightweight, stream-based solution is fine. A Python script using pandas, openpyxl, or another memory-efficient approach, or a Power Query setup that processes the file in chunks, would work as long as the end result is an .xlsx I can open without losing rows.
Deliverables
• A working script or tool that performs the conversion.
• The generated Excel file, or a representative extract if file size prevents full transfer.
• A brief read-me covering dependencies, step-by-step usage, expected runtime, and any hardware requirements.
Experience handling very large datasets is essential, and the process must avoid data loss or column misalignment.
Because the file is so large and my budget is tight, a lightweight, stream-based solution is fine. A Python script using pandas, openpyxl, or another memory-efficient approach, or a Power Query setup that processes the file in chunks, would work as long as the end result is an .xlsx I can open without losing rows.
Deliverables
• A working script or tool that performs the conversion.
• The generated Excel file, or a representative extract if file size prevents full transfer.
• A brief read-me covering dependencies, step-by-step usage, expected runtime, and any hardware requirements.
Experience handling very large datasets is essential, and the process must avoid data loss or column misalignment.
Related categories:
Python
Data Processing
Excel
Software Architecture
Scripting
Data Analysis
Data Management
Pandas