Enhance Synthetic Data Generator with Genrocket
Budget: ₹600 – ₹1,500 INR
Seeking an experienced data scientist to assist in optimizing my synthetic data generator, specifically by dividing larger datasets into smaller subsets. Expectations are as follows:
- Integrate the capability of dividing data into subsets: you will need to specify both the number and size of these subsets.
- Implement parallel processing using multi-threading to process these subsets concurrently.
- Store the resulting data in a pandas dataframe for further analysis.
The dataset involved is rather extensive, containing around 1M records, hence efficiency and good understanding of high-volume data processing is key. Skills in working with Genrocket, Python, Pandas, and multi-threading are highly desirable for success in this task.
- Integrate the capability of dividing data into subsets: you will need to specify both the number and size of these subsets.
- Implement parallel processing using multi-threading to process these subsets concurrently.
- Store the resulting data in a pandas dataframe for further analysis.
The dataset involved is rather extensive, containing around 1M records, hence efficiency and good understanding of high-volume data processing is key. Skills in working with Genrocket, Python, Pandas, and multi-threading are highly desirable for success in this task.