Spark code to generate test data
Budget: ₹600 – ₹1,500 INR
I need to generate test data using spark code in HDFS path. If storing in AWS will be also more useful
Requirments :
We need to give the column names that needs to be created
Number of rows to be generated
Output format can be csv,parquet,txt,json
For the columns created we need to provide the data from another file
Requirments :
We need to give the column names that needs to be created
Number of rows to be generated
Output format can be csv,parquet,txt,json
For the columns created we need to provide the data from another file