Data Sets and Formats for the Assignment

There are several datasets available for this assignment. These have been installed as blob storage on
Microsoft Azure. Further data is available on data.gov.uk should you wish more detail.
The data sets are:
 all_crimes21_hdr.txt.gz (2.32 GiB Compressed, 43x10^6 records)
 LSOA_pop_v2.csv (2.4MB uncompressed)
 postcodes.gz (0.6GB Compressed)
 posttrans.csv (23.5 kB uncompressed)
All the files are csv format and may be compressed with gzip. Spark natively understands this
compression format, so you may use the files just as CSV files