Apache Spark performance tuning required(High proficiency required)
Budget: $50 – $0 USD
Currently I have a job which does some aggregations and takes a day or two but I have seen the same job completed within 30 mins with some unknown set of resource allocations.
Since I've been playing with Spark for few years, I am only looking for someone who is highly proficient with Spark resource allocation and fixing the data skew issues when encountered wide transformations/aggregations(apart from salting techniques)
Since I've been playing with Spark for few years, I am only looking for someone who is highly proficient with Spark resource allocation and fixing the data skew issues when encountered wide transformations/aggregations(apart from salting techniques)