Currently I have a job which does some aggregations and takes a day or two but I have seen the same job completed within 30 mins with some unknown set of resource allocations.
Since I've been playing with Spark for few years, I am only looking for someone who is highly proficient with Spark resource allocation and fixing the data skew issues when encountered wide transformations/aggregations(apart from salting techniques)
Hey there !
Good day. I am Pankaj Ranga I would like to work with your project and I can surely provide the details you have specified on the project description.
I can confidently say that I am knowledgeable enough to finish your required task. I hope I can get response. Thank you !
BEST REGARDS