This website uses Cookies. Click Accept to agree to our website's cookie use as described in our Privacy Policy. Click Preferences to customize your cookie settings.
Accept
Reject
Preferences
Log in to ask a question
Get hands-on experience with 20+ free Google Cloud products and $300 in free credit for new customers.
Log in to ask a question

org.apache.spark.shuffle.FetchFailedException in Serverless Dataproc

Posted on 09-15-2022 08:26 PM
prabhaA
Bronze 3
Bronze 3
Reply posted on --/--/---- --:-- AM

I am getting the below error with serverless Dataproc (Batches) for a job.

"org.apache.spark.shuffle.FetchFailedException"

This is due to autoscaling removing executors, Serverless data proc doesn't support EFM; is there a way to handle this issue? Any help/pointer is appreciated.

Thanks in advance.

0 1 2,633
Topic Labels
0 Likes
1 REPLY 1
Top Solution Authors
View all