This website uses Cookies. Click Accept to agree to our website's cookie use as described in our Privacy Policy. Click Preferences to customize your cookie settings.
Accept
Reject
Preferences
Log in to ask a question
Get hands-on experience with 20+ free Google Cloud products and $300 in free credit for new customers.
Log in to ask a question

Dataflow HttpError 429 when requesting to trigger a dataflow template

Posted on 08-04-2022 11:18 PM
bharath-03
Bronze 1
Bronze 1
Reply posted on --/--/---- --:-- AM

Hi all,

   We created a dataflow template and running dataflow pipelines from it since a month or two. Today we received a weird error related to it which is "HttpError 429 when requesting <url> returned Internal service error: Failed to configure shuffle service for job <job_id>". But the next time we ran it triggered the pipeline and ran fine. I was going through the source of this error but unfortunately i couldn't find any. Can some one help me know what is this about.

 

  Job details : It is a batch dataflow pipeline. Source BQ query, Sink Pub/Sub.

 

Thank you in advance

0 1 254
Topic Labels
0 Likes
1 REPLY 1
Top Solution Authors
View all