This website uses Cookies. Click Accept to agree to our website's cookie use as described in our Privacy Policy. Click Preferences to customize your cookie settings.
Accept
Reject
Preferences
Log in to ask a question
Get hands-on experience with 20+ free Google Cloud products and $300 in free credit for new customers.
Log in to ask a question

How to get job_id inside a pyspark job running on dataproc cluster ?

Posted on 07-22-2022 08:47 AM
RC1
Bronze 4
Bronze 4
Reply posted on --/--/---- --:-- AM
Is there any provision or any way to get the job_id of the pyspark job inside the pyspark code while running on Dataproc cluster?
 
 
0 1 813
Topic Labels
0 Likes
1 REPLY 1