can not create Dataproc cluster due to " Unable to validate the staging bucket lifecycle"

[pt_ch]

Hi there !!!

I'm a newbie GCP who's currently using GCP free tier for learning purpose.

Right now, I 'm trying to create a dataprpoc cluster.However,the provision isn't  successful. 

the error says :

• Unable to validate the staging bucket lifecycle configuration of the bucket 'dataproc-staging-us-central1-283764494239-fansdrod' due to an internal error, Please make sure that the provided bucket doesn't have any delete rules set.

but when I went to dataproc-staging-us-central1-283764494239-fansdrod and checked under lifecycle tab there is no rules at all. At this point.I'm so confused what's happening here. please help.

[nikacalupas]

Hi pt_ch,

Welcome to the Google Cloud Community!

When Dataproc fails with "Unable to validate the staging bucket lifecycle," it's often due to hidden or faulty lifecycle rules on the staging bucket you're using, even if the Cloud Console shows none. Here are some suggestions that might help you to resolve your issue:

• Ensure that your Dataproc service account (or default Compute Engine service account) has roles/storage.admin (Storage Admin) or roles/editor (Editor) IAM role on the project and that you are under the same region.
• Use the gsutil lifecycle get command through Cloud Shell to view all lifecycle rules, even hidden ones. Delete them with gsutil lifecycle rm.
• You can create a brand new bucket with a simple name and try using that as the staging bucket.
• If you’re using a custom service account key, ensure it's valid and properly configured. Generate a new key event.

Was this helpful? If so, please accept this answer as “Solution”. If you need additional assistance, reply here within 2 business days and I’ll be happy to help.