This website uses Cookies. Click Accept to agree to our website's cookie use as described in our Privacy Policy. Click Preferences to customize your cookie settings.
Accept
Reject
Preferences
Log in to ask a question
Get hands-on experience with 20+ free Google Cloud products and $300 in free credit for new customers.
Log in to ask a question

Historical Resource Consumption Metrics on Dataproc Ephemeral Clusters

Posted on 11-16-2023 04:31 AM
sqoor
Bronze 5
Bronze 5
Reply posted on --/--/---- --:-- AM

Hello,

I am currently tasked with analyzing the historical resource consumption of our Dataproc ephemeral clusters on Google Cloud Platform. The goal is to make informed decisions about configuring an on-premises cluster equivalent to our cloud setup.

Given that our Dataproc clusters are ephemeral and get deleted upon job completion, I am looking for a retrospective analysis of resource metrics such as CPU usage, memory consumption, machine count, and core utilization during the lifespan of these clusters.

How to achieve it in the simplest way?


0 2 668
Topic Labels
0 Likes
2 REPLIES 2