Secrets Manager : GCP cost estimation

[tushensu]

I am in the process of configuring a Dataform workspace for ETL workloads and as part of the set up I have to integrate the Dataform workspace with git. Now in order to do this I need to connect via https using a git token which I need to add to the GCP secrets manager and then expose to Dataform. My concern is I am not sure how this works in the background in terms of the access operations and I wondering what is the best way to estimate the potential cost of this with regards to Dataform workloads.

I have looked at some examples in the docs but I am still confused as to how to estimate this.

Is it calculated like this :

• git commit = access operation
• dataform job run = access operation

I need to understand this so that I can properly estimate the cost in terms of how many potential access operation will I have on a monthly basis.

[kolban · Accepted solution]

Looking at the Secret Manager access operations cost found here, we seem to see a charge of $0.03 for 10,000 operations.  This makes me think that if Dataform were to perform a secret manager access every second of the day, the cost would be under $0.26/day.  I'm going to assume your access will be dozens per day as opposed to tens of thousands.  What I suggest we do is run your solution for a short period of time and monitor your secret manager access charges.  If you really need to estimate, then assume worst case of an access charge for every git interaction (commit, push, pull) and for every dataform job run.  That way we shouldn't underestimate the costs.

[lawrencenelson]

Hi @tushensu,

Adding to @kolban's comment above, you may also use the legacy Pricing Calculator to get a better estimate of your monthly cost. Thanks.