Solved: BigQuery Pricing is not working - Page 2

LearnGCP · 03-08-2024 07:58 AM

Hi Team,

I am trying to understand the monthly cost of my query which is running in Bigquery using cloud composer schedule?

My query is showing “This query will process 19.17 GB when run”.

Final output table storage info is showing 12.01 MB in Active Logical bytes.

In BigQuery Pricing calculator using ‘On-Demand”,we need to provide Amount of data queried and Active logical storage.

I have given 19.17GB in Amount of Data queried . But it was showing $0/month.

I have added 12.01MB which is 12.01/1024=0.012 GB

I have 2 questions.

How do I get the total cost for my query including the storage cost?
It is showing per month cost. Is it on the basis that query will run once in a month?

Thank you for your help.

kolban

My understanding is that the free tier is per organization. So if you have a GCP organization, and there are multiple projects under it, your total BQ spend is rolled up to the organization and, if you are on-demand billing, the 1st TB per month is credited as is the first 10GB of storage.

Storage is associated with a table ... which rolls up to a dataset which rolls up to a project which rolls up to an organization. Active Logical Storage is the amount of storage (as found associated with a table) currently attributed to that table. If the data in the table (or partition) has not been modified for 90 consecutive days then the storage is automatically "flagged" as long term storage and the price per month of that storage drops. If you look at a table, you will see its active logical bytes and that is the total amount of storage (uncompressed) for THAT table by itself. I don't know what we would mean by the "sum" in that context. As always, there are permutations. Google offers you different billing models and you get to choose which one you want to utilize as a function of minimizing costs will maintaining the attributes you want. For example, you can opt to be billed based on physical storage instead of logical storage. Physical storage is a charge based on how much data you store on disk ... which will almost always be less than logical storage as Google saves the data compressed. However, when you opt for physical storage, that will also include storage needed for recovery and time travel where when you pay for logical storage, the additional storage needed for recovery and time travel is not a factor of the cost.

View solution in original post