BigQuery data deletion cost

[kd2709]

Hi,

I have a huge data in one of my environment, where I am not running my data pipelines and I am paying on huge cost on that. I was thinking to delete this data but my storage billing model is Physical at this moment and If I delete this huge data, I might end up getting a cost spike as I will be billed for time travel(I have lowered the time travel) and fail safe storage cost.
What is the best way to avoid such cost spikes, is moving to Logical storage billing model is best approach.

Data Volume- 230 GBs

Best Regards,

Amit K

[caryna]

Hi @kd2709,

Welcome to Google Cloud Community!

You might want to switch to logical storage because the physical storage charges extra for time travel and fail-safe storage at active rates. With logical storage, these features are included in the base rate.

For comprehensive guidance on optimizing storage efficiently, refer to the provided documentation. Additionally, you might find it helpful to explore this Google Cloud blog, which offers insights on strategies for reducing BigQuery physical storage usage.

I hope the above information is helpful.

[kd2709]

Hi @caryna ,

Thank you for the reply.
As far I understood, I can switch to logical storage billing model before deleting the tables.
Given I have a huge data, based on what I read it will be more costlier when it will be on logical storage billing model. So, if I move it, will there be any sort of cost spike since the billing model is changed.
Also, is setting the table partition expiration is another alternative, will it be still charged for fail safe and time travel.

[caryna]

You're correct that logical storage can result in higher costs since it stores uncompressed data, and there's a risk of a cost increase when switching to logical billing because charges are based on the total data stored. In contrast, physical storage benefits from data compression, reducing costs due to smaller storage size. However, modifying or deleting data incurs additional charges for time travel and fail-safe features, which can increase storage expenses.

Setting a partition expiration will help you reduce storage costs, but you will still be charged for the expired data until it's permanently deleted, as fail-safe and time travel charges continue to apply. To manage costs more effectively, consider deleting smaller chunks of data over time.

I hope the above information is helpful.