Datastream: Unselect columns - data processing

[mtomov]

Hello,

For data privacy reasons, we'd like to avoid google Datastream transferring data out of the columns which are not selected. 

Is there somewhere that confirms if Datastreams are indeed transferring / not transferring the data in those columns out of the source database (RDS) in this case?

Thank you!

Martin

[mcbsalceda · Accepted solution]

Hi @mtomov,

Welcome to Google Cloud Community!

To keep your data private, it’s totally understandable that you want to make sure Google Datastream isn’t transferring any data from unselected columns. The good news is that Datastream lets you specify exactly which schemas, tables, and columns to include or exclude in your stream. While it can read data from those excluded columns, it won't actually transfer that data.

To confirm what’s being transferred, you can check the Datastream log files. They’ll provide information about the current status, including entries that indicate when a table has finished backfilling. If you want more details, you can also take a look at the Datastream FAQ for additional insights!

I hope the above information is helpful.