DLP de-identification for streaming data

[EliorDana]

Hi all, 
I need to create a service (I thought about using Cloud Run) that will get streaming data (Json) The data contains sensitive information that is needed to de-identification (and re-identify
in the future) using DLP and save the result to BigQuery.
I could not find a code that can perform this task, I would be very grateful for help, thank you very much.

[ste_google]

There are a few options you can use here depending on your data size, shape, and cadence. Here are a few prototype solutions to help get you started:

• Using Dataflow with DLP (based on Apache Beam and has some details on batch and streaming)
• Using Data Fusion with DLP
• Using Cloud Storage inspect and transform jobs to process data in GCS before loading into BQ: 
  Introducing easier de-identification of Cloud Storage data

Also in case it helps, there's also a pattern of calling DLP from BigQuery's engine using a remote UDF function.

Are any of these helpful?