Managing GCP and BigQuery environments

Hi,

We are using GCP, BigQuery, Dataform and LSP in an enterprise environment. Users are on Workspace.

My need is to have a report which can pull data from different environments (eg. dev, staging/uat, prod). The goal is to validate changes in the Data pipelines and/or datamarts before releasing them to the users accessing the data through the LSP report. Data for each env exists in a separate GCP project (eg. projectA-dev, projectA-uat, projectA-prod).

I can't find a way to get the same LSP report to pull the data from different env based on a parameter or a control. 

It could work with a custom query like:

IF @env="prod" THEN

< production environment query >;

ELSE

< dev environment query>;

END IF

This works fine in BigQuery but not in the Looker Studio bigquery connector. Procedural functions are not supported by the LSP BQ connector, likely because Looker tries to add a limit clause to a query already finished by ";" (which is required by the BigQuery IF syntax). Same with Table Functions which aren't supported. 

LSP support confirms the above isn't supported and is not able to provide a way to manage multiple BQ environments.

Please add support for Procedural functions, Table functions or any other way to support multiple BQ env. 

 

0 0 179