Work on Dataform(gcp) with differents projects

[a8mad_mohammad]

As you know In every Dataform repository, there is a distinct configuration file called "dataform.json". This file specifies both the Google Cloud project ID and the schema that Dataform uses to publish its assets in BigQuery.

In my current case , I am required to work with various data sources across multiple projects within my organization. Specifically, there are several departments, each responsible for delivering data to BigQuery on Google Cloud Platform (GCP) with their own unique project IDs: Department X with project ID Xid delivering DataX, Department Y with project ID Yid delivering Datay, and Department Z with project ID Zid delivering Dataz. My department, Department T, operates within project ID Zid and requires access to data from Departments X, Y, and Z. Although I attempted to utilize Analytics Hub, I found that it is limited to sharing data at the dataset level and not individual tables.

Many thanks, much appreciated! 

[psandmann]

Hi, 

you can declare the source from different projects

https://cloud.google.com/dataform/docs/declare-source

override the database / schema and name fields in the config.

If you declare an dataset on another project or If you are working across projects, you only need to activate the dataform service account for the projects.