Stream Firestore to BigQuery

[ajayv-19]

Hi, we have an app with Google Firebase as a Database which is No SQL, JSON-based data. Now, we have to build an analytics dashboard on this data. We have sub-collections inside the main collection Can anyone guide us here on how to do data Analytics on this nested JSON data? One way I am trying is to get data to big query and try to do analytics from there.

[kevinlearynet]

You could do something like this:

1. Create a Cloud Function that exports data from Firebase daily as newline JSON and saves it to Cloud Storage
2. Scheduled import in BigQuery pulls the latest newline JSON into BigQuery

Thats the rough concept, but it may also help to know that BigQuery also has a JSON data type, and an array of struct types can be helpful when working with JSON data too. 

[jangemmar]

Hi @ajayv-19,

Welcome to Google Cloud Community!

In addition to @kevinlearynet, Yes, you can export your project data from Firebase to BigQuery. Once your data is in BigQuery, You can start creating your own dashboard using Looker Studio and select your BigQuery dataset as your data source. Take note of the IAM policy as it may show a blank dashboard if you don’t have the proper roles/permission configured.

I hope the above information is helpful.