Influence Looker’s Roadmap and join the BI Customer Council (BICC)
Would you like to influence Google Cloud’s BI roadmap more? I’d like to invite you to join the Google Cloud BI...
Data Analytics
Want more from your data? Have questions about products like BigQuery, Dataflow, or Pub/Sub? You're in the right place. Join conversations around data warehouse modernization, streaming analytics, business intelligence, and more.
Focused on Looker? Engage with the Looker Community here.
Focused on Looker? Engage with the Looker Community here.
Forum Posts
Not Able to Copy Data Source Connected With Service Account Credentials
I have a data source connected with data tables using BigQuery connector. The data source uses service account...
Dataform uniqueKey and partitionBy VS BigQuery primary key and partitioned on field
Hi there,What is the different between primary keys in BigQuery and uniqueKey in GCP Dataform? How come the un...
How Dataplex Data Quality TableConditionExpectation works behind scenes ?
Hi im trying to set up a custom query in Dataplex Data Quality Scans like the following: 1 2 3 4 5 6 7 8 9 10 ...
upgrading Google.Cloud.Firestore API throws an error
Our C# .Net Core project is using Google.Cloud.Firestore API version 2.5.0 and works just fine. However, the n...
Firebase and GA4 integration
Hi there, I have some questions about Firebase and GA4 integration:Can we link GA4 to one BigQuery project and...
know the user who executed a DAG
Hey, guys,I need to know who ran a DAG on the GCP composer airflow(Version 1 and 2).Do you have any tips for k...
Unable to connect a BigQuery table as a data source. Firebase Template(?) recognized.
When trying to connect a new BQ table to a lookerstudio report, I ran into a problem. The table was recognized...
Wildcards in Dataform sqlx files?
I'm trying to figure out the best way to reference multiple tables with the same schema across multiple datase...
how to pull all unacknowledged messages from pull subscription process and ack in batch
I Have a requirement to pull all the messages from the pull subscription and process ( write to GCS file and w...
Can deleted service account keys can be recovered?
I have json service account key file which was downloaded during creation of service account key. If my servic...
How to find URIs which causing the load job failure
Hi,I am loading data into a big query table as followsasync loadDataToTable(project_id, dataset_id, table_id, ...
Darshan Hiranandani - How do I visualize and interpret data effectively?
I'm Darshan Hiranandani, hope you're all doing well. I'm currently working on a project that involves analyzin...
Design options to connect Looker Core instance from onpremise via partner interconnect
I have spun up a Looker core instance on a GCP project which is on a private IP. My goal is to enable access t...
Inquiry About GCP's Handling of Upcoming Kazakhstan Time Zone Change to UTC+5
Dear Google Cloud Platform Team,I am writing to you as part of the development team at Kolesa, a company that ...
How to trigger a single Dataform Workflow from Composer
Title explains a lot.I am using Dataform and Composer. Both instances are very simple and I just used the quic...
Override more than one project in Dataform
Hi, to everyoneI am currently working on dataform creating a sql flow to create some tables in my dev environm...
Incremental load from Big Query to Cloud MySQL
I am currently running a Cloud Function that exports an entire table in BigQuery as csv files into Cloud Stora...
Accessing Big Query by Self Service
I work in a Brazilian company. We use Big Query for our analytic datas. We are implementing a self service con...
Getting Table Not found Exception
Stackoverflow linkI am using Java SDK jars for BigQuery data fetching. From BigQuery I am fetching a detailed ...
Dataform CLI: deprecated vm2@3.9.19
Hello,When I install npm install -g @dataform/cli@latest, I have an error saying:npm WARN deprecated vm2@3.9.1...
Dataflow requires minuemiun 4 minutes time for resources provision for processing small data jobs
Hi,When we submit a new job in Dataflow, the service automatically allocates the necessary infrastructure, inc...
BigQuery Subscription with proto3: Wrong writing of null values to BigQuery table
Hi all,It appears that the BigQuery Subscription writes NULL values to the BigQuery table when the proto3 defa...
Looker dashboard cost
Hi, I am trying to get cost of queries being running in background of looker studio dashboard, I tried using b...
Read Message from PubSub to GCS Parquet file using Dataflow template Streaming
Team,Is there any default template available to consume message from pubsub topic to GCS Parquet file using Da...
Gsheets spreadsheet connections with Data Fusion
Hey, guys,I would like to ask for help, I'm trying to get data from a gsheets spreadsheet within data fusion, ...
PubSub: Consuming message fron Subscriber Acknowledged Message using message id
Team,I consumed message from Pubsub using my subscriber. Can i re consume same message using message id though...
GA4 Admin API from a Google Sheet
I'm trying to create GA4 properties from a Google Sheet using the Creating a GA4 property with GA4 Admin API i...
Changing cloud composer variables with ci/cd
I have a Cloud Composer environment running with the 1.20.11 Composer version and 2.3.4 Airflow, but I have so...
Merge daily snapshots to a table incrementaly.
Hello everyone,I will present the challenge I have.I need to keep two BQ tables: a raw table that gets populat...
Data Quality
Hi,I have a DQ job which essentially fetches data from cloud storage bucket , checks the data quality and once...
Articles from Product Experts and Googlers
BigQuery Data Preparation with AI Agents: Smarter, faster, and code-free
Ready to unlock the secrets hidden in your product data? This tutorial demonstrates how BigQuery Data Preparation can clean and transform your raw data into actionable business intelligence, using a realistic example from the Fashion and Beauty industry.
Launched: ABAP SDK v1.10 unleashing powerful AI/ML, eventing, and storage capabilities
Supercharge your SAP systems! ABAP SDK v1.10 unlocks BigQuery AI/ML, simplified event-driven integration, Cloud Storage content repositories & access to 290+ Google Cloud APIs. See what's new.
From idea to viral video: the GenAI workflow you need
What if you could create professional-quality videos with just a fraction of the effort? This blog introduces a radical new GenAI workflow on Vertex AI, using models like Gemini, Imagen3, MusicLM and Veo2 etc to make video creation accessible to everyone.
