Influence Looker’s Roadmap and join the BI Customer Council (BICC)
Would you like to influence Google Cloud’s BI roadmap more? I’d like to invite you to join the Google Cloud BI...
Data Analytics
Want more from your data? Have questions about products like BigQuery, Dataflow, or Pub/Sub? You're in the right place. Join conversations around data warehouse modernization, streaming analytics, business intelligence, and more.
Focused on Looker? Engage with the Looker Community here.
Focused on Looker? Engage with the Looker Community here.
Forum Posts
Data glossary creation and update in Dataplex
Hey Experts,There are a way to create a glossary inside Dataplex trough script, and insert all the terms with ...
Dataform Releases/Workflows Github Trigger
Hi all,I would love to hear if there are any advancements on cloud build integration or some pull request trig...
How Can I Fetch all the data from Youtube to the Google Big Query Using Data transfer Job Service
I want to fetch all the Youtube Post and Page Analytics from my Youtube Channel using the Data Transfer Job Av...
Creating a Sink for BigQuery Audit Logs Across Organizations or Projects Error
HelloI'm trying to set up an audit log sink in a BigQuery dataset.=An issue persists, causing errors as follow...
BigQuery Snapshot actual size and cost
BigQuery Snapshots are a great way for backing up data due to its cost efficiency, as only changed data is bei...
how to find out who deleted an iam user?
we had an iam user got deleted and trying to find out how it got removed. is there a way to do this?
Export recommendations to the Big Query table
Hi All,I have enabled the export of recommendations data to BigQuery. However, the exported data only includes...
How to make avro schema fields optional ?
Already tried below schema.{ "type": "record", "name": "MyRecord", "fields": [ { "name": "requiredField", "typ...
io.grpc.StatusRuntimeException: INTERNAL: Panic! This is a bug!
Hi Everyone,I am encountering an issue while using BigQuery Data Transfer with the following Maven dependencie...
How to Filter Specific Fields for GCLB Logs in Log Sink?
created a log sink in Google Cloud Platform (GCP) to export Google Cloud Load Balancer (GCLB) logs to a BigQue...
Big Query - How to change date format
Hi all. Hopefully someone can help, I'm brand new to Big Query and these forums so hopefully I'm posting in th...
Creating a Sink for BigQuery Audit Logs Across Organizations or Projects
Hello!I'm currently working on setting up a sink for BigQuery Audit Logs, and I'm wondering if it's possible t...
Dataplex attribute store on entities from bigquery
Hi all,I'm trying to attach an Attribute Store to a table in BigQuery that already existed before I created a ...
Spring based Java API/Library for GCP Bigquery Storage Write API
Hi @ ,Earlier I was using Bigquery InsertAll() method for streaming data to BQ using Spring based library/apis...
Emmanuel Katto : How to Prevent a DAG from Running Automatically on Startup in Airflow?
Hello everyone,I'm Emmanuel Katto, We’re using Airflow in a daily pipeline, and everything runs in the morning...
Querying public google_ads_transparency_center table doesn't show all the needed data.
I'm having an issue querying table `bigquery-public-data.google_ads_transparency_center.creative_stats` for a ...
Streaming Buffer in BigQuery Taking Too Long to Flush After InsertAll Operation
Hi everyone,I’m experiencing an issue with the streaming buffer in BigQuery. I am using the Java SDK (Java 8 )...
Is there a way to apply labels to a BigQuery query issued from a Dataflow job?
We are running Apache Beam on Google CLoud Dataflow. One of our jobs SELECTs data from BigQuery and inserts ea...
Google Tag Manager sends data on Preview GTM Tool but it doesn't in production.
Hi community. Does anybody know why this is happening? My GTM works perfectly in the debug mode, the data is s...
Dataform different sources one target name
HelloMy team and I want to create a process where a target table gets data from several sources.All sources an...
Darshan Hiranandani :Error While Accessing or Creating GSheet Linked Tables -API Key Not Valid Issue
Hi everyone,I'm Darshan Hiranandani, I’ve been encountering an issue across multiple projects and tables since...
Replicating data from MySQL to BigQuery using Dataflow template
Hello BQ users! We recently published a step by step guide, which walks through how to set up data replication...
GA4>BQ streaming export, users_ table missing rows
Hi there,Until June 18 - streaming export creates events_, pseudo- and users_ tables as intended, no differenc...
Syntax error: Unexpected keyword WHERE at [5:1], Syntax error: Unexpected keyword WHERE at [4:1]
I enrolled for Google Data Analytics and started learning Google Query. In my queries, I keep having syntax er...
ReadFromBigQuery dinamically Apache Beam - Dataflow
I have a list of bigquery queries("SELECT JSON_CONTENT FROM project_id.ds.TB_1","SELECT TRANSACTION_ID FROMpro...
DCF using SQL (share & help needed)
Hi all,I'm not sure how many people will see this page but just wanted to share my SQL project related to disc...
How to Trigger a Retry in PubSub When Using Push Subscriptions
I have a google cloud function that is subscribed to a pubsub push-type subscription. Because of the setup, th...
Creating Composer 1 with Terraform fails
Hello. I'm getting this error when I'm trying to create a Composer 1 env with terraform.Error: Error waiting t...
Xxx,xxx finical reports
I'm confused on why I'm trying to do a deep comprehensive report and it's coming up as xxx and not giving me e...
Different values after dataform tables run with full refresh
I have encountered a strange issue with dataform, whereby a full refresh of the pipeline results in slightly d...
Articles from Product Experts and Googlers
Introducing DeepSeek R1 Model-as-a-service on Vertex AI Model Garden
Deploying Deepseek-R1-0528, a 671B parameters model, typically necessitates at least 8x H200 GPUs for a single API request. Such extensive resources are not accessible to everyone.To make Deepseek R1 more accessible to developers, we're excited to announce that DeepSeek R1 is now available as a fully managed API on Vertex AI in Preview.
Untangle the API maze with Apigee API Hub
Mirror mirror on the wall, What do I do with my API sprawl, Where can I see them all, How to make sure they listen to my call, And to ensure their compliance doesn’t fall. API Hub is the one to rule them all!
Next-Gen Data Pipelines: Airflow 3 Arrives on Google Cloud Composer
We are thrilled to announce that Google is the first hyperscaler to provide selected customers with access to Apache Airflow 3 on our fully managed Cloud Composer 3 service. Discover how powerful new features like DAG Versioning, a modern React-based UI, and scheduler-managed backfills can help you innovate faster and more reliably.
