Influence Looker’s Roadmap and join the BI Customer Council (BICC)
Would you like to influence Google Cloud’s BI roadmap more? I’d like to invite you to join the Google Cloud BI...
Data Analytics
Want more from your data? Have questions about products like BigQuery, Dataflow, or Pub/Sub? You're in the right place. Join conversations around data warehouse modernization, streaming analytics, business intelligence, and more.
Focused on Looker? Engage with the Looker Community here.
Focused on Looker? Engage with the Looker Community here.
Forum Posts
Issue with "Publish Results to BigQuery" Option in Dataplex DataScan via Terraform
Hi team,I have a question regarding DataScans in Dataplex. I'm deploying a DataScan task using Terraform; howe...
Renaming table in BigQuery using terraform
Hi everyone,I am working on a project where we utilize Terraform to manage all BigQuery infrastructure, includ...
How to load data from external sources into BigQuery?
Hi,I'm working on a project where I need to load data into BigQuery from multiple cloud and on-prem sources (l...
Issue with BigQuery saving results as Google Sheets: some floating points number are messed up
Hello, I am from Brazil where we use comma "," as decimal separator and a point "." as thousands separator. Wh...
PubSub periodic timeouts / latency spikes in Flink
Hi folks,I'm using the Flink PubSub connector library (https://github.com/apache/flink-connector-gcp-pubsub) a...
Google Cloud Log Monitoring
I've built a centralized log monitoring dashboard in Cloud Monitoring, aggregating logs from multiple projects...
schemas not streaming after instance recover
have an SQL instance called production, we stopped this instance for about two months, after I started it agai...
How to transfer all data from Google Analytics 4 to Google BigQuery?
Hello everyone, I have set up and linked my Google Analytics 4 property to Google BigQuery. It does collect da...
using system variable dataset_project_id while executing stored procedure
Hi, Best-practice question -When executing a stored procedure, how can I set the dataset_project_id system var...
Missing data from Google Ads Data Transfer in VideoConversionStats table
Hello, I'm experiencing a data discrepancy issue with Google Ads Data Transfer Service in BigQuery when trying...
BQ Connection parameters to set default dataset project_id
Hi, Am looking for some parameters in BQ connection that lets me define billing project_id AND default dataset...
Completed Certificate Showing as Incomplete on Dashboard
Hello,I have completed all 5 courses in the "Beginner: Google Cloud Data Analytics Certificate" pathway and ha...
Conversational Insights Pricing
I have a couple of questions , not sure if this the correct place to ask, regarding the pricing under https://...
A problem with accessing Mongo Atlas cluster from GCP Data Fusion pipeline
My team is now building data integration pipelines in Google Cloud Data Fusion. The pipelines read data from M...
Dataform: How to get an unqualified table name?
I am new to dataform and am migrating some ETL activities that involve Pivot and Unpivot.I have created a conf...
BIGQUERY - SHOW TABLE table_name
I asked Gemini the following:I want to see the DDL for a given table in bigquery And I received this for an an...
BigQuery Dataset IAM Condition issue
1. I have an sa with BigQuery JobUser and the following DataViewer IAM Conditon ( Type is Dataset) at project ...
How to Implement Scheduled Delta Updates from BigQuery to Neo4j?
Hi all,I'm exploring a strategy to optimize Neo4j graph updates by avoiding full reloads and instead focusing ...
Composer 3 - Monitoring frequently offline
Hello,I've been using Cloud Composer 3 for some time now. Recently I've noticed that my Environment Overview t...
Dataflow enable_google_cloud_profiler dataflow_service_options not working
Hi,We are trying to enabled the Google Cloud Profiler for Dataflow using dataflow_service_options -> enable_go...
Using Dataform with Internal/Private GitLab Repositories
Hello Google Cloud Community,I am looking to use Dataform to execute data pipelines in my company. We use GitL...
How to keep sending Looker Scheduled Report if there is an error
I set up a schedule to send a dashboard every week on Monday. Today, it did not send any results, due to the e...
Column Lineage in Google Dataplex
Hello, I know that we can visualize Table lineage in Dataplex. Is it possible to visualize Column Lineage for ...
How to UPSERT in BigQuery
My design is to have a script run daily to stream records into BigQuery tables via Write API. However, I need ...
Google Search Console data export is missing after June 3rd
Hello,Is there any issue with Google Search Console data?Both the API to download search impressions and click...
Google pubsub message delay for 60 seconds (StreamAckDeadlineSeconds default value)
Hey guys, I have problem similar to described here. From time to time our consumer receive message 60 seconds ...
BQ data transfer tool evaluation for SaaS data sources- 3rd party low code ETL vs BQ native transfer
We have a use case for data transfer from Google Analytics into BQ. I am evaluating a few low code data stream...
Use a different Quota Project For BigQuery
Hi community,I was trying to use a different quota project (other than my resource project where my BQ data re...
GSC to BQ bulk export not working?
I've had the bulk export from Search Console to BigQuery setup since over a year and it has been working witho...
Articles from Product Experts and Googlers
Deeper Insights with knowledge engine & dataset-level metadata in BQ
In my previous blog From Data to Metadata: Unlocking Insights with Gen AI in BigQuery, we explored how BigQuery's “Insights” feature can automatically generate metadata for your tables and columns helping to uncover hidden patterns and trends within your data. We are now taking it a step further with metadata and insights generation at the dataset level. This new capability not only describes the dataset but also provides an interactive entity relationship map that visually reveals connections between different entities.
A developer's guide for building with Anthropic’s Claude 4 models on Vertex AI
We recently announced the general availability of two new models from the latest generation of Anthropic’s Claude model family on Vertex AI: Claude Opus 4 and Claude Sonnet 4. In this blog, we’ll guide you through building with the new Claude 4 models on Vertex AI.
Introducing DeepSeek R1 Model-as-a-service on Vertex AI Model Garden
Deploying Deepseek-R1-0528, a 671B parameters model, typically necessitates at least 8x H200 GPUs for a single API request. Such extensive resources are not accessible to everyone.To make Deepseek R1 more accessible to developers, we're excited to announce that DeepSeek R1 is now available as a fully managed API on Vertex AI in Preview.
