Influence Looker’s Roadmap and join the BI Customer Council (BICC)
Would you like to influence Google Cloud’s BI roadmap more? I’d like to invite you to join the Google Cloud BI...
Data Analytics
Want more from your data? Have questions about products like BigQuery, Dataflow, or Pub/Sub? You're in the right place. Join conversations around data warehouse modernization, streaming analytics, business intelligence, and more.
Focused on Looker? Engage with the Looker Community here.
Focused on Looker? Engage with the Looker Community here.
Forum Posts
BigQuery not taking advantage of WHERE predicate
We tried comparing the performance of BigQuery on the Star Schema Benchmark described here. The benchmark crea...
Getting StreamWriterClosedException in BQ Storage Write Api
I have been using java service which write records to BQ using storage api. Its been running fine for almost a...
Big query [Schedule query issue]
Hi folks I got a weird issue in Big Query's schedule query section around 2022-10-11 22 : hour UTC. My queries...
Can I disable PubSub without killing Cloud Functions?
I enabled pub/sub in my Google Cloud functions account, but subsequently realized that CloudTasks is a better ...
Using Drop-down Lists in Data Studio with Exclude Filters
Hello everyone! Does anyone know how to use drop-down lists in Data Studio to control exclude filters (e.g. if...
Escaping comma in dataproc workflow template parameter
I have a workflow template in Dataproc that must have a parameter NAME containing a comma. e.g "john,doe". I i...
Vincular tablas en Data Studio
HolaQuiero hacer un gráfico a partir de una tabla y usar una columna que contiene los ID de productos.¿Puedo i...
What does "file size strategy" mean here in stream prefix path of GCP Datastream?
What does "file size strategy" mean here in stream prefix path of GCP Datastream? Is this any new feature that...
Loading Data from Google Cloud Storage
I was trying to load multiple csv files as table on my dataset, how can I load all the files at once on my dat...
Replicating Oracle data in BigQuery for real-time and automated insights
Hello BQ users! We recently published a step by step guide (with sample codes), which walks through how to set...
Regarding App Verification for Sensitive scope
Hi Team,For Using Sensitive Scope in our Application Do we need to verify our app? We are doing R&D on Google ...
Move CSVs from Google Cloud Storage to BigQuery
Hello super engineers, I hope you are well! I have recently created a scheduled upload of CSVs from a SaaS too...
Data set not pinned under explorer
Hi Everyone, I am having issues when viewing data set, the data set does show in the left bar automatically wh...
How to move csv files from Gmail to Google Cloud Storage
Hi everyone, someone can I help me with an example of how to move a .csv file from gmail to Cloud Storage?Frec...
Government Transparency
We've built a modern platform to form a robust basis for understanding public finances in Utah.It's comprehens...
Data Table Expiration Date
Per these instructions (https://cloud.google.com/bigquery/docs/managing-tables#updating_a_tables_expiration_ti...
incomplete data bigquery
On 13.07 I only see 204,047 rows in my bigquery, usually not less than 5 million rows. In the GA4 interface, t...
How to fix "There is no cloudservices robot account for your project."
We are using Terraform to deploy the resouce "google_dataflow_job" on Google Cloud. We did a successfully depl...
Copy GCS objects with CSEK
I have a few files that are uploaded to my GCS bucket. I need to copy those files using Python to another buck...
Question about how BigQuery querying external table
Dear Sir / MadamI got a question about how BigQuery querying external table. I do very appreciate your kind he...
Public data not Pinned under explorer
Hello,The data set noa_lightening is failing to pin under the explorer tab as seen in the attached image.Kindl...
Avro schema specify during the big query load
I am looking for an option where I can specify Avro schema file from bq load . Thanks in advance.
BigQuery COMPRESSED storage tier?
When I was exploring BigQuery's public dataset today and the details shown from BigQuery information schema I ...
org.apache.spark.shuffle.FetchFailedException in Serverless Dataproc
I am getting the below error with serverless Dataproc (Batches) for a job."org.apache.spark.shuffle.FetchFaile...
At what rate does Google Pub/Sub deliver messages to a listener?
Hello,I am trying to understand the policy Google Pub/Sub uses to deliver messages to a listener.- is each mes...
New resource! 👉 Dataflow observability, monitoring, and troubleshooting 7 data pipeline challenges
Check out our latest article to learn Dataflow's core observability features and how to troubleshoot seven com...
When does Cloud Storage Pubsub Notification object contain eventBasedHold field?
I have been using (Synchronous Pull) requests to fetch Pubsub Notifications for objects pushed to a bucket. To...
Permissions for access to Bigquery Project-Id
Hi community,When we're working on different projects in bigquery, we're changing project-id from the top pane...
Materialized View is slow
BigQuery Materialized View is very slow when queried, even when just a one-to-one pull from its originating ta...
BigQuery data transfer with Market Insights for Merchant Center MCA account
Hi,I am trying to setup a data transfer for a MCA account of Merchant Center. Only some of the hundreds of sub...
Articles from Product Experts and Googlers
Deeper Insights with knowledge engine & dataset-level metadata in BQ
In my previous blog From Data to Metadata: Unlocking Insights with Gen AI in BigQuery, we explored how BigQuery's “Insights” feature can automatically generate metadata for your tables and columns helping to uncover hidden patterns and trends within your data. We are now taking it a step further with metadata and insights generation at the dataset level. This new capability not only describes the dataset but also provides an interactive entity relationship map that visually reveals connections between different entities.
A developer's guide for building with Anthropic’s Claude 4 models on Vertex AI
We recently announced the general availability of two new models from the latest generation of Anthropic’s Claude model family on Vertex AI: Claude Opus 4 and Claude Sonnet 4. In this blog, we’ll guide you through building with the new Claude 4 models on Vertex AI.
Introducing DeepSeek R1 Model-as-a-service on Vertex AI Model Garden
Deploying Deepseek-R1-0528, a 671B parameters model, typically necessitates at least 8x H200 GPUs for a single API request. Such extensive resources are not accessible to everyone.To make Deepseek R1 more accessible to developers, we're excited to announce that DeepSeek R1 is now available as a fully managed API on Vertex AI in Preview.
