Influence Looker’s Roadmap and join the BI Customer Council (BICC)
Would you like to influence Google Cloud’s BI roadmap more? I’d like to invite you to join the Google Cloud BI...
Data Analytics
Want more from your data? Have questions about products like BigQuery, Dataflow, or Pub/Sub? You're in the right place. Join conversations around data warehouse modernization, streaming analytics, business intelligence, and more.
Focused on Looker? Engage with the Looker Community here.
Focused on Looker? Engage with the Looker Community here.
Forum Posts
Connecting with Data experts for guidance
hi, I will like to get to know and have data experts whom I could get advise and guidance on the path of becom...
Is there a list of Resource-based APIs and Client-based APIs
In a documentation page regarding authentication (https://cloud.google.com/docs/authentication/provide-credent...
Explorer doesn't show up
Hello, previously I have made a project using Google BigQuery and it works fine & well. Suddenly, when I want ...
pub/sub subscription in order (PHP)
Hi, Im Wayne.I'm subscribing messages with "pull" method in PHP.I'm wondering if I could get messages in order...
Download multiple files from cloud?
Hello. Could anyone please show me how to download folders/files that I had previously uploaded to Google Clou...
Best way to develop pub/sub application - comparison of different examples
I am learning pub/sub and have seen at least 3 different ways to process pub/sub messages. Here they are:1. ht...
External Query to MySQL Cloud Database
Hello I have gone throw the following tutorials:https://cloud.google.com/bigquery/docs/cloud-sql-federated-qu...
data catalog
Hi All,I am working on GCP data catalog where there are two environments dev and prod. There are similar table...
Need permission to select a Billing Project for Data Studio
Hi community We want the cost to remain customer for the report screens we have prepared. but we don't know ...
New feature in google map
Hello dears My idea related to help request from a car driver through google map based on his current loaction...
Cost in data ingestion project
Hello everybody,I'm working on a project to migrate data from a PostgreSQL database to Bigquery, and I'm using...
firebase intergrated data(events_intraday_20220825) not merged
Hi, I integrated my firebase project to Bigquery and using data via it.What I have been saw is : [1] when the ...
Data ingestion cost for Big Query Storage api
What is the data ingestion cost of storage api in pending mode and committed mode. In gcp page there is only s...
Images are not loading in the Documentation Page
I am looking at this documentation for the Google Cloud connector for SAP, Architecture diagram is not loading...
Connection finished with error io.grpc.StatusRuntimeException: CANCELLED: Stream is closed by user.
we are using the code provided here to write to BQ storage. It works but we see following message in the logs ...
PermissionDenied: 403 Permission 'TABLES_UPDATE_DATA' denied
Hi,I am testing the Bigquery storage write API by attempting to write sample data into Bigquery and I am getti...
How to load local csv to cloud sql and create pipeline to connect it to bigquery ?
Loading local csv to Cloud sql and creating batch data pipeline and connect it to BIgquery for further analyti...
Big query schedule queries to run at a particular minute of an hour
Hi , So I want to schedule my queries every hour at 15 th minute. For example 09.15 , 10.15 , 11.15 , 12.15 .....
Dataflow job runs successfully but Composer DAG reports failed
Hello,I am trying to execute one Dataflow job only within a DAG on Composer. The Dataflow job runs successfull...
Do Cloud Storage Pubsub Notification messages include Ordering Key?
I'm consuming messages from a Pubsub topic that is populated by Cloud Storage Pubsub Notifications (https://cl...
Monthly Snapshots in BigQuery
What is the best way to create monthly backups of your data within BigQuery?In looking like BQ provides snapsh...
PubSub Push Subscription - how to reduce retry attempts below 5
Hi, I am working on one of the project migrations from AWS to GCP. In that, I need to implement a workflow as ...
Unable to Pin public dataset to BigQuery
Hi,Unable to Pin Public dataset to Explore tab and also after clicking on "View Dataset" on Dataset page, the ...
How to identify duplicate OBJECT_FINALIZE events in Cloud Storage Pubsub Notifications?
Is there an example, or a recommended way to deduplicate messages that come from Cloud Storage Pubsub Notifica...
BigQuery Subscription: Incompatible Schema using proto3 and BigQuery Subscriber
Hi all,it seems like there is an issue/bug using proto3 for the Cloud Pub/Sub Topic Schema definition together...
Unable to run any query due to error: Query error: An internal error occurred and the request could
Hello, I just received this error on my scheduled queries:Query error: An internal error occurred and the requ...
pubsub stops subscribing messages till failed message gets succeeded
we have implemented pubsub with orderingkey enabled. we are trying to publish 1, 2, 3, 4, 5 and the message 3 ...
BQ Multiple FROM statements
I have sink setup where our GCP logs are streamed to BQ. These logs are separated by date where the end of the...
Not able to copy a public dataset to big query
Tried copying a public dataset "theLook eCommerce" but not able to copy. Permission is getting denied even aft...
Unable to copy public datasets to BigQuery - The attempted action failed
When I try to copy a public data set, e.g. austin-incidents to my project, I get a cryptic error message such ...
Articles from Product Experts and Googlers
Deeper Insights with knowledge engine & dataset-level metadata in BQ
In my previous blog From Data to Metadata: Unlocking Insights with Gen AI in BigQuery, we explored how BigQuery's “Insights” feature can automatically generate metadata for your tables and columns helping to uncover hidden patterns and trends within your data. We are now taking it a step further with metadata and insights generation at the dataset level. This new capability not only describes the dataset but also provides an interactive entity relationship map that visually reveals connections between different entities.
A developer's guide for building with Anthropic’s Claude 4 models on Vertex AI
We recently announced the general availability of two new models from the latest generation of Anthropic’s Claude model family on Vertex AI: Claude Opus 4 and Claude Sonnet 4. In this blog, we’ll guide you through building with the new Claude 4 models on Vertex AI.
Introducing DeepSeek R1 Model-as-a-service on Vertex AI Model Garden
Deploying Deepseek-R1-0528, a 671B parameters model, typically necessitates at least 8x H200 GPUs for a single API request. Such extensive resources are not accessible to everyone.To make Deepseek R1 more accessible to developers, we're excited to announce that DeepSeek R1 is now available as a fully managed API on Vertex AI in Preview.
