Influence Looker’s Roadmap and join the BI Customer Council (BICC)
Would you like to influence Google Cloud’s BI roadmap more? I’d like to invite you to join the Google Cloud BI...
Data Analytics
Want more from your data? Have questions about products like BigQuery, Dataflow, or Pub/Sub? You're in the right place. Join conversations around data warehouse modernization, streaming analytics, business intelligence, and more.
Focused on Looker? Engage with the Looker Community here.
Focused on Looker? Engage with the Looker Community here.
Forum Posts
Clarification on Dataform Repository Size Limitations and Actions vs. SQL Workflow Nodes
Hello Dataform Community,I'm currently working with Dataform and trying to better understand some of the speci...
Dataform cannot find upstream view if using workspaceName
When Schema Suffix is set to `${workspaceName}`, I start getting errors like the following:```Not found: Datas...
How Do I Fix "QuickBooks the File You Specified Cannot Be Opened" Error?
I'm trying to open my QuickBooks company file, but I keep getting an error message that says, "The file you sp...
Dataform: Loading data from local CSV file
I want to be able to load data from a local csv file to a Bigquery table (i.e similar to the dbt command) and ...
How to provide permission to BigQuery datasets
Hi. I have several datasets in my project. Please tell me how to provide access to the project, but not to all...
BigQuery export using FOR SYSTEM_TIME AS OF
Is there a way to export a BigQuery table with respect to a past time using time travel. Snapshot and clone al...
DATAFORM- CSV GCS using Dataform to Bigquery
I am trying to bring data from a .csv file from Google Cloud Storage to Bigquery using Dataform, however the j...
Logging service client returns a lot less log entries than what I got from log explorer
In Log Explorer, run the following query for the last 30 days got 51 entries.resource.type="cloud_dataproc_clu...
Datastream Issues
We are encountering a problem with the synchronization of data from MySQL to BigQuery through Datastream. An e...
Issue with BigQuery Data Streaming using google-cloud-bigquerystorage 2.24.2
I am experiencing an issue with my BigQuery data streaming application, which uses the following dependency: c...
Creating a remote function from Dataform
Hello Community,We need in our project, from a Dataform Workflow to trigger a Cloud Run Workflow via an end po...
Insufficient Permissions Error When Fetching Data from Google Analytics to Custom Dashboard
Hello everyone,I'm encountering an issue with fetching data from Google Analytics to a custom-built dashboard ...
Events from Firebase Analytics not showing up in Big Query after a specific date
Hello Everyone,I have linked Firebase with Big Query, and I was consistently receiving the 'app open' event fr...
BQ Admin but cannot access INFORMATION_SCHEMA.TABLES
I have the IAM role of Bigquery Admin, yet when I try execute an INFORMATION_SCHEMA.TABLES query I get the err...
Issue with BigQuery Data Streaming using google-cloud-bigquerystorage 2.24.2
I am experiencing an issue with my BigQuery data streaming application, which uses the following dependency: c...
Dataflow template - Streaming - Mongo DB CDC to Bigquery
I am using the Dataflow Mongo cdc to Bigquery template to create a pipeline that listens to Mongo DB change st...
BigQuery check if two strings are different by exactly 1 character
I have a long (18 million) list of short (sub ten character) strings. I need to compare them all to each other...
Googl Cloud Statistic
Hi,I would like to know number of select queries for all tables or views from the particular project, which wa...
Using DMS instead of pub/sub for transaction data
I need some help with a GCP based architecture that I am trying to design.Here is the scenario: Some point-of-...
context timeouts during composer upgrades and python package additions
Show More We are experiencing issues with cloud composer upgrades and the addition of pypy packages to the sys...
Price to implement bigquery on-demand
I want to implement Bigquery in a company, they have several spreadsheets and we want to migrate this data to ...
Dataform - Incremental Pipeline Issue: Unrecognized Variable Error in Dataform Using pre_operations
Hi,I'm working on creating an incremental pipeline where I aim to update a table incrementally from a partitio...
Why do I get charged 2 cents per month for minimal Big Query storage and use?
My organization created a BigQuery account to store website analytics data past the 18 month limit imposed by ...
BigQuery Subscription writes FLOAT and BOOLEAN data incorrectly to BigQuery
Hello guys,I'm working with Pub/Sub's BigQuery Subscription on different kinds of data types and there are sev...
I couldn't see the embed option in Admin panel
We have embedded a looker dashboard to the production site recently. We have removed some of the users from lo...
Google Merchant Center -> BigQuery. Wrong quantity of products by custom label
Hello, I have a problem with data in BigQuery.I have counted how many products had custom label X yesterday, a...
CrUX dataset in Power BI
Hi, the CrUX (=Chrome User Experience Report) dataset is a dataset that can publically be accessed via google ...
Google Analytics 4 RAW Data Export to GCS. Is Approach valid?
Hi,Goal: To export Google Analytics 4 events data to the GCS bucket on daily basis. Approach: Exporting Table ...
Dataflow PubSub to Elastic Text Transform Does Not Execute [Resolved]
I am attempting to use the PubSub to Elasticsearch Dataflow Template:https://cloud.google.com/dataflow/docs/gu...
Debezium for MySQL
I want to configure debezium for capturing the data from MySQL and then Sending it to Pub/Sub and then I want ...
Articles from Product Experts and Googlers
Introducing DeepSeek R1 Model-as-a-service on Vertex AI Model Garden
Deploying Deepseek-R1-0528, a 671B parameters model, typically necessitates at least 8x H200 GPUs for a single API request. Such extensive resources are not accessible to everyone.To make Deepseek R1 more accessible to developers, we're excited to announce that DeepSeek R1 is now available as a fully managed API on Vertex AI in Preview.
Untangle the API maze with Apigee API Hub
Mirror mirror on the wall, What do I do with my API sprawl, Where can I see them all, How to make sure they listen to my call, And to ensure their compliance doesn’t fall. API Hub is the one to rule them all!
Next-Gen Data Pipelines: Airflow 3 Arrives on Google Cloud Composer
We are thrilled to announce that Google is the first hyperscaler to provide selected customers with access to Apache Airflow 3 on our fully managed Cloud Composer 3 service. Discover how powerful new features like DAG Versioning, a modern React-based UI, and scheduler-managed backfills can help you innovate faster and more reliably.
