Influence Looker’s Roadmap and join the BI Customer Council (BICC)
Would you like to influence Google Cloud’s BI roadmap more? I’d like to invite you to join the Google Cloud BI...
Data Analytics
Want more from your data? Have questions about products like BigQuery, Dataflow, or Pub/Sub? You're in the right place. Join conversations around data warehouse modernization, streaming analytics, business intelligence, and more.
Focused on Looker? Engage with the Looker Community here.
Focused on Looker? Engage with the Looker Community here.
Forum Posts
autoscale cloud function based on no. of messages in pubsub
is there a way to autoscale cloud function based on number of messages in pubsub. My understanding of scaling ...
Can BigQuery perform Left join on 24TB data?
Hi,I want to use BigQuery to remove duplicate items between 2 tables (each table only has one column). I plan ...
GCP Datastream doesn't replicate new tables from RDS Postgres
Hello,I have a datastream that replicate RDS postgres to Bigquery dataset.Everything is set correctly, the dat...
Restrict other users to perform any actions on my BigQuery tables
Hi Folks,There are risks that user overwrites an existing BigQuery table. Let's say a user wants to create a t...
See GCS and BQ Storage Sizes Across Multiple projects
I need to monitor general GCP statistics across multiple projects. LikeTotal GCS StorageTotal BQ StorageTotal ...
How to configure a compilation result
Hi, I'm try to execute scheduled workflows in Dataform, my repo is not connected with a git remote. I'm using ...
Column Parameter to Dataform Assertion
Hi, Is it possible create a custom assertion passing column and list of accepted values as parameter to check ...
which service to choose : hive metastore on cloud sql or on metastore service
Hi When we are using a dataproc cluster that needs a hive metastore,what benefits we have using the metastsore...
about table data in BI engine update
Hi,May i ask, If I reserve a BI engine and set a table, but the bigquery table data will be updated daily, and...
SQL error
SELECT customer.customer_id, customer.first_name, customer.last_name, SUM(invoice.total) as totalFROM `Music_d...
BigQuery Quota Limit understanding
Hi,I'm using bigquery, interactive queries (not scheduled or nor API) to perform task that requires too many l...
Looking for BQ compatible metadata table corresponding to Netezza metadata
Hi Folks,We are in the process of migrating our customer from Netezza to BigQuery. In this phase, we are refac...
Getting a GCP BAA without a Google Workspace account
One of my clients is in Healthcare and just set up their GA4 export to BigQuery. We went forward with this bec...
Dataform - Incremental Update (MERGE), But Delete When Not Matched By Source
Hi,I'm working with Dataform and seeking advice on handling a specific case. In my current setup, I'm using Da...
How to UPSERT in BigQuery
My design is to have a script run daily to stream records into BigQuery tables via Write API. However, I need ...
BigQuery Storage API Billing Breakdown
Hello! Is there any way to breakdown BigQuery Storage API costs further than SKU.description? Got quite big am...
Dataform incremental tables
I think I am surely doing something wrong here. I shall be grateful if someone can guide me.Please see this ps...
BQ Sandbox limit table - historic data
I have the bigquery sandbox here at the company and the table is only valid for 60 days. If I upgrade to a pai...
Dataform optimisation
I have this query in Dataform which I am trying to optimise. I cannot find a way to do it. Any help will be ap...
Dataproc Metastore couldn't start
I got an issue happened since 3h30 UTC with Dataproc MetastoreAs I look into Logs Explorer, it happened after ...
BigQuery table restoration usecases
Hi Folks,How can we perform the following restoration in BigQuery?Need to be able to restore any tables back i...
CCAI insights Export
I want to export CCAI Insight data to Big query to have the transcript data for conversation. HOW can i procee...
BigQuery Storage Cost didn't match with Billing Report
Hi! I'm trying to get storage cost in BQ with following query: with data as ( select sum(billable_active_logic...
Bigquery load from GCS using python client API sleeping...
While performing a GCS (parquet) load to BQ using the python SDK I get a debug message that seems to be backin...
BigQuery compatibility with Netezza hash function for values with special character ¶
Hi Team,I'm trying to convert NZ functions to BQ compatibility and Im facing some discrepancy when dealing wit...
Schedule Job from cloud storage to big query
Hi, may I know how and what are the steps to schedule a job that will do merging of datasets from cloud storag...
trigger spark job from Airflow bitnami on compute engine
HiI have successfuly deployed a job in airflow from google cloud composer.I'm trying now to do the same by pro...
data bias
I am working on data analytics guided project. I have completed working on ask phase and currently working on ...
BigQuery Materialized View
Hi there, I am exploring on BigQuery Materialized view. anyone knows if Materialized view supporting Primary/F...
Data Fusion add one table
Hello, I've encountered an issue in Data Fusion where in the Replication task, it's not possible to add a new ...
Articles from Product Experts and Googlers
BigQuery Data Preparation with AI Agents: Smarter, faster, and code-free
Ready to unlock the secrets hidden in your product data? This tutorial demonstrates how BigQuery Data Preparation can clean and transform your raw data into actionable business intelligence, using a realistic example from the Fashion and Beauty industry.
Launched: ABAP SDK v1.10 unleashing powerful AI/ML, eventing, and storage capabilities
Supercharge your SAP systems! ABAP SDK v1.10 unlocks BigQuery AI/ML, simplified event-driven integration, Cloud Storage content repositories & access to 290+ Google Cloud APIs. See what's new.
From idea to viral video: the GenAI workflow you need
What if you could create professional-quality videos with just a fraction of the effort? This blog introduces a radical new GenAI workflow on Vertex AI, using models like Gemini, Imagen3, MusicLM and Veo2 etc to make video creation accessible to everyone.
