Influence Looker’s Roadmap and join the BI Customer Council (BICC)
Would you like to influence Google Cloud’s BI roadmap more? I’d like to invite you to join the Google Cloud BI...
Data Analytics
Want more from your data? Have questions about products like BigQuery, Dataflow, or Pub/Sub? You're in the right place. Join conversations around data warehouse modernization, streaming analytics, business intelligence, and more.
Focused on Looker? Engage with the Looker Community here.
Focused on Looker? Engage with the Looker Community here.
Forum Posts
Strategies to Block Access for a Specific User to a Table in BigQuery
I'm facing challenges in attempting to block access for a specific user orserviceAccount , to a table in Googl...
Dataform repository SSH connection to GitLab failing
For our Dataform repository, I'm attempting to add an SSH connection to our remote GitLab repository (cloud ho...
Error while triggering Dataform via Airflow (Composer environment)
Please see my code for triggering Dataform. This is in my Airflow DAG and I am using the Composer Environment....
How to get number of records written to bigquery on a specific time period
My requirement is to get the records count that was created / updated to bigquery on a specific time frame.How...
Change in select query response for GoogleSQL Vs Legacy SQL
Hi,When hitting ".../queries" API to fetch data for record datatype with repeated mode I found the response st...
How do I specify resorceHints when running a Dataflow classic template
Hello all,We are trying to deploy our dataflow job as a classic template. The job is Apache Beam Java and when...
Separating slots in Bigquery by process
I separate the slots for the use case mentioned in this question (https://www.googlecloudcommunity.com/gc/Data...
Bigquery Biglake Metastore Linking Fails
Hi Team,We have recently started working with Biglake metastore with Iceberg tables. I am using Apache Spark s...
Same query, different costs [BigQuery]
I have a table with daily partitions by the triggered_at (timestamp) column. When writing a query in the Googl...
BigQuery Data Transfer Service error from 28th October
When using BigQuery's DataTransferService to perform cross-region dataset copy, the following error occurs for...
What can cause pub/sub stops sending message to subscriber?
Sorry if this wrong place to ask. I have async golang microservice that subscribe to pub/sub topic i use, afte...
dataform schema suffix for sources
am trying to manage production and development environments using the GCP cloud GUI from the same code base. I...
Unable to Retrieve Metadata from XCom for Dataform Workflow Invocation in Airflow
I'm working on integrating a Dataform workflow in Airflow, using the guidelines provided in this Google Cloud ...
Help me understand sudden drop in BI Engine used bytes
I have a large table (~150TB) and a 100 GB reservation for BI Engine. The table was constantly using the BI En...
How to run Natural Language API V2
I want to try sentiment analysis by using Natural Language API in Japanese.I was able to run the sample code.h...
How do I stop BigQuery crashing on Google Chrome?
I'm working through a Coursera Course and Google about data analytics.It was fine to work through queries for ...
Google Merchant Transfers (GMC) Still Not Fully Working Several Days Since Setup
Hi guys,I am getting a little desparate here. I've set up a new data transfers from my Merchant Center to BigQ...
Can we increase PubSub subscription filter max length of 256 bytes.
Hi,Can we increase PubSub subscription filter max length of 256 bytes ?As per below link it looks like max all...
Option to Abort or Suspend BigQuery's Scheduled Query
We are running Scheduled Query every 15 minutes. We need an option to abort the running job when it is not abl...
Special characters support in column names
Hi,We have been querying external data sources using temporary tables, with JSON schema files (which include s...
Permissions to see only BQ logs
Could you please advice how to set up IAM permissions, so our BQ admins could see all the logs connected with ...
GCP - Firestore Collection & document create in default DB, not in expected DB
Hello Techies, I am new in GCP world. I have a quick question regarding GCP- Firestore.I have 2 databases ("de...
Error connecting to jdbc with pyspark in dataproc
Hi, I am trying to connect to a mssql server via jdbc with pyspark in dataproc.I am getting an error: py4j.pro...
Structured Streaming data upsert into BigQuery
HiWe are trying to merge streaming data managed in structured streaming, into BigQuery target table. But we me...
Error loading 3GB parquet file from GCS to BigQuery
I have a 3GB parquet file in GCS I am trying to load into a BigQuery table. I see two errors related to the jo...
Dataform: schedule all actions in a schema
Is there a way to schedule all actions in a schema? Note that I specifically don't want to use tags.Scenario:I...
Your favourite data ingestion tool for GCP? Easy extract/load for raw data
So I need to select a data ingestion tool for data platform based on GCP.At first glance - Cloud Data Fusion m...
EU Dataset Not Found Error during Table Creation in DEV_Env Workspace
Scenario Description:Upon the creation of a new development workspace, named as "DEV_Env", its primary functio...
Cloud function error Cannot read properties of undefined (reading 'jobCompletedEvent')
Hi there, I got an error when the Cloud Function executed. run_scheduled_query_ga4_daily_master TypeError: Can...
Google Cloud's Datastream: Not replicating deletes to BigQuery
I have a stream setup with Datastream where a PostgreSQL database on Cloud SQL replicates to BigQuery. When da...
Articles from Product Experts and Googlers
BigQuery Data Preparation with AI Agents: Smarter, faster, and code-free
Ready to unlock the secrets hidden in your product data? This tutorial demonstrates how BigQuery Data Preparation can clean and transform your raw data into actionable business intelligence, using a realistic example from the Fashion and Beauty industry.
Launched: ABAP SDK v1.10 unleashing powerful AI/ML, eventing, and storage capabilities
Supercharge your SAP systems! ABAP SDK v1.10 unlocks BigQuery AI/ML, simplified event-driven integration, Cloud Storage content repositories & access to 290+ Google Cloud APIs. See what's new.
From idea to viral video: the GenAI workflow you need
What if you could create professional-quality videos with just a fraction of the effort? This blog introduces a radical new GenAI workflow on Vertex AI, using models like Gemini, Imagen3, MusicLM and Veo2 etc to make video creation accessible to everyone.
