Influence Looker’s Roadmap and join the BI Customer Council (BICC)
Would you like to influence Google Cloud’s BI roadmap more? I’d like to invite you to join the Google Cloud BI...
Data Analytics
Want more from your data? Have questions about products like BigQuery, Dataflow, or Pub/Sub? You're in the right place. Join conversations around data warehouse modernization, streaming analytics, business intelligence, and more.
Focused on Looker? Engage with the Looker Community here.
Focused on Looker? Engage with the Looker Community here.
Forum Posts
Special characters support in column names
Hi,We have been querying external data sources using temporary tables, with JSON schema files (which include s...
Permissions to see only BQ logs
Could you please advice how to set up IAM permissions, so our BQ admins could see all the logs connected with ...
GCP - Firestore Collection & document create in default DB, not in expected DB
Hello Techies, I am new in GCP world. I have a quick question regarding GCP- Firestore.I have 2 databases ("de...
Error connecting to jdbc with pyspark in dataproc
Hi, I am trying to connect to a mssql server via jdbc with pyspark in dataproc.I am getting an error: py4j.pro...
Structured Streaming data upsert into BigQuery
HiWe are trying to merge streaming data managed in structured streaming, into BigQuery target table. But we me...
Error loading 3GB parquet file from GCS to BigQuery
I have a 3GB parquet file in GCS I am trying to load into a BigQuery table. I see two errors related to the jo...
Dataform: schedule all actions in a schema
Is there a way to schedule all actions in a schema? Note that I specifically don't want to use tags.Scenario:I...
Your favourite data ingestion tool for GCP? Easy extract/load for raw data
So I need to select a data ingestion tool for data platform based on GCP.At first glance - Cloud Data Fusion m...
EU Dataset Not Found Error during Table Creation in DEV_Env Workspace
Scenario Description:Upon the creation of a new development workspace, named as "DEV_Env", its primary functio...
Cloud function error Cannot read properties of undefined (reading 'jobCompletedEvent')
Hi there, I got an error when the Cloud Function executed. run_scheduled_query_ga4_daily_master TypeError: Can...
Google Cloud's Datastream: Not replicating deletes to BigQuery
I have a stream setup with Datastream where a PostgreSQL database on Cloud SQL replicates to BigQuery. When da...
Google Analytics API
Hi Google Team,I am able to execute the below Google Analytics API in the Google Analytics-->Reporting--> Repo...
How to upgrade 1st gen cloud function to 2nd gen
Hi there, hope someone can give me some guidance. How do I upgrade 1st gen cloud function to 2nd gen? What do ...
Cloud PubSub Subscription Exactly once delivery not wokring
hi allI am using Pub/Sub and my Subscription settings are as followsAcknowledgement deadline : 60 secondsExact...
Syntax EXTERNAL_QUERY
I need to implement in the first query the external query (2. screentshot). could someone help me? thank you s...
Pubsub BigQuery Subscription Incompatible type for enum field
I'm attempting to stream a PubSub topic to a BigQuery table using the PubSub BigQuery subscription. Here's wha...
503 ServiceUnavailable Error in BigQuery during load job, but job is successful in console
Hi all,Recently we have been experiencing a 503 Error (google.api_core.exceptions.ServiceUnavailable) when run...
Create dashboard from cloud logs
i have some dataproc batch (serverless) jobs which read data from gcs and write to bigquery. In my job i am ca...
Secrets and Dataflow python
What is the reccomended way to access secrets from secret manager in a dataflow (python) pipeline ?
Proposed Enhancements for Dataform: Maximizing Utility & Streamlining User Experience
Dear Google Cloud Community,As part of my recent deep dive into Dataform, I sought to understand how it could ...
Dataproc serverless batch failure on accessing external PostgreSQL database
I have a PostgreSQL database on aws which I need to ingest into BigQuery. I am trying to use DataProc serverle...
Cannot see BigQuery preview tab when table has policy tags
Hello, we have policy tags defined on some of our tables. They work as expected, users with masked reader perm...
(JOBSテーブルの課金バイト数と請求レポートのバイト数が異なる)BigQuery Billing - difference between JOBS table and Billing report
(請求レポートに表示されるバイト数とINFORMATION_SCHEMA.JOBSから取得できる課金バイト数を確認していますが、実際の各バイト数が2倍以上異なっており、原因として何が考えられるでしょうか。)I have ...
Are There any Data Egress Charges for Using Power BI(cloud) Against GCP Big query
We're considering migrating from on-premises data to Google Cloud's BigQuery. Currently, we use Power BI (SaaS...
Pros and cons: BigQuery Connector for SAP vs Cloud Data Fusion
Considering options for ingesting SAP ERP data into BigQuery. Plan is to ingest raw data and then process as n...
Best way to batch load / historic backfill bigQuery table?
We've got a mysql server running at another cloud provider, and the plan is to use datastream to pull the near...
BigQuery connection
Hi,In the company I've working, Google accounts will be deleted in few weeks (we switch to Microsoft). My conc...
URL of a bigquery table
Hi How do i get the URL from a bigquery table that ive created.ty
Dataflow job failed - Read Time out from Bq
Hello, Everyone.My dataflow job is later than later. And a job is failed becase of time out execption.Dataflow...
Big Query table partition behavior with views
Hello All.I have a bq table that is partitioned on one of the date columns. A view was created on top of this ...
Articles from Product Experts and Googlers
Introducing DeepSeek R1 Model-as-a-service on Vertex AI Model Garden
Deploying Deepseek-R1-0528, a 671B parameters model, typically necessitates at least 8x H200 GPUs for a single API request. Such extensive resources are not accessible to everyone.To make Deepseek R1 more accessible to developers, we're excited to announce that DeepSeek R1 is now available as a fully managed API on Vertex AI in Preview.
Untangle the API maze with Apigee API Hub
Mirror mirror on the wall, What do I do with my API sprawl, Where can I see them all, How to make sure they listen to my call, And to ensure their compliance doesn’t fall. API Hub is the one to rule them all!
Next-Gen Data Pipelines: Airflow 3 Arrives on Google Cloud Composer
We are thrilled to announce that Google is the first hyperscaler to provide selected customers with access to Apache Airflow 3 on our fully managed Cloud Composer 3 service. Discover how powerful new features like DAG Versioning, a modern React-based UI, and scheduler-managed backfills can help you innovate faster and more reliably.
