Influence Looker’s Roadmap and join the BI Customer Council (BICC)
Would you like to influence Google Cloud’s BI roadmap more? I’d like to invite you to join the Google Cloud BI...
Data Analytics
Want more from your data? Have questions about products like BigQuery, Dataflow, or Pub/Sub? You're in the right place. Join conversations around data warehouse modernization, streaming analytics, business intelligence, and more.
Focused on Looker? Engage with the Looker Community here.
Focused on Looker? Engage with the Looker Community here.
Forum Posts
Dataplex - Email alert on job failure - needs to happen once - incremental scope
Dear TeamAny inputs on the below would be highly appreciated? we have set the below things in our scanscope in...
Filtering Big Query view with partition column
Hello.I have a case where I need to filter data using a view and a partition column.Table:CREATE TABLE `testin...
Datastreams Bug: Primary Key Mapping Failure on Tables with Formal Definitions
We are experiencing an issue with Datastream, when replicating SQL Server (Cloud SQL) tables that have formall...
Apache Beam pipeline deployed with a flex template fails to run on Dataflow
I'm trying to build a dataflow pipeline to fetch data from sql server (its on a vm on compute engine), do some...
Event Parameter value cut off after 100 char - GA360 limits are not applied
Hi there, hope you'll be able to help. Maximum length of parameter value is 100 characters, meaning values lon...
Dataforms rest api
HI,I notice the rest api of Datafomrs is name 1beta1 and its latest relesae is 0.11. Does it mean this is a be...
Spark Dynamic overwrite to bigquery overwrites entire table
Hi I'm trying to overwrite a specific partition date(dt) data from bigquery through spark but it overwrites th...
Underlying implementation details for dataflow runner
Our system processes high volumes of I/O operations, primarily consisting of concurrent external service calls...
Influence Looker’s Roadmap and join the BI Customer Council (BICC)
Would you like to influence Google Cloud’s BI roadmap more? I’d like to invite you to join the Google Cloud BI...
Apache beam python pipeline error: ERROR:root:Error: Cannot start an expansion service since neither
I'm trying to run an apache beam Dataflow job directly into GCP using Artifact Registry. Basically I'm trying ...
DataPlex DataQuality Scan
I have a table that has field "Updated_TS" , which is the time at which the record was updated. I am setting u...
Incremental materialized view - can't query more than once workaround
I need to create incremental materialized view for reporting purposes having the following source table:produc...
Dataform - Bigquery Omni AWS problem
Hi, I'm currently working on the multi-cloud integration in my company.To achieve this, we started to connect ...
Default behavior of spark3.5.1 when writing Numeric/Bignumeric to BigQuery
As per documentation of spark 3.5.1 using latest spark-bigquery-connector, Spark Decimal(38,0) should be writt...
python_template_launcher.go:37: Failed to initialize fluentd logger
Hi all,I'm using a golden image with non root user to build an run a dataflow template.I got this errorpython_...
Dataform - Timezone workflow configurations issue
Hi,Last week I created in Dataform a new workflow configuration.I was really sure that I selected the CEST as ...
goog_blockchain_polygon_mainnet_us not updating since 8 march
goog_blockchain_polygon_mainnet_us data is not being updated since 8 March 2025.It is mentioned here that Goog...
Can't choose multi-region when creating BigQuery dataset.
Hi,We currently have two problems with our data warehouse, that I believe are connected. The first problem is ...
how to connect google drive data to bigquery?
how to connect google drive data to bigquery?Bigquery required URI form is https://drive.google.com/open?id=[f...
Need Help on Hybrid Query support with bigquery and spark
I have small use case, like the belowi have CSV file in GCS storage, there one Huge table in bigQuery as emp_t...
Schema Modeling & SQL Migration Tools for BigQuery
Hi,I'm working with BigQuery and managing around 50 tables, along with multiple routines, scheduled jobs, and ...
No APP campaigns into the Google Ads Data Transfer (bigquery)
Hey, please clarify the situation that the Data Transfer for BigQuery and exactly transfering Google Ads data ...
Unexpected unacked messages for Push to BigQuery subscriptions
Hello, community!I'm facing an issue with Pub/Sub subscription metrics (Push delivery type with Write to BigQu...
What are the key steps in the data analytics process?
The key steps in the Data Analytics process include data collection, cleaning, analysis, visualization, and in...
BigQuery Storage Write API, multiple datasets and tables, and Node.js
We're building a new data ingestion pipeline and storing data in BigQuery. This is streaming data (think like ...
No native solution SFTP to GCS? For real?
I am exploring options for copying/moving some files from SFTP to GCS, Google Cloud Storage.Does GCP for real ...
Basic checks on BigQuery tables
I have a set of CRITICAL tables in BigQuery that are getting loaded hourly by DAGS. I have been tasked to deve...
USING BigQuery and having this error
"Not found: Table hajira-450716:avocado_data.avocado_prices was not found in location US" having this error wh...
Geminin in Looker - activation Problem
hello, i have the 90 day trail version. my idear is bigquery - analytics-ki.i try since 2 days that i can acti...
Dataplex column-level lineage: Estimated release date
Hi,I'd like to know if there is an estimated release date for the column-level lineage feature in Dataplex.As ...
Articles from Product Experts and Googlers
BigQuery Data Preparation with AI Agents: Smarter, faster, and code-free
Ready to unlock the secrets hidden in your product data? This tutorial demonstrates how BigQuery Data Preparation can clean and transform your raw data into actionable business intelligence, using a realistic example from the Fashion and Beauty industry.
Launched: ABAP SDK v1.10 unleashing powerful AI/ML, eventing, and storage capabilities
Supercharge your SAP systems! ABAP SDK v1.10 unlocks BigQuery AI/ML, simplified event-driven integration, Cloud Storage content repositories & access to 290+ Google Cloud APIs. See what's new.
From idea to viral video: the GenAI workflow you need
What if you could create professional-quality videos with just a fraction of the effort? This blog introduces a radical new GenAI workflow on Vertex AI, using models like Gemini, Imagen3, MusicLM and Veo2 etc to make video creation accessible to everyone.
