Influence Looker’s Roadmap and join the BI Customer Council (BICC)
Would you like to influence Google Cloud’s BI roadmap more? I’d like to invite you to join the Google Cloud BI...
Data Analytics
Want more from your data? Have questions about products like BigQuery, Dataflow, or Pub/Sub? You're in the right place. Join conversations around data warehouse modernization, streaming analytics, business intelligence, and more.
Focused on Looker? Engage with the Looker Community here.
Focused on Looker? Engage with the Looker Community here.
Forum Posts
Event Filter on "id" attribute of google.cloud.storage.object.v1.finalized event
Hi!I am looking to add an event filter to a cloud event trigger that filters on the id attribute of the google...
Dataform Incremental Table Merge to also DELETE
Hello Google Community, hoping for some help here!I've got a Dataform JavaScript file that needs to merge a so...
Encrypt Bigquery datasets with CMEK
I have a BIGQUERY datasets which has over 400GB of data encrypted with google managed keys, now I want to encr...
Queriying on table with large data gives null response the first time
Hi,I am developing an integrating with Google big query, I have notices sometimes "/queries" API endpoint resp...
Datastream got updated and now timing out
We have three environments using Datastream. On Sunday they all got "updated" and started failing immediately ...
Dataflow Stateful processing Issue || worker failed with OOM
Hi,I have implemented dataflow pipeline to replicate data from BQ to cloudsql. In Bigquery there are tables wh...
Data fusion Bigquery plugin
Hi, I have a pipeline that is failing in Bigquery plugin, now I created another with just that plugin and the ...
Selected software image version '2.1.24-s8s-spark' does not support control plane decommissioning
Hi,I have a dataproc serverless batch job using the 2.1 Runtime version.Looking to use the new autoscaling ver...
JSON_SET broken?
I thought I posted this but now I cannot find the post.Starting last night, our calls to JSON_SET are no longe...
To convert SQL DDLs to BigQuery.
Can someone please suggest a best tool to convert SQL DDLs to BigQuery. I wrote a Python code to read the Json...
who sent the job to dataproc?
Hello community,I need to know who started a job in the dataproc cluster... I need to know if it was a service...
gsutil copy command changing the content inside the Json file
every time I use the command gsutil -m cp -r -P "$input_location" "$destination" to copy jason file , the orde...
How I can spilit data from one column to other column
WITH Test_1 AS(SELECTchat_start_url, chat_start_date_Asia_Kolkata, referrer, chat_duration_in_seconds, visitor...
Cloud Composer monitoring pod connection timeout
Hello,I've created a few Composer environments through Terraform (same config, different projects). For the mo...
BigQuery Error : Resources exceeded during query execution
We are reporting an error which happened for 2 days in a row now in our BigQuery Operations.These processes we...
Sudden change to big query permissions
Without making any changes on our domain, big query suddenly stopped importing Workspace logs, and I got a cry...
Reserved VMs availability for dataproc
Is the use of reserved VMs applicable for the below usecases in dataproc?1. Dedicated cluster: this we could a...
Control access to query BQ tables from specific project
Hi all,So we have 2 GCP project, let's call them `real` and `playground`. There are BQ tables under both, and ...
Slow query execution in Bigquery
Hi Team, We are using Bigquery with BI engine enabled. There are multiple occurrence of a simple select query ...
Google Drive API: problem accessing Revisions List by using Google Service Account
When I read:https://developers.google.com/drive/api/reference/rest/v3/revisions/listand try this call right on...
Accessing Dataproc cluster using Apache Livy
Can i access Dataproc cluster from Apache Livy instead of Dataproc API? If i can, Where I have to install my a...
Bigquery Logs
Is there a way to check the history of changes made to a particular schedule query.I am able to see the creato...
Duplicate records in bigquery not able to delete.
1. Our source is Oracle and the Destination is a big query we are using Datastream to migrate the data. In the...
Customer Feedback Analysis (Prioritization)
Hello EveryoneI am working as a Fractional Head of Growth at a FinTech. I want to understand how I can analyze...
Querying a view that references another view returns no records.
I have a view that compares a table to a different view. If I run the SQL (on the right) that comprises the vi...
Getting Bigquery resources exceeded error in LookerML
Hi, we are getting the "Resources exceeded during query execution: The query could not be executed in the allo...
Remove Extra column which is automatically created in table
WithChat_Kernel as (SELECTconferenceId, chat_creation_date_Asia_Kolkata, chat_start_date_Asia_Kolkata, chat_st...
Connect and transfer data from google sheets to bigquery
Hey community, I want to automatically push new data to BigQuery from Google sheets and save each day, instead...
Querying BigQuery via zeppelin will fail because permissions are denied.
1. I created a service account. ( with bigquery.admin role )2. created a service account key 3. set up zeppeli...
Bigquery location consistency over multiple multi regions datasets
My organisation has multiple datasets in different projects with US multi-regions setting. I never had any iss...
Articles from Product Experts and Googlers
Using Vertex AI to evaluate an example A2A Agent
Previously, we explored why trajectory evaluation and handoffs are critical for multi-agent systems. In our latest post, we move from theory to practice, showing you exactly how to evaluate agent2agent (A2A) agents. We'll guide you through a hands-on example, building and assessing a Reimbursement Agent using the power of Vertex AI Evaluation services. Dive into our Colab notebook to learn how to set up and run your own evaluations, ensuring your multi-agent systems perform flawlessly. 🚀
How to build AI agents with long-term memory using Vertex AI Memory Bank & ADK
Is your AI agent suffering from amnesia? Don't let your users get stuck in a conversational loop. It's time to stop relying on clunky, expensive context windows that lead to "context rot." This guide introduces the Vertex AI Agent Engine Memory Bank. Learn how to build agents that remember and recall information across conversations. We'll show you how to generate, store, and retrieve memories, creating an enhanced user experience. Ready to build agents that truly connect? Let's get started.
Protect your LLM applications with Google Cloud Services
Generative AI offers immense power, but with it comes significant risk. This article discuss how to protect your LLM applications from prompt injection, data leakage, and other threats using a multi-layered security approach with Google Cloud services like Natural Language API, Model Armor, and vector databases.
