Influence Looker’s Roadmap and join the BI Customer Council (BICC)
Would you like to influence Google Cloud’s BI roadmap more? I’d like to invite you to join the Google Cloud BI...
Data Analytics
Want more from your data? Have questions about products like BigQuery, Dataflow, or Pub/Sub? You're in the right place. Join conversations around data warehouse modernization, streaming analytics, business intelligence, and more.
Focused on Looker? Engage with the Looker Community here.
Focused on Looker? Engage with the Looker Community here.
Forum Posts
Concern Regarding Release Configuration in Dataform
I hope this message finds you well.I am reaching out to address a recurring concern regarding the release conf...
INFORMATION_SCHEMA.TABLES Monitoring last modified time
I'm monitoring table updates per project, so I'm using INFORMATION_SCHEMA.TABLES. But TABLES only have "creati...
Data Stream from AWS RDS MariaDB to Big Query
Hi everyone,I am in the process of setting up Datastream to transfer data from AWS RDS using MariaDB engine to...
GCP remote repository GitLab closed connection during remote operation
Hello, I have an issue in dataform in connection to my gitlab repository. The release configuration in Datafor...
BigQuery external table using JSON files
I have e-commerce product data in JSON format. This data is frequently updated. I am planning to load this dat...
Accessing Dataplex entry for a bigquery table from bigquery UI
From BigQuery UI I can access dataplex lineage, data profile and quality scans but I cannot directily open the...
Join multiply tables within one dataset
Good Day Community,Recently completed my Google Analytics certification in September. Working on my capstone p...
Gmail API reply to a mail
Hi,I am using Gmail API to send a message to a recipient. I want to reply to a particular message like we do i...
Use case...when...then...end statement in stored procedure in BigQuery
Hi there,hope you can help me with this. I'm trying to use stored procedure to create flatten query and data. ...
Dataform Incremental table - Am I thinking right?
Hi,1) I have a table that is being formed through Dataform every hour (I have an Airflow DAG Calling Dataform)...
adding user_id in event parameter
Hi there, I wonder if we're able to add user_id in event parameter? It sends via GTM. However, i got "undefine...
Using AWS Appflow to pull data from Google Bigquery results in a response too large error
I've established a workflow in Appflow that relies on a connection to BigQuery. However, when I execute the wo...
exporting data from dv360 to BigQuery
iam trying to export an offline report from dv360 to BigQuery.I followed along the documentation which was pre...
Connecting data from a REST API
I am trying to figure out what is the easiest way to connect our CRM's REST API. The CRM we use in Inline Data...
Query related to inserting and updating data in BigQuery using streaming.
For a project, new records are being created in BQ and subsequently modified with relevant data. However, the ...
Sometimes, I got API request error when submit actions in Dataform
Dear GCP Community,Sometimes, I got API request error when submit actions in Dataform for example when I Creat...
Unified BigQuery/Dataform View
Hey everyone,Was wondering if there was a more streamlined way to look between BigQuery (to see all my project...
Bi Engine with BigQuery Materialized View not working
We have a BigQuery Materialized View with:allow_non_incremental_definition set to TRUE2 CTEsa window functiona...
Updating API Scripts for Looker Query API Patch
Hi,After this patch I need to update my scripts that use the Looker getQuery endpoint to support using slugs i...
BigQuery billing spike
There is a spike in BQ usage suddenly . How to reduce the spike?
Serverless Batches CMEK upcoming change
I noticed this alert on the serverless batches page:"Starting March 31, 2024, special requirements apply to us...
Dataform write truncante only a specific partition
The question is self-explanatory. I need to write with truncate disposition only a specific partition of a tab...
reservation for BQ Materialized view refresh jobs
is it possible to set a custom reservation(other than project reservation) ex: if i have a MV in project A , i...
csv to dataframe to BigQuery
Hi @ms4446 I am finding many repeated rows in BigQuery. I am reading several csvs as you see below, converting...
Urgent: UA as a Data Source Not Working
One of my clients has experienced their UA tables in Looker Studio appear with "No Data". This has happened tw...
Decompress/unzip files
I would like to decompress/unzip files in my data bucket to be able to send it to Bigquery, using Dataflow rec...
Submit Dataproc serverless job using service account
Hi Folks,I'm trying to submit to submit a Dataproc serverless job using service account (have necessary permis...
Data Transfer From Table to Table in BigQuery
Hi Community!I have a question about BigQuery data transfer. In my events dataset, there is a table for each d...
Datastream_to_bigquery dataflow template : Invalid date problem
I am using Datastream_to_bigquery dataflow template to ingest data from GCS to Bigquery. The avro files in GCS...
Google Analytics Data Export to BigQuery resulting in null Value in User ID
Hello, we have an application that uses Firebase and Google Analytics and then exports the data to BigQuery. O...
Articles from Product Experts and Googlers
BigQuery Data Preparation with AI Agents: Smarter, faster, and code-free
Ready to unlock the secrets hidden in your product data? This tutorial demonstrates how BigQuery Data Preparation can clean and transform your raw data into actionable business intelligence, using a realistic example from the Fashion and Beauty industry.
Launched: ABAP SDK v1.10 unleashing powerful AI/ML, eventing, and storage capabilities
Supercharge your SAP systems! ABAP SDK v1.10 unlocks BigQuery AI/ML, simplified event-driven integration, Cloud Storage content repositories & access to 290+ Google Cloud APIs. See what's new.
From idea to viral video: the GenAI workflow you need
What if you could create professional-quality videos with just a fraction of the effort? This blog introduces a radical new GenAI workflow on Vertex AI, using models like Gemini, Imagen3, MusicLM and Veo2 etc to make video creation accessible to everyone.
