Influence Looker’s Roadmap and join the BI Customer Council (BICC)
Would you like to influence Google Cloud’s BI roadmap more? I’d like to invite you to join the Google Cloud BI...
Data Analytics
Want more from your data? Have questions about products like BigQuery, Dataflow, or Pub/Sub? You're in the right place. Join conversations around data warehouse modernization, streaming analytics, business intelligence, and more.
Focused on Looker? Engage with the Looker Community here.
Focused on Looker? Engage with the Looker Community here.
Forum Posts
Update tab size in Dataform IDE
Is there a way to adjust the default tab size in the Dataform IDE? In the BigQuery IDE, the default tab size i...
Dataform Incremental Table Merge Error
Hello Google Community, hoping for some help here! I have a Dataform sqlx script that needs to merge. I have t...
Namespace not able to view and Connection refused error in Data Fusion Pipeline
Dear Experts,we have configured two names space in the cloud data fusion, but from yesterday onwards not able ...
I am debugging a query - Expected end of input but got keyword CROSS at [118:5]
sql_query = """CREATE TABLE `{prodid}.{datasetid}.{tableid}`PARTITION BY DATE(event_timestamp)CLUSTER BY metri...
Why does the same user_pseudo_id appear across multiple devices in BigQuery?
Hello folks,Context: In my Firebase implementation, I've noticed that the same user_pseudo_id is appearing acr...
Duplicate data in BigQuery export from GA UA 360
Hi there,I hope this is the right place to ask for help. We noticed that BigQuery GA (UA) export is not matchi...
Cant establish connection to on-prem mssql server.
Hello guys, I am trying to establish a connection to an on-prem mssql server - however I get this error in dat...
Dataflow: FirestoreIO for Python SDK
Hello people!I have documents stored in Firestore and was wondering if there is a native FirestoreIO in Apache...
Syntax error: Expected ")" but got keyword AS at [8:1]
I'm getting error again and again. Could anyone please help me with that. Any help would be much appreciated. ...
BigQuery Storage Read API is slow
Hello, I am experiencing weird behavior when fetching data from BigQuery : the performance is worse by using S...
Is it possible to use Virtual environment (venv) for BigQuery notebook?
Hi there, Is it possible to use Virtual environment (venv) for BigQuery notebook? Usually we use cli prompt to...
Loading data from Datastore exports taking time
I have a table in data store with about 15k records. It's reference data, so the same table is in A-production...
Can I run the BigQuery notebook on a Pub/Sub message or CRON?
Hi there,Is it possible to run the BigQuery notebook on a Pub/Sub message or CRON? I presume that i should be ...
API credentials storage for BigQuery notebook
Hi there,Is it possible to access APIs via BQ Notebooks? If yes, where do we store credentials - can I use GCP...
Google sheets missing authentication for big query in apps script
Hello everyone,I am currenthy having trouble with creating an apps script function that queries bigquery when ...
Cannot update incremental table maybe due to recent update on dataform
When I run the query below on Datafrom, I encounter the following error message despite using 'even_date' for ...
Error Code 7
All of a sudden starting today (2023-12-13) I cannot save Results to a BQ Table. I tried by saving from the ed...
CUD analysis report, formatted as a CSV file
Hi Team,I need "CUD analysis->[Committed use discounts analysis]->Resource based commitments" for each commitm...
SA360 DTS Migration
With the old version of the SA360 API being sunset in 2024, the original SA360 DTS connections that were set u...
How to install python packages during runtime in dataproc serverless
In Dataproc, we have metadata option to install python packages in a dataproc cluster created through Composer...
PubSub permissions error while publishing using google cloud dependencies
Hello community!We are switching from spring based pubsub dependencies to Google cloud's pubsub dependency by ...
Messed up time zones while replicating
We replicate data from MySQL to BigQuery via DataFusion.MySQL server has UTC+2 timezone while BQ has UTC by de...
Implement Bigquey query in Datafusion as no code solution approach
I have bigquery query i need to implement the query using plugins in the datafusion without any query or code....
Dataplex tag templates:cannot make tag "required"
Hi,I am editing tag templates in Dataplex but I am unable to tick the option to make the field required.I am a...
GSC exports to BQ not working since 12/08
Hi there,I wonder if somebody could help me with an issue in BQ. I have my Google Search Console exports set u...
[ABUSE] By: Modita / Board: cloud-database (2018)
This post has the wrong label - it pertains to BigQuery not Cloud BigtableLink to post: (BigQuery restore data...
Use custom merge logic for incremental table in Dataform
I'm creating an incremental table in Dataform, but want to change how duplicate rows are merged. The default b...
Upload file report error “Unable to retrieve column specifications“
Hello all, (apologies if I'm posting in the wrong place)I wanted to upload csv files to big query ,format as b...
Load to BigQuery from API Endpoint
I would like to get different ideas and approach for API to BigQuery Inserts.Users will be posting payload in ...
Articles from Product Experts and Googlers
BigQuery Data Preparation with AI Agents: Smarter, faster, and code-free
Ready to unlock the secrets hidden in your product data? This tutorial demonstrates how BigQuery Data Preparation can clean and transform your raw data into actionable business intelligence, using a realistic example from the Fashion and Beauty industry.
Launched: ABAP SDK v1.10 unleashing powerful AI/ML, eventing, and storage capabilities
Supercharge your SAP systems! ABAP SDK v1.10 unlocks BigQuery AI/ML, simplified event-driven integration, Cloud Storage content repositories & access to 290+ Google Cloud APIs. See what's new.
From idea to viral video: the GenAI workflow you need
What if you could create professional-quality videos with just a fraction of the effort? This blog introduces a radical new GenAI workflow on Vertex AI, using models like Gemini, Imagen3, MusicLM and Veo2 etc to make video creation accessible to everyone.
