Influence Looker’s Roadmap and join the BI Customer Council (BICC)
Would you like to influence Google Cloud’s BI roadmap more? I’d like to invite you to join the Google Cloud BI...
Data Analytics
Want more from your data? Have questions about products like BigQuery, Dataflow, or Pub/Sub? You're in the right place. Join conversations around data warehouse modernization, streaming analytics, business intelligence, and more.
Focused on Looker? Engage with the Looker Community here.
Focused on Looker? Engage with the Looker Community here.
Forum Posts
How to set properties for google pubsub in app?
I am trying to use google pub/sub to provide subscription service to users.I created one topic and created one...
Creating and managing schemas within google cloud pub/sub
While reviewing the google cloud pub sub schema registry: https://cloud.google.com/pubsub/docs/schemas#goIt is...
How to optimize BigQuery costs with live Q&A
Once you’re using BigQuery, you can run blazing fast queries, get real-time insights, and start using advanced...
Query about how "Non fatals" percentage is calculated
Hi, I would like to know that how "Non fatals" percentage is calculated under firebase crashylitics. Attaching...
Schedule dataform with tags
I have a set of actions within dataform that need to be run at varying frequencies throughout the day, some ho...
OBJECT_FINALIZE multiple events when file uploaded to Cloud Storage
I have a client that uploads files to Cloud Storage. I have added a Pub/Sub Notification on OBJECT_FINALIZE. W...
Make Pub/Sub emulator fail on purpose
HelloI have a Node.js app running on my local machine that publishes to a pub/sub topic. I'm currently using t...
How to find the failed Inserts from DataFlow to BigTable?
I am writing a pipeline to migrate data from GCS to Bigtable. Data is in json format. Pipeline works fine but ...
Connecting Google Sheets to Big Query
I'm trying to connect to Big Query thru Google Sheets. I want to find the pkg_loc for this list of products in...
BigQuery TimeStamp_Diff() Observation/Question
Hello,My company started using BigQuery for our data warehouse a few months ago so I'm relatively new to BigQu...
When using a CTE in GCP it has a limitation of only 100 iterations.
I am trying to run a query which has around 1000 iteration with the help of "WITH RECURSIVE" clause. But when ...
"Force" pulling a message from a subscription where the message is in exponential backoff state
Hi, I have a subscription configured with an exponential backoff strategy AND message ordering. There is a mes...
[BigQuery] InternalServerError: 500 Error encountered during execution
Hi Everybody!Our Data Team need to upload data to BigQuery from gcs with Python, and it has been successfully ...
Work on Dataform(gcp) with differents projects
As you know In every Dataform repository, there is a distinct configuration file called "dataform.json". This ...
[BigQuery] Retrieve old query from a scheduled query / Control Change on Scheduled Queries
Hi Everybody!Writing to ask a question about Scheduled Queries in BigQuery.Our Data Team had a scheduled query...
Serverless spark job throwing an error while using shared VPC to connect on-prem storage
I am trying to run simple serverless spark(dataproc batch) job which reads object from on-prem ECS with shared...
Problems Extracting the last value form a column
Hello to everyone.I´m writing because I have a problem extracting the last value of a filed.This is the error ...
Log operations "save results" in BigQuery
Good afternoon, inside the company we want to log the click of the "Save Results" button from the browser UI t...
About data analysis
Hey there!!Can you give me some information about data margin, data analysis and data patterns?
Connecting Bigquery from Java using JDBC
Hii, im trying to connect to bigquery from Java using jdbc. But im facing dependency issue. I tried to add the...
pubsub subscription randomly didn't retry
Given this subscription configurations we had 2 failed cloudfunctions handling 2 messages at the same moment w...
I've deleted a key of a service account, but I can still run query on BigQuery with that key.
Is it possible?I deleted only the key not the service account, but GCP shows error in [Service accounts] tab a...
Grant DataEditor Permissions
Hello! I am new to GCP. I already have a couple of existing projects in BigQuery. Now I have created a new pro...
Total physical bytes keeps changing randomly when transferring data from Datastore to Bigquery
Total logical bytes remain same when I replace my data present in BQ (loading from Datastore to GCS to bq). Bu...
Cannot use apache hudi on dataproc
I am trying to use Apache Hudi component on Dataproc cluster I ran the example code provided by Google, but it...
What Pub/Sub permissions do I need to create a subscription?
I have a Python 3.9 Cloud Function that is using the Cloud SDK to create Pub/Sub subscriptions. I'm having tro...
GCP Big Query New Features 🎉🎉🎉
Blog : https://cloud.google.com/blog/products/data-analytics/build-limitless-workloads-on-bigqueryNew Features...
cloud composer vs cloud workflow
Hello, GCP community i have some doubts when it comes to choosing between cloud workflows and cloud composers....
temp_location set for template at execution time but it still uses value at compile time
So I know that you can set `temp_location` at compile time e.g.```python template_name \--runner DataflowRunne...
BI Engine Billing
Why am I still being charged, what appears to be a flat fee, for BigQuery BI engine?I'm getting the charge on ...
Articles from Product Experts and Googlers
BigQuery Data Preparation with AI Agents: Smarter, faster, and code-free
Ready to unlock the secrets hidden in your product data? This tutorial demonstrates how BigQuery Data Preparation can clean and transform your raw data into actionable business intelligence, using a realistic example from the Fashion and Beauty industry.
Launched: ABAP SDK v1.10 unleashing powerful AI/ML, eventing, and storage capabilities
Supercharge your SAP systems! ABAP SDK v1.10 unlocks BigQuery AI/ML, simplified event-driven integration, Cloud Storage content repositories & access to 290+ Google Cloud APIs. See what's new.
From idea to viral video: the GenAI workflow you need
What if you could create professional-quality videos with just a fraction of the effort? This blog introduces a radical new GenAI workflow on Vertex AI, using models like Gemini, Imagen3, MusicLM and Veo2 etc to make video creation accessible to everyone.
