Influence Looker’s Roadmap and join the BI Customer Council (BICC)
Would you like to influence Google Cloud’s BI roadmap more? I’d like to invite you to join the Google Cloud BI...
Data Analytics
Want more from your data? Have questions about products like BigQuery, Dataflow, or Pub/Sub? You're in the right place. Join conversations around data warehouse modernization, streaming analytics, business intelligence, and more.
Focused on Looker? Engage with the Looker Community here.
Focused on Looker? Engage with the Looker Community here.
Forum Posts
Column Parameter to Dataform Assertion
Hi, Is it possible create a custom assertion passing column and list of accepted values as parameter to check ...
which service to choose : hive metastore on cloud sql or on metastore service
Hi When we are using a dataproc cluster that needs a hive metastore,what benefits we have using the metastsore...
about table data in BI engine update
Hi,May i ask, If I reserve a BI engine and set a table, but the bigquery table data will be updated daily, and...
SQL error
SELECT customer.customer_id, customer.first_name, customer.last_name, SUM(invoice.total) as totalFROM `Music_d...
BigQuery Quota Limit understanding
Hi,I'm using bigquery, interactive queries (not scheduled or nor API) to perform task that requires too many l...
Looking for BQ compatible metadata table corresponding to Netezza metadata
Hi Folks,We are in the process of migrating our customer from Netezza to BigQuery. In this phase, we are refac...
Getting a GCP BAA without a Google Workspace account
One of my clients is in Healthcare and just set up their GA4 export to BigQuery. We went forward with this bec...
Dataform - Incremental Update (MERGE), But Delete When Not Matched By Source
Hi,I'm working with Dataform and seeking advice on handling a specific case. In my current setup, I'm using Da...
BigQuery Storage API Billing Breakdown
Hello! Is there any way to breakdown BigQuery Storage API costs further than SKU.description? Got quite big am...
Dataform incremental tables
I think I am surely doing something wrong here. I shall be grateful if someone can guide me.Please see this ps...
BQ Sandbox limit table - historic data
I have the bigquery sandbox here at the company and the table is only valid for 60 days. If I upgrade to a pai...
Dataform optimisation
I have this query in Dataform which I am trying to optimise. I cannot find a way to do it. Any help will be ap...
Dataproc Metastore couldn't start
I got an issue happened since 3h30 UTC with Dataproc MetastoreAs I look into Logs Explorer, it happened after ...
BigQuery table restoration usecases
Hi Folks,How can we perform the following restoration in BigQuery?Need to be able to restore any tables back i...
CCAI insights Export
I want to export CCAI Insight data to Big query to have the transcript data for conversation. HOW can i procee...
BigQuery Storage Cost didn't match with Billing Report
Hi! I'm trying to get storage cost in BQ with following query: with data as ( select sum(billable_active_logic...
Bigquery load from GCS using python client API sleeping...
While performing a GCS (parquet) load to BQ using the python SDK I get a debug message that seems to be backin...
BigQuery compatibility with Netezza hash function for values with special character ¶
Hi Team,I'm trying to convert NZ functions to BQ compatibility and Im facing some discrepancy when dealing wit...
Schedule Job from cloud storage to big query
Hi, may I know how and what are the steps to schedule a job that will do merging of datasets from cloud storag...
trigger spark job from Airflow bitnami on compute engine
HiI have successfuly deployed a job in airflow from google cloud composer.I'm trying now to do the same by pro...
data bias
I am working on data analytics guided project. I have completed working on ask phase and currently working on ...
BigQuery Materialized View
Hi there, I am exploring on BigQuery Materialized view. anyone knows if Materialized view supporting Primary/F...
Data Fusion add one table
Hello, I've encountered an issue in Data Fusion where in the Replication task, it's not possible to add a new ...
Timezone in BigQuery
I've encountered an issue where some of my datetime fields are stored in the UTC+2 timezone, while others are ...
Data Profiling using DataPlex
Is there a way that I can add custom statistics to my Data profile scan according to my own needs? Or is there...
4XX errors while loading Google scripts through server-side tagging
So I set up server-side tagging with App Engine (Google Cloud Platform).I came across this article "Load Googl...
Storage Write API ValueError generator already executing
I'm writing to a Bigquery table as shown here. try: insert_rows_write_api(dataset_id, HISTORY_WRITE_API_TABLE_...
Capturing and extracting code from BigQuery Lineage using Lineage REST API
I'm successfully automatically capturing lineage from BigQuery and I'm able to see the SQL code in the lineage...
blob_list not listing current directory.
Hi,I have a scenario, tried multiple options but it is not working.Suppose I have a directory/files,Source:gs:...
Querying INFORMATION_SCHEMA.TABLE_STORAGE in BigQuery gives an access denied error
I'm trying to query the TABLE_STORAGE view in my BigQuery project to get storage information about my tables. ...
Articles from Product Experts and Googlers
A developer's guide for building with Anthropic’s Claude 4 models on Vertex AI
We recently announced the general availability of two new models from the latest generation of Anthropic’s Claude model family on Vertex AI: Claude Opus 4 and Claude Sonnet 4. In this blog, we’ll guide you through building with the new Claude 4 models on Vertex AI.
Introducing DeepSeek R1 Model-as-a-service on Vertex AI Model Garden
Deploying Deepseek-R1-0528, a 671B parameters model, typically necessitates at least 8x H200 GPUs for a single API request. Such extensive resources are not accessible to everyone.To make Deepseek R1 more accessible to developers, we're excited to announce that DeepSeek R1 is now available as a fully managed API on Vertex AI in Preview.
Untangle the API maze with Apigee API Hub
Mirror mirror on the wall, What do I do with my API sprawl, Where can I see them all, How to make sure they listen to my call, And to ensure their compliance doesn’t fall. API Hub is the one to rule them all!
