Influence Looker’s Roadmap and join the BI Customer Council (BICC)
Would you like to influence Google Cloud’s BI roadmap more? I’d like to invite you to join the Google Cloud BI...
Data Analytics
Want more from your data? Have questions about products like BigQuery, Dataflow, or Pub/Sub? You're in the right place. Join conversations around data warehouse modernization, streaming analytics, business intelligence, and more.
Focused on Looker? Engage with the Looker Community here.
Focused on Looker? Engage with the Looker Community here.
Forum Posts
BigQuery Storage Write API, multiple datasets and tables, and Node.js
We're building a new data ingestion pipeline and storing data in BigQuery. This is streaming data (think like ...
No native solution SFTP to GCS? For real?
I am exploring options for copying/moving some files from SFTP to GCS, Google Cloud Storage.Does GCP for real ...
Basic checks on BigQuery tables
I have a set of CRITICAL tables in BigQuery that are getting loaded hourly by DAGS. I have been tasked to deve...
USING BigQuery and having this error
"Not found: Table hajira-450716:avocado_data.avocado_prices was not found in location US" having this error wh...
Geminin in Looker - activation Problem
hello, i have the 90 day trail version. my idear is bigquery - analytics-ki.i try since 2 days that i can acti...
Dataplex column-level lineage: Estimated release date
Hi,I'd like to know if there is an estimated release date for the column-level lineage feature in Dataplex.As ...
BigQuery Multi-statement Queries with Temporary Functions, Console preview question
When performing multistatement queries that are preceded with a temporary function, the output window repeats ...
BigQuery - query for item performance with source / medium dimension
Hi,I've been trying for quite a while to generate a query that will give results like this:Dimension: Date, It...
Try Looker Studio Pro at no cost for 30 days
Hello,I'd like to try Looker Studio Pro. On the Looker Studio page, it states that we can try Looker Studio Pr...
GCP dataform default service account unable to access secret
Hi there! I've been trying to create a custom service account for dataform. I've given it the required roles l...
Dataplex Quality Generated Query Optimization
Hi,I am using Dataplex to execute data quality controls over my data but I am concerned about its resource con...
How to Get the Total Input Record Count in a Google DataFusion Custom Transformation Plugin?
I am developing a custom transformation plugin using java for Google DataFusion, and I need to determine the t...
Is there a way to declare sources dynamically in a separate sources.js file in Dataform?
I want to read all tables from a specific dataset in BigQuery's INFORMATION_SCHEMA.TABLES and dynamically popu...
Trino on zeppelin on dataproc
Hello.I do not have the trino interpreter in Zeppelin on Dataproc.How do I enable it?I can run trino from the ...
Dataplex Attribute store tagging to Bigquery
Hi, I have create a lake where it contains a dataset with 2 tables. Next, I have create a taxonomy in Attribut...
Cloud Data Fusion Upgrade
Dear Experts,I tried to upgrade a Data Fusion instance from version 6.9.2 to 6.10.1.2 with an error returned: ...
Issue Sharing Looker Report
I am experiencing while attempting to share a Looker report with a large group of users, approximately 3,000 i...
Datastream - PostgreSQL Source and BigQuery Destination - Handling of REPLICA IDENTITY FULL
We have a self-managed PostgreSQL v10 database in which multiple tables have their replication identity set to...
Dataplex - Dataquality scan - hourly
My requirement is to run a data quality check every hour. There is an option to configure the check hourly, bu...
Airflow to Dataform call
Hi Team,I have an scenario, to call the data form workspace from airflow.I'm getting struct with assign the ri...
Dataplex Quality scan cost optimizing
Hi,I'm wondering if there's some way to configure a custom query in Dataplex's data quality scans in a cost-op...
EXECUTE IMMEDIATE ("query string")
hi everybody,I'm trying to launch the following query:DECLARE ex_table STRING;DECLARE ex_column STRING;DECLARE...
Dataflow flex template issue
I am having the issue with dataflow flext temaplete , while lauching the jobs from vertex ai kfp pipeline gett...
GSC Data Exports: BigQuery Connector vs. GSC API
Hi all & @ms4446 who likely can help here I recently compared a data export from the GSC API to the data exp...
GoogleJsonResponseException: API call to bigquery.jobs.getQueryResults failed with error: Access Den
I'm trying to get data out of bigQuery and into Google Sheet through AppScript.This works perfectly as long as...
[BigQuery] (310) Storage API Error: Error: { code: UNKNOWN, message: Stream removed } in PowerBI
I am getting this error for big projects which have large number of rows in PowerBIFailed to save modification...
Simba biquery driver not supporting different project other than billing project
Hi Folks,We are using Simba BigQuery driver for one of our integration. Based on that we have two projects one...
DataPlex DataQuality dependencies
Are there dependencies between rules in a data quality framework, such as linking one rule or dimension to ano...
Best option to implement a Data Dictionary in BigQuery
Hi Dear,I am working with BigQuery, Dataform and Dataplex Data Catalog to manage my data and metadata. I have ...
API for listing all the External Connections in a project for BigQueryI’m
Hi All,The RestAPI avaialable for listing external connections for BigQuery.https://cloud.google.com/bigquery/...
Articles from Product Experts and Googlers
A developer's guide for building with Anthropic’s Claude 4 models on Vertex AI
We recently announced the general availability of two new models from the latest generation of Anthropic’s Claude model family on Vertex AI: Claude Opus 4 and Claude Sonnet 4. In this blog, we’ll guide you through building with the new Claude 4 models on Vertex AI.
Introducing DeepSeek R1 Model-as-a-service on Vertex AI Model Garden
Deploying Deepseek-R1-0528, a 671B parameters model, typically necessitates at least 8x H200 GPUs for a single API request. Such extensive resources are not accessible to everyone.To make Deepseek R1 more accessible to developers, we're excited to announce that DeepSeek R1 is now available as a fully managed API on Vertex AI in Preview.
Untangle the API maze with Apigee API Hub
Mirror mirror on the wall, What do I do with my API sprawl, Where can I see them all, How to make sure they listen to my call, And to ensure their compliance doesn’t fall. API Hub is the one to rule them all!
