Influence Looker’s Roadmap and join the BI Customer Council (BICC)
Would you like to influence Google Cloud’s BI roadmap more? I’d like to invite you to join the Google Cloud BI...
Data Analytics
Want more from your data? Have questions about products like BigQuery, Dataflow, or Pub/Sub? You're in the right place. Join conversations around data warehouse modernization, streaming analytics, business intelligence, and more.
Focused on Looker? Engage with the Looker Community here.
Focused on Looker? Engage with the Looker Community here.
Forum Posts
[BigQuery] Regarding Conversion String to Date Type Issue
Hi there ,I have column which contains timestamp and it is String DatatypeI want cast has Date Data type Used ...
BQ pricing calculator results- Is regional storage expensive than multi-region?
From the new Google Cloud pricing calculator it seems like regional storage is more expensive than multi-regio...
Dataflow Flex Template: 'No JVM Shared Library File' Error When Using Custom Docker Image
Hi,I'm working on a Dataflow batch job to fetch data from an SQL server using the JayDeBeApi package, which re...
Dataform generally unstable lately
Hey folks-Has anyone else experienced general instability and transient errors with dataform lately? Lots of r...
Error 403 - Permission denied on 'locations' when using Workflow for Dataform
Hey I followed the steps from the schedule-executions-workflows tutorial from Google's documentation but it ...
Subject: Exploring the World of Data Analytics!
I’ve been diving deep into Data Analytics, uncovering insights from data and exploring trends, patterns, and...
Google Ads Transfer in BigQuery Does not match conversions with Google Ads Dashboard
Hi everyone, How to fix data discrepancy in conversions from Google Ads into Google Bigquery via BigQuery Data...
export/import datafusion pipeline schedule
Hello All,I am trying to export and import a datafusion pipeline which is scheduled in DEV to STAGE, however w...
Continuous Queries Roadmap
Hi @nickorlove What's the roadmap for BigQuery Continuous Queries looking like at the moment? I have a team th...
Dataform Javascript Operate Tags
I publish a few tables that require "execute immediate" so they're publish via "operations". I do this using t...
BigQuery EXPORT DATA OPTIONS TO JSON Not retaining cell values with value NULL
We are using EXPORT DATA OPTIONS to export tables to newline delimited JSON files.We are not able to export ta...
How to get execution tag in Dataform
Hello everyone,I'm just learning Dataform, and I need to log in a table the tag used to excecute the dataform ...
"Spanner change streams to Pub/sub" dataflow template hitting pub/sub max message size
Transactions in spanner are converted into a single changestream record. And it looks like https://cloud.googl...
BigQuery Slot allocation Levels
What are the different levels BigQuery Slot allocation is possible. Is it possible, like Query level, user lev...
File is being created with wrong date when using data export as a scheduled query
I have a scheduled query in Big Query, set to run daily, is meant to export the results of a SQL query that jo...
Dataform: Error using @dataform/cli when running with "--dry-run" argument
Hi there!I'm working on a Dataform project using the @dataform/cli (https://cloud.google.com/dataform/docs/use...
Can Dataform Connect to Other Databases like Snowflake or MySQL?
Hi everyone,I’m new to Dataform, and I noticed that the official documentation mainly focuses on data transfor...
Best Practice for Managing BigQuery Resources with Terraform: Dataset vs. Dataset and Tables
I’m working on managing Google BigQuery resources using Terraform and am trying to determine the best practice...
Biglake managed table for production
I am considering using big lake managed tables for production, but currently, only the preview version is avai...
Slowness in Looker Dashboard Loads
Has anyone seen the slowness in Looker reports despite implementing all the recommended optimized filter condi...
Stream Firestore to BigQuery
Hi, we have an app with Google Firebase as a Database which is No SQL, JSON-based data. Now, we have to build ...
Impact of Adding PyPi Packages on Cloud Composer Scheduler Stability and DAG Execution
Currently we are facing issues in Cloud Composer. While adding new PyPi packages in Composer, it's updating Co...
Dataform Declaration Aliases
Say you are trying to declare some data sources, but you have an ugly table name. E.g: config { type: "declara...
Can't select Edition Looker (Google Cloud core) instance.
Hi all,I can't select Edition when creating a Looker instance as the picture below. I did complete all the ste...
before and after trigger in oracle can we implement in gcp bigquery
Triggers can run BEFORE the action is taken or AFTER the action is taken.Can we implement is bigquery.
Instance template creation from Compute Engine VM
I have created a VM Instance based on the requirements and I have installed some applications on it.Is it poss...
Missing datasets in Information_schema and audit tables
Hello, I'm encountering two issues with BigQuery on GCP:1. When querying `region-eu.INFORMATION_SCHEMA.SCHEMAT...
Share Looker content with external whitelisted domain
We are attempting to share all Looker content with an external whitelisted domain. We can successfully share i...
Use cases to share tabular data via GCS instead of BigQuery?
Do you know use cases where analytical data product teams need to give access to gcs bucket objects instead of...
Passing Parameters to Dataform
Hi @ms4446 I have the following use case and shall b grateful if you can help.a) I have an Airflow DAG which I...
Articles from Product Experts and Googlers
Deeper Insights with knowledge engine & dataset-level metadata in BQ
In my previous blog From Data to Metadata: Unlocking Insights with Gen AI in BigQuery, we explored how BigQuery's “Insights” feature can automatically generate metadata for your tables and columns helping to uncover hidden patterns and trends within your data. We are now taking it a step further with metadata and insights generation at the dataset level. This new capability not only describes the dataset but also provides an interactive entity relationship map that visually reveals connections between different entities.
A developer's guide for building with Anthropic’s Claude 4 models on Vertex AI
We recently announced the general availability of two new models from the latest generation of Anthropic’s Claude model family on Vertex AI: Claude Opus 4 and Claude Sonnet 4. In this blog, we’ll guide you through building with the new Claude 4 models on Vertex AI.
Introducing DeepSeek R1 Model-as-a-service on Vertex AI Model Garden
Deploying Deepseek-R1-0528, a 671B parameters model, typically necessitates at least 8x H200 GPUs for a single API request. Such extensive resources are not accessible to everyone.To make Deepseek R1 more accessible to developers, we're excited to announce that DeepSeek R1 is now available as a fully managed API on Vertex AI in Preview.
