Influence Looker’s Roadmap and join the BI Customer Council (BICC)
Would you like to influence Google Cloud’s BI roadmap more? I’d like to invite you to join the Google Cloud BI...
Data Analytics
Want more from your data? Have questions about products like BigQuery, Dataflow, or Pub/Sub? You're in the right place. Join conversations around data warehouse modernization, streaming analytics, business intelligence, and more.
Focused on Looker? Engage with the Looker Community here.
Focused on Looker? Engage with the Looker Community here.
Forum Posts
Using a Shared Subscription with Multiple Pull Subscribers in Google Cloud Pub/Sub
Create One publisher and Two Subscriber using the same one Subscription ( Pull ). Pull the Message using the f...
Execution order of Dataform workflows with the same tag name.
Hello Community,I have the following situation in my project: More than one Dataform workflows under the same ...
Error while creating Dataflow Custom Templates
Hi Google,I have a requirement to read data from BigGuery and write data to the gcs bucket for that I created ...
SQL Spark connection in juptyerlab
Hi,I have a Dataproc cluster and using the web interface (Jupyterlab) inside the cluster, I am trying to read ...
POST API data to Big Query
I am trying to figure out what is the easiest way to connect our CRM's REST API. The CRM we use in Inline Data...
Concurrent UPDATES or INSERTS to a BQ table
Hello Community,I am building a validation process for checking whether a .csv file was successfully ingested ...
Looker Instance Went Down
We have a legacy looker instance that doesn't appear to be responding, and we don't see any information from g...
Google Analytics 4 (standard) overcome data retention period
Google Analytics 4 (standard) has only a 14-month data retention period we need to extend it quite long and ne...
Airflow DAG: Web scrapping using selenium
In my pipeline, I have a step wherein I am doing some web scrapping with selenium. That is: using selenium to ...
Pushing CDC data from pubsub to BQ
Hi All,I would like to understand what are the ways by which I can handle the CDC data present in pubsub & pus...
Are the BigQuery API calls like getting table metadata free?
I'm struggling to find information on how BigQuery API calls are charged. Is calling tables.get with STORAGE_S...
Unable to Execute Dataform Workflow due to "IAM permission denied for service account"
HelloI've been facing an issue trying to execute a workflow in Dataform. Every time I attempt to run it, I'm m...
Dataplex > Explore > Spark SQL: Script Failed in Execution
Has anyone been getting this error in Dataplex > Explore > Spark SQL?___Script failed in execution.org.apache....
Why are certain BigQuery jobs not allocated to the reservation?
I've established a reservation specifically for query jobs. However, why are certain BigQuery jobs not being a...
TABLE_STORAGE_TIMELINE view details
Hey, We can't find any information about this view (TABLE_STORAGE_TIMELINE), anyone can give us some more deta...
I can't see the whole exported rows from BigQuery to the Google Sheets, I have almost 12k rows ?
I can't see the whole exported rows from BigQuery to the Google Sheets, I have almost 12k rows .I only see 31 ...
Dataform and BI Engine
It seems that queries run from Dataform are not able to utilize the BI Engine.Is there a way to use the BI Eng...
Physical billing related: Time Travel bytes question
I'm analyzing my BQ project to see if switching to Physical Bytes Pricing model will be beneficial and I ran t...
Dataform Development
Hi All,I am trying to set up my teams' infrastructure in BQ and currently, we are looking to have 2 projects 1...
dataform: Add assertions as dependencies
Hi Experts, I am following Add assertions as dependencies. I have created A.sqlx: config { type: "table", asse...
Streaming changes from BigQuery?
Does BigQuery have a change-data-capture equivalent such that we can stream changes that are happening to tabl...
creating latest snapshot from cdc data of a source data table
Scenario: We stage Change Data Capture (CDC) data in an Operational Data Store (ODS) layer table. This table i...
Hire data analyst freelance
I am looking for Data Analyst Freelancer. Any best place to hire..any recommendation?
Big Query can't connect to Cloud SQL
Please helpInvalid table-valued function EXTERNAL_QUERY Failed to connect to MySQL database. Error: MysqlError...
Dataform: generic::invalid_argument: The remote repository closed connection during remote operation
Hello,I've scheduled Dataform actions using workflow configurations, however I'm getting the following error i...
How to properly delete data from incremental table
Hi, I have a dataform incremental table where I would need to delete the past 3 days of data from the table. H...
DATAFORM - Load a table with data from CSV files using Dataform
Hi,Following this conversation, I decided to put my case as a new message here. My goal is to load a table wit...
Dataform - Documentation Generation
Hi, Does any know how we can generate documentation i.e. our model's documentation? Like in DBT, we can genera...
HttpStatusCode is Forbidden. User does not have sufficient permissions for this profile.
So I am trying to send API requests from a C# application to Analytics so I can track user's using my applicat...
Using GCP Artifact Registry for Dataform Private Packages
Hello,Can we use GCP Artifact registry for Dataform private packages.
Articles from Product Experts and Googlers
BigQuery Data Preparation with AI Agents: Smarter, faster, and code-free
Ready to unlock the secrets hidden in your product data? This tutorial demonstrates how BigQuery Data Preparation can clean and transform your raw data into actionable business intelligence, using a realistic example from the Fashion and Beauty industry.
Launched: ABAP SDK v1.10 unleashing powerful AI/ML, eventing, and storage capabilities
Supercharge your SAP systems! ABAP SDK v1.10 unlocks BigQuery AI/ML, simplified event-driven integration, Cloud Storage content repositories & access to 290+ Google Cloud APIs. See what's new.
From idea to viral video: the GenAI workflow you need
What if you could create professional-quality videos with just a fraction of the effort? This blog introduces a radical new GenAI workflow on Vertex AI, using models like Gemini, Imagen3, MusicLM and Veo2 etc to make video creation accessible to everyone.
