Influence Looker’s Roadmap and join the BI Customer Council (BICC)
Would you like to influence Google Cloud’s BI roadmap more? I’d like to invite you to join the Google Cloud BI...
Data Analytics
Want more from your data? Have questions about products like BigQuery, Dataflow, or Pub/Sub? You're in the right place. Join conversations around data warehouse modernization, streaming analytics, business intelligence, and more.
Focused on Looker? Engage with the Looker Community here.
Focused on Looker? Engage with the Looker Community here.
Forum Posts
Calculate costs for capacity Pricing model, doubt about slots data source
I'm using BigQuery Editions and running on a Capacity Pricing model (Enterprise and no commitments). So, my fo...
Autoscaling not working for Dataproc GCE cluster
I created an autoscaling policy and attached to a cluster with 2 primary worker nodes (2 core with 8gb). I ran...
Dataflow MongoDB to BigQuery template: How to overwrite BigQuery tables?
Hey, I have a question about Dataflow MongoDB to BigQuery template. I can't understand how can I overwrite the...
What is the best practice to implement row level security with Looker
Dear Support Team, I am David Isaacs working for 4WD Supacentre (Retail trade organisation). We extensively us...
Custom Expressions Error in Looker
Hi all, I was making a custom expression field in Looker, and coding the custom formula for my dataset in SQL....
Dataform Roadmap
Hi!I am interested in learning more about the active evangelists for dataform Could you provide me with inform...
Data Fusion Driver installation
Hi experts,I have a datafusion instance created with terraform and it works fie, because the system can create...
Elevated Number of ListWorkflowInvocation API Calls
Our cloud environment uses dataform for ETL/ELT purposes. I have a cloud function that accepts some arguments ...
Ensuring Sequential Delivery with Multiple Ordering Keys in Pub/Sub
I'm working on a Pub/Sub system where I need to ensure that messages are received in the exact sequence they a...
Data at Google Cloud Next '24!
Answer this question in the comments to earn a special badge: In your journey, what's one overlooked data skil...
LAB not working
https://www.cloudskillsboost.google/paths/420/course_templates/962/labs/472057Hi guys, I was recently chatting...
Dataproc job states via API not matching with gcloud CMD output and API specification
@jangemmarPer doc: "https://cloud.google.com/dataproc/docs/reference/rest/v1/projects.regions.jobs#State"0: ST...
Issue with latest version of composer 2 environment
We have recently created later version of composer 2 environment.Here the task is returning non zero exit code...
Computing Cost of a Query/Job
Hi BigQuery Community,I am looking for the correct formula to compute the cost of a job/query in $ amount. We ...
Automating data ingestion into a BQ native table
Hey all, I'm fairly new to GCP and BigQuery so please be kind. I've got data coming from an on-premise MS SQL...
Reference to Date Sharded Tables Created Using While Loop in dataform
I am working on setting up a pipeline in Dataform to create date-sharded tables that can be referenced as depe...
Data getting deleted or missing from Big Query
Hi, We have the following configuration on firebase for Big Query and according to expired data our data shoul...
Loading GeoJSON files using BigQuery - JSON parsing error in row starting at position 0: No such fie
I have a GeoJSON newline-delimited file that looks like the following: I've been trying to load it and so far ...
Dataflow: ModuleNotFoundError: No module named 'src'
Hi I'm been trying to launch a dataflow job with flex templates in python sdk. The job starts and then fails w...
BigQuery efficient data extraction
Hi! I want to read data from BigQuery table to 3'rd party application to process the data.I'm trying to unders...
nullMarker on empty string breaking change
Hello, we noticed a breaking change behavior in our ingestion systems on 24th July due to a change in nullmark...
Sensitive Data Protection (DLP) Discovery/Scan Configuration/Action/Pub Sub
Hi Experts, I am quite new with Sensitive Data Protection (DLP). While creating a scan configuration, in the A...
Third party software on GCP VM
Hi @ms4446 I shall be grateful if you can help meI have the following use case:1) I have a third party softwar...
Dataflow does not execute pipelines
Hey, I have several dataflow batch pipelines running once per day to read data from MongoDB and ingest it into...
Dataflow: Latency in 'Kafka to table in CloudSQL db' pipeline
Hi.I have a Dataflow pipeline (in Java) which reads messages from Kafka topic and writes row updates to CloudS...
Data Analyst Learning Path: 02.Introduction to Data Analytics on Google Cloud course
I have a problem finding the source:spls/gsp072/baby-names/yob2014.txt on task 4: Load data into a new table o...
Monitorix Email Notification
Hi friends, can somebody provide me some explanation about how to configure my monitorix.conf file to send da...
Executing query in Big Query is taking more time than usual
Hi, We are fetching data from Big Query using Spring Boot and till yesterday it was working fine and use to ta...
Dispersion de datos Big query / transferencia de datos google ads
Hola, quisiera hacerles una consulta sobre la transferencia de datos de google ads a big query. Originalmente ...
Does Dataform have an equivalent to Airflow's BranchPythonOperator?
I want to branch out my Dataform workflow. Say, there are 3 different sets of tasks:Set 1 = [Task_1.sqlx, Task...
Articles from Product Experts and Googlers
Introducing DeepSeek R1 Model-as-a-service on Vertex AI Model Garden
Deploying Deepseek-R1-0528, a 671B parameters model, typically necessitates at least 8x H200 GPUs for a single API request. Such extensive resources are not accessible to everyone.To make Deepseek R1 more accessible to developers, we're excited to announce that DeepSeek R1 is now available as a fully managed API on Vertex AI in Preview.
Untangle the API maze with Apigee API Hub
Mirror mirror on the wall, What do I do with my API sprawl, Where can I see them all, How to make sure they listen to my call, And to ensure their compliance doesn’t fall. API Hub is the one to rule them all!
Next-Gen Data Pipelines: Airflow 3 Arrives on Google Cloud Composer
We are thrilled to announce that Google is the first hyperscaler to provide selected customers with access to Apache Airflow 3 on our fully managed Cloud Composer 3 service. Discover how powerful new features like DAG Versioning, a modern React-based UI, and scheduler-managed backfills can help you innovate faster and more reliably.
