Get hands-on experience with 20+ free Google Cloud products and $300 in free credit for new customers.

Writing streaming data to BigQuery via I/O connector using a Dataflow job

I am using the `STORAGE_WRITE_API` method using BQ I/O connector to write data to BQ from a DataFlow job. I am seeing SSL connection related pipeline errors and unable to figure out the reason why it is happening. The more important question though is what happens to data in such scenarios are there any retries. From reading the documentation it appears that `STORAGE_WRITE_API` guarantees exactly once semantics does it mean data is lost?

0 5 1,210
5 REPLIES 5