Get hands-on experience with 20+ free Google Cloud products and $300 in free credit for new customers.

Datastream failed to find the publication

We're having a frustrating problem with Datastream.   

  1. We set up a user in our Postgres (CloudSQL) db with all the settings as listed in the Datastream documentation
  2. We set up a publication from the database we wanted, with 7 of the tables marked for streaming
  3. We have a connection profile set up with a proxy set (that we know is working) to connect to our Postgres db
  4. We have a destination connection profile set up as well to BQ
  5. We use the connection profiles to set up the stream for the 7 tables

Some of them backfill but not all.  We are getting the "Datastream failed to find the publication" error even though the publication exists, the proxy is working (for other streams), and some of the tables are syncing.  

The Validation step is all green, no errors.

Trying to figure out what the issue might be and how to correct it.  These tables are really large with nested JSON columns (that don't exceed the nesting limit though); we really don't want to have to export to CSV from Postgres and try to load those CSVs into BQ.  (tried and failed already)

0 2 1,936
2 REPLIES 2