Get hands-on experience with 20+ free Google Cloud products and $300 in free credit for new customers.

Datastream doesn't correctly replicate JSONB fields from Postgres to BigQuery

We're replicating multiple tables from Postgres to BigQuery using Datastream. We use quite a lot of JSONB fields. Some of the JSONB fields are replicated as null, whereas they are not null in the Postgres database, and they've never been null. Backfilling seems to resolve the issue for most rows, but not always. It's seemingly random.

I think this is a Datastream bug. What information would I need to provide to investigate this issue?

The docs mention JSONB fields can't contain more than 2950 nested objects, but our fields are very small, so that's not the case.

Solved Solved
2 5 778
1 ACCEPTED SOLUTION

5 REPLIES 5