Data Stream incompatible with Postgres 16

[g_mendes_gain]

I've been using DataStream for almost 1 year now without a problem.

I have a CloudSQL instance running a postgres database (version 15 so far) with private IP address and use a bastion VM to tunnel the connection from DataStream to Postgres.

Yesterday we upgraded the database to Postgres 16 and the Datastream connection profile to CloudSQL started failing.

I managed to connect to the bastion VM tunnel from my machine and it is working fine.

I tried different approaches, such as creating a Private Connectivity on the VPC for DataStream and point directly to the CloudSQL database, adding a firewall rule to allow traffic from the Private Connectivity IP range on ports 80 and 5432, but it also failed.

Followed this documentation: https://cloud.google.com/datastream/docs/create-a-private-connectivity-configuration

I believe the DataStream is incompatible with Postgres 16.

Is there anything I am missing?

[ms4446]

Datastream supports PostgreSQL versions 10 and greater. Given this, the issue you are facing with your PostgreSQL 16 instance may stem from configuration rather than compatibility.

First, ensure your connection profile for Cloud SQL is correctly configured for PostgreSQL 16. After an upgrade, minor configuration adjustments might be necessary. It’s crucial to update the Datastream configuration to reflect any changes from the PostgreSQL upgrade. This includes rechecking private connectivity settings, user permissions, and firewall rules.

Double-check the private connectivity configuration to ensure it accurately points to the PostgreSQL 16 instance. Verify that all required IP ranges and firewall rules are correctly set up, allowing traffic from Datastream's IP range on port 5432. Reviewing detailed error logs from Datastream can provide insights into specific issues causing the connection failure.

Additionally, test the connection independently by connecting to the PostgreSQL 16 instance from another client within the same VPC. This can help determine if the issue is with Datastream or a broader networking problem. Verify that there are no new settings or extensions in PostgreSQL 16 causing compatibility issues. Ensure the database user Datastream employs has the necessary permissions to access and replicate data.

If these steps do not resolve the issue, consider temporarily downgrading to PostgreSQL 15. This can be a temporary measure while you seek a more permanent solution. For persistent issues, contacting Google Cloud Support with detailed error logs and configuration settings is recommended. They can offer specific guidance and troubleshooting tailored to your setup.