Issue with non-Eng character like 'â' changed to '/342' (migrated data from SQL Server to Postgres)

[DharmendraMohap]

We have recently migrated data from an MS SQL server to PostgreSQL GCP. One of the tables has compressed data. While migrating, we decompressed it using a decompress function and migrated. Now, in PostgreSQL, when trying to decompress, it gives a result but some non-English characters and changes to a different form. How to fix the issue? Need support.

[jaia]

Hello,

Thank you for contacting Google Cloud Community!

Please do the following:

1. Investigate the compression format used in MS SQL Server (e.g., gzip, bzip2, proprietary format). This information might be available in the database schema or from the source system documentation.
2. Once you know the compression format, explore libraries or tools compatible with PostgreSQL that can handle it correctly. For example, PostgreSQL supports decompressing gzip-compressed data with the gunzip function. Use the appropriate function for your specific format.
3. Check the character encoding used in MS SQL Server for the compressed data. You can find this information from the source database or through queries.
4. Ensure that your PostgreSQL database or the tool you're using for decompression is configured to use the same character encoding. Tools like iconv or pg_dump might be helpful for encoding conversion.
5. Consider re-migrating the data if the issue persists. During re-migration, ensure you use the correct decompression library and verify character encoding consistency.

If the problem still occurs , please contact : GCP support 

Regards,
Jai Ade

[jaia]

Hello,

Thank you for your engagement regarding this issue. We haven’t heard back from you regarding this issue for sometime now. Hence, I'm going to close this issue which will no longer be monitored. However, if you have any new issues, Please don’t hesitate to create a new issue. We will be happy to assist you on the same.

Regards,
Jai Ade