CSV File Compatibility Issue in Dataplex assets

[jvilchezv]

Hi team,

I have a question about dataplex with manage lakes.

Recently, I discovered that I have an incompatibility in my data lakes in Dataplex. I have deployed files in CSV format; however, I encountered the following error. Does Dataplex not support files with a CSV extension?

Thanks.

[dawnberdan]

Hi @jvilchezv,

Welcome to Google Cloud Community!

The error you’re experiencing is related to Dataplex's curated zone, which only supports data in formats such as Avro, Parquet, or ORC. Currently, CSV files aren't directly compatible with curated zones. To resolve this you can convert your CSV data to one of the supported formats or store the CSV files in a raw zone for processing at a later stage. For more details, refer to this documentation.

Was this helpful? If so, please accept this answer as “Solution”. If you need additional assistance, reply here within 2 business days and I’ll be happy to help.

[jvilchezv]

Hi @dawnberdan 

Thanks for this important information. I'll check it out.

Joel.