One of our team is testing the Export to GCS for the data archival. It is observed that the EXPORT DATA produces too many files (nearly 2000 files for 1 partition; filesize less than 1GB) in the storage bucket. But, if the EXPORT DATA statement has a LIMIT specified, the number of files created is reduced drastically. Is this working as expected? Any documentation somewhere about this LIMIT clause that reduces the number of files created?
LinkedIn
Twitter
