Get hands-on experience with 20+ free Google Cloud products and $300 in free credit for new customers.

import file (.csv) too big to import to vertex ai dataset

I have image dataset of receipts of about 12gb along with their label and bounding boxes (.json) of about 800 mb. I have uploaded the images dataset successfully to gcp bucket and created the cloud storage path in CSV. I then combined the path with the label and bounding boxes to create the input file in CSV. However, when I Uploaded the file (CSV) to gcp, I got an error that said my input file was too big to import, the limitation is 209715200 byte. My input file (CSV) is about 780 mb. How can I upload large input file to gcp?

 

0 2 1,459
2 REPLIES 2