Load 130.000 csv files to BigQuery. Limitation loading jobs

ivo
Bronze 1
Bronze 1

Hello, I have 130.000 csv files in GCS. I am uploading them via 

bigquery.Client() . But the problem is that apparently there is limitation job loading of 1.500 per table and per day. The code is uploading files one by one, so the BigQuery infer that it's a individual job. So, I can only load 1.500 files pers day. I have to finish this task very soon, Can Anyone help, I appreciate a lot !  ๐Ÿ™‚
1 1 170
1 REPLY 1