Doubt on BigQuery [Poor GUI interface]

[Kudos]

Please address the following issues:

1. How we can upload multiple files (CSV) from our PC to the dataset in one attempt, I saw there is no way to do it from GUI we can do one at a time.

2. Why we can't export a dataset from bigquery to Google cloud bucket storage directly or locally on our PC, why there is no such feature, I saw we can only do a table one by one like a stupid.

3. What is the extension of the dataset that google cloud storage uses, and can we convert group of .csv files into a dataset and directly upload it as a dataset for making queries in bigquey.

4. Can we export a dataset to local PC and then reupload it under a same project by renaming it?

Please suggest a method if it can be done anyhow by GUI or code or GC terminal or anyhow, I really tried doing it but failing it's very important, I will be thankful for suggestions for my whole life. 

[SebastianG]

Hi @Kudos ,

First of all BigQuery I don't think it was designed at all to interact with "local", the fact that you can upload and download small pieces of data that doesn't mean that it was designed for that. BigQuery IMO is exactly what it says on the think and it's a fabulous product the way it is. Generally speaking BigQuery was designed to work with really large amounts of data, uploading 2TB from a local PC would be a very lengthily and painful process.

1. I'd recommend to combine all those CSVs into one large file if they all have the same structure and upload them to GCS if that's the way you want to deal with your data and BigQuery. Second option is to write a small wrapper script and upload them individually.

Change the way you interact with BQ and send all your data automatically to GCS. From GCS to BQ the ingestion rate / speed is way way better than from local.

2. Why would you need to export a dataset to GCS or locally? What's the point in doing this? Usually you upload data to BQ, perform your queries and download the results.

3. https://cloud.google.com/bigquery/docs/loading-data bottom of the page.

4. You don't need to export a dataset and then upload it, have a look here https://cloud.google.com/bigquery/docs/copying-datasets