Looker Studio Failed to fetch data from the underlying data set. (data comes from BQ)

[fcortes]

source of data:

the original data that I have problems with resides on my google drive, in the form of .csv file, it then gets uploaded to bigquery using the add > google drive

size:

the size of .csv file is over 107mb, this is why I can´t upload the csv directly to  looker studio, plus it's easier for me to get the csv data combined with other sources while working with it in BQ, which I can do without any issues.

what I can do:

In BQ: I can work with the data in BQ as usual, I can merged/combined the data in the .csv with other sources/tables through a BQ queries

in Looker Studio: I can add the datset as a custom Query from BQ. I get no errors when getting the data in using the BQ connector

where the problem appears:

Once I get a chart or any other data element in looker studio, I get an error that says that Looker Studio Failed to fetch data from the underlying data set

What I have tried:
1. since the error is common I went through this guide https://www.databloo.com/blog/looker-studio-cannot-connect-to-your-dataset/

2. I tried to explore the data (.csv file in question by itself) with looker studio starting from BQ, which starts a new looker studio file and that works, but I can´t reuse the source in any other looker studio file. now if I try to explore with looker studio the query in which I have 3 datasets combined (including the problem .csv) BQ does not give me the option to explore the data with looker studio. (option appears greyed out)

Current work around:
I loaded the problem .csv file to BQ and got a subset of the data in it exported to a google sheet (the original problem .csv has 2.5M rows, the subset I exported to google sheets has 20K), then I re-add the google sheet data with the subset to BQ so I can use the subset data to combine it in BQ with the other 2 sources I used in my query, then I can connect that Query to looker studio with no issues.

I just want to understand why looker can´t connect to the dataset if I use the csv loaded from google drive to bq but it has no issues if I'm using a google sheet instead. please note that the csv, the google drive and permissions to access BQ they are all under my google account so I doubt this is a permissions issue.

[ArkadyZagdan]

@fcortes 
My hunch is its about using Custom Query.

If you really need Custom SQL for some dynamic filtering then first materialize this as materialized view :
Create or replace Materialized View.

If you do not need Custom SQL just create a schheduled query and save to Table.

Just Use select * andn run on schedule. This should solve the issue.

https://cloud.google.com/bigquery/docs/scheduling-queries

Hope it Helps

Arkady Zagdan

[fcortesjp]

I don´t have permissions to create materilize views or scheduling- queries, nor I know what permission I would need to create those and if I were to request those it would take forever if they were to be given by our company cloud admins

One of our admins though did provided a feasible solution: I uploaded the data to a GC storage bucket and then I added that table as native to BQ... that resolved the access problem I was getting in Looker Studio.