Announcements
This site is in read only until July 22 as we migrate to a new platform; refer to this community post for more details.
Get hands-on experience with 20+ free Google Cloud products and $300 in free credit for new customers.

How to load local csv to cloud sql and create pipeline to connect it to bigquery ?

Loading local csv to Cloud sql and creating batch data pipeline and connect it to BIgquery for further analytics

0 1 427
1 REPLY 1

comaro
Former Googler

You can follow this guide for exporting a .CSV file to a Cloud SQL instance. Please note, this is only available for MySQL and PostgreSQL engines for Cloud SQL.

When running the Google Cloud Console, local files can be accessed through the "Launch Code Editor" in the top right. There, you will see a file explorer to which you can upload files.

This will be your "local" directory from where the `LOAD DATA LOCAL INFILE` pulls from.

Additionally, Cloud Data Fusion is a fully managed data integration service for building and managing data pipelines through a graphical interface.

Here is a guide on how to connect a Cloud SQL MySQL instance to Cloud Data Fusion.

Data must be written to a sink. Cloud Data Fusion contains various sinks, such as BigQuery.