Hi every experts,
I have a snapshops from aws rds and export it to S3.
Can I restore this snapshot on S3 to GCP cloud sql? If GCP cloud sql support this file?
Thanks in advance.
Solved! Go to Solution.
According to the documentation shared in my previously posted answer, you will need to use BigQuery, and it doesn’t seem possible to be directly using Cloud SQL.
If I understood your second question correctly, this Stack Overflow answer might help.
The Cloud Storage Transfer Service, which organizes and plans load jobs into BigQuery, can be used. For this use scenario, this migration technique is advised. Data from AWS RDS must first be loaded into CSV files before being transferred to S3. Transfers using Amazon S3 are done in two steps:
The use of AWS Data Pipeline to extract data from MySQL and feed it to BigQuery is another intriguing solution I came across.
Additionally, you can transfer the data to BigQuery using one of the ETL tools (see here) that are integrated with Amazon RDS and BigQuery.
Additionally, here is a similar question I found in Stackoverflow.
Hi JGerman23,
Thanks for you reply. My question is similar in Stackoverflow as you post. But in the discussion, it didn't have a clearly answer.
I would like to know if I have a "snapshot file" from AWS RDS and export to S3 on AWS. Can I transfer this "snapshot file" to GCP storage and then restore this snapshot file directly to GCP Cloud SQL for MySQL (not BigQuery)?
Replenish:
I check the file format in S3 which export from AWS RDS snapshot to S3 is "parquet".
Is GCP cloud sql for mysql support import from parquet file?
Thanks in advance!
According to the documentation shared in my previously posted answer, you will need to use BigQuery, and it doesn’t seem possible to be directly using Cloud SQL.
If I understood your second question correctly, this Stack Overflow answer might help.
Hi @TonyChang
Is your goal to migrate an AWS RDS database to Cloud SQL for MySQL? If yes, have you considered using the DB migration service: i.e., https://cloud.google.com/database-migration/docs/mysql/migration-src-and-dest?
Hi Kumards,
My goal is not just migrate AWS RDS database to Cloud SQL for MySQL, I want to transfer AWS RDS snapshot file to GCP continuously. I hope we can use these AWS RDS snapshot file to restore to Cloud SQL for MySQL if AWS have problem.
In brief, if AWS RDS have problem, we want these AWS RDS snapshot file can be reused on other cloud environment.
Thanks for clarifying the requirement, @TonyChang . The DB migration service provides an option to set up continuous replication.
Would the cost of that not be way more than the storage of snapshots only?