Get hands-on experience with 20+ free Google Cloud products and $300 in free credit for new customers.

gsutil cp -r crasing after 30 seconds

I'm trying to copy all contents of a Wordprss upload install to a Cloud Bucket using SSH. After executing the command, the files begin to transfer as expected for about 30 seconds, and then the session crashes.  I've tried multiple times with the same result.

Any advice on how to resolve or better transfer 4GB of data to another storage solution would be appreciated. FYI,  I only have ~500MB of free space, therefore, archiving the files first is not an option. 

gsutil cp -r /var/www/vhosts/scswraps.com/httpdocs/wp-content/uploads/ gs://scs_bucket

Screen Shot 2022-09-16 at 11.12.48 AM.png

Screen Shot 2022-09-16 at 11.06.15 AM.png

 

0 1 305
1 REPLY 1

What upload request are you using? 

When choosing whether to use a single-request upload instead of a resumable upload or XML API multipart upload, consider the amount of time that you're willing to lose should a network failure occur and you need to restart the upload from the beginning. For faster connections, your cutoff size can typically be larger.

For example, say you're willing to tolerate 30 seconds of lost time:

  • If you upload from a local system with an average upload speed of 8 Mbps, you can use single-request uploads for files as large as 30 MB.
  • If you upload from an in-region service that averages 500 Mbps for its upload speed, the cutoff size for files is almost 2 GB.