Get hands-on experience with 20+ free Google Cloud products and $300 in free credit for new customers.

Problem with copying from GCP bucket using gloud alpha storage

I am trying to copy a folder that contains a large file from a GCP bucket to a VM running in GCP using the gcloud utility. The VM is running Windows Server 2016 and is configured with 8 vCPUs and 32 GB of memory, along with SSD drives. The command that I am running is as follows.

gcloud alpha storage cp gs://mybucket/* D:\Data --recursive --no-clobber

The problem is the operation always fails to copy two large files after about 50% to 80% has been copied. One is about 500GB and one is about 2.7TB. The errors that are displayed are as follows.

ERROR: ('Connection broken: OSError("(10054, \'WSAECONNRESET\')")', OSError("(10054, 'WSAECONNRESET')"))
ERROR: ('Connection broken: OSError("(10054, \'WSAECONNRESET\')")', OSError("(10054, 'WSAECONNRESET')"))
ERROR: Failed to download one or more component of sliced download.

Does anyone know why the copy would fail or anything that I might do to fix it?

0 3 1,737
3 REPLIES 3

This seems to be a Windows problem. Not in Cloud Storage, but in Windows. Could you try the Hotfix mentioned here?

The hotfix you mentioned is for older servers and does not appear to apply to Widows Server 2016.

Please try 'gsutil cp' instead of 'gcloud alpha storage cp' and let me know the result.

There is a flag '-D' that can give us more information.