gsutil Upload Stuck at 99% for Large Folder Transfer to Google Cloud Storage

[herraproduction]

Hello,

I'm encountering an issue while trying to upload a large folder (around 357 GB) to my Google Cloud Storage bucket using gsutil on a Mac. I've been using the following command:

gsutil -m cp -r "/Volumes/[ExternalDrive]/[FolderName]" gs://[YourBucketName]/

The upload process progressed smoothly until it reached 99%, displaying this status:

[12.4k/12.4k files][356.8 GiB/356.8 GiB]  99% Done  14.1 MiB/s ETA 00:00:00

However, it's been stuck at this point for an extended period without completing. The network and system resources seem stable, and I haven't encountered any error messages.

Has anyone experienced a similar issue, or does anyone have insights into why the process might be hanging at the last percent? Are there additional steps I should take to troubleshoot or complete this upload?

Any advice or suggestions would be greatly appreciated! Thank you!

[SHBASI96]

try to use :

gcloud components update

Add the -o option to increase the verbosity of gsutil output. This might provide more details about what's happening during the upload.

gsutil -o 'GSUtil:verbosity=debug' -m cp -r "/Volumes/[ExternalDrive]/[FolderName]" gs://[YourBucketName]/

If the issue persists, consider breaking down your upload into smaller chunks.

You can upload sub-directories or individual files separately to identify if there's a specific part causing the problem.

 Use gsutil rsync: Instead of gsutil cp, try using gsutil rsync, which is optimized for synchronization. It may handle large uploads more efficiently.

gsutil -m rsync -r "/Volumes/[ExternalDrive]/[FolderName]" gs://[YourBucketName]/

Hope it works : )