Get hands-on experience with 20+ free Google Cloud products and $300 in free credit for new customers.

Unable to download the whole content of a Google Cloud Bucket from Google Workspace Takeout

Hi everyone,

A total Google Cloud newbie here, even though I'm on the geeky linux side.

So here's what I'm trying to do for two week now :

  1. I had a Google Takeout export started in Google Workspace Admin
  2. Everything went fine and I received a Google Cloud Bucket link to download the data
  3. The data is 1.2TB and I want to download it locally for a local backup measure
  4. When I realized that I only can download each zip one by one, I search for an automated solution on the internet
  5. I stumbled upon google-cloud-cli for linux from Google Workspace Admin Help - Export all your organization's data
  6. I installed gcloud from the snap package on my machine running Ubuntu 22.04
  7. I ran 

 

 

 

gcloud storage cp --continue-on-error --recursive "gs://takeout-export-*****-*****-*****" .

 

As outlined in the Google Workspace Admin Help page.

 

Everything seemed to went fine at first, but after 550 gb of data, I keep up having errors that prevent it from completing, even though I have the --continue-on-error flag activated... I also activated few log option for verbose.

 

gcloud storage cp --continue-on-error --recursive --log-http --verbosity=debug   "gs://takeout-export-***-***-***"   /DESTINATION

 

I think it is related to a post that was never answered :

gsutil download of takeout bucket to local PC stalls 

So I'm trying the rsync command instead of cp. I don't have a very fast internet connection (60Mbps) and need to download 1.2Tbytes of data so I expect to see the results of rsync VS cp in a day or two...

Here is some of the log I get:

 

== body start ==

== body end ==
==== request end ====
⠼DEBUG: https://storage.googleapis.com:443 "GET /download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288db25/o/20250218T172148Z%2FResource:%20-339802026859650876%2Ftakeout-20250218T172150Z-004.zip?generation=1739899871337449&alt=media HTTP/11" 401 176
DEBUG: Skipping response_handler as response is invalid.
---- response start ----
status: 401
-- headers start --
Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
Cache-Control: private, max-age=0
Content-Length: 176
Content-Type: text/html; charset=UTF-8
Date: Wed, 05 Mar 2025 08:42:16 GMT
Expires: Wed, 05 Mar 2025 08:42:16 GMT
Server: UploadServer
Vary: Origin, X-Origin
WWW-Authenticate: Bearer realm="https://accounts.google.com/"
X-GUploader-UploadID: AHMx-iGK7ApM_LyvwEo4hjymeRhV17xA2vd63mWWCeC01NVjId8PvpxRZIZDY8H1ONW35ZyB
-- headers end --
-- body start --
<streaming body>
-- body end --
total round trip time (request+response): 0.057 secs
---- response end ----
----------------------
DEBUG: Retrying download from byte 1008497930 after exception: <class 'apitools.base.py.exceptions.TransferRetryError'>. Trace: <traceback object at 0x7bea7b009900>
Traceback (most recent call last):
File "/snap/google-cloud-cli/311/platform/bundledpythonunix/lib/python3.12/multiprocessing/queues.py", line 264, in _feed
obj = _ForkingPickler.dumps(obj)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/snap/google-cloud-cli/311/platform/bundledpythonunix/lib/python3.12/multiprocessing/reduction.py", line 51, in dumps
cls(buf, protocol).dump(obj)
TypeError: cannot pickle 'traceback' object
⠏=======================279.2GiB | 3.0MiB/s
==== request start ====
uri: https://storage.googleapis.com/download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288...
method: GET
== headers start ==
b'content-length': b'0'
b'range': b'bytes=1073687787-1288424783'
b'user-agent': b'google-cloud-sdk gcloud/512.0.0 command/gcloud.storage.cp invocation-id/0afba3139ca14d2298f918df7890a412 environment/None environment-version/None client-os/LINUX client-os-ver/6.8.0 client-pltf-arch/x86_64 interactive/False from-script/False python/3.12.8 term/xterm-256color (Linux 6.8.0-52-generic)'
== headers end ==
== body start ==

== body end ==
==== request end ====
DEBUG: https://storage.googleapis.com:443 "GET /download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288db25/o/20250218T172148Z%2FResource:%201867897127803802125%2Ftakeout-20250218T172150Z-263.zip?generation=1739901296033613&alt=media HTTP/11" 401 176
DEBUG: Skipping response_handler as response is invalid.
---- response start ----
status: 401
-- headers start --
Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
Cache-Control: private, max-age=0
Content-Length: 176
Content-Type: text/html; charset=UTF-8
Date: Wed, 05 Mar 2025 08:42:16 GMT
Expires: Wed, 05 Mar 2025 08:42:16 GMT
Server: UploadServer
Vary: Origin, X-Origin
WWW-Authenticate: Bearer realm="https://accounts.google.com/"
X-GUploader-UploadID: AHMx-iHS8KLZJ1mk-HMm1EZ8pm1k2lzng6k5LudmUEdlHX1194-5RmyV9Q7Y-1ADnKYggush
-- headers end --
-- body start --
<streaming body>
-- body end --
total round trip time (request+response): 0.107 secs
---- response end ----
----------------------
DEBUG: Retrying download from byte 1073687787 after exception: <class 'apitools.base.py.exceptions.TransferRetryError'>. Trace: <traceback object at 0x7bea7ad15e00>
⠧=======================279.2GiB | 3.0MiB/s
==== request start ====
uri: https://storage.googleapis.com/download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288...
method: GET
== headers start ==
b'content-length': b'0'
b'range': b'bytes=1411897102-1613596687'
b'user-agent': b'google-cloud-sdk gcloud/512.0.0 command/gcloud.storage.cp invocation-id/0afba3139ca14d2298f918df7890a412 environment/None environment-version/None client-os/LINUX client-os-ver/6.8.0 client-pltf-arch/x86_64 interactive/False from-script/False python/3.12.8 term/xterm-256color (Linux 6.8.0-52-generic)'
== headers end ==
== body start ==

== body end ==
==== request end ====
⠏DEBUG: https://storage.googleapis.com:443 "GET /download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288db25/o/20250218T172148Z%2FResource:%20-339802026859650876%2Ftakeout-20250218T172150Z-004.zip?generation=1739899871337449&alt=media HTTP/11" 401 176
DEBUG: Skipping response_handler as response is invalid.
---- response start ----
status: 401
-- headers start --
Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
Cache-Control: private, max-age=0
Content-Length: 176
Content-Type: text/html; charset=UTF-8
Date: Wed, 05 Mar 2025 08:42:25 GMT
Expires: Wed, 05 Mar 2025 08:42:25 GMT
Server: UploadServer
Vary: Origin, X-Origin
WWW-Authenticate: Bearer realm="https://accounts.google.com/"
X-GUploader-UploadID: AHMx-iF7_Km2AUfVG7pTkDaHNF6-MkgMiGGFQ7FcQN5NlA5AFQ18sCIh58gYejzJSCdjCvxC
-- headers end --
-- body start --
<streaming body>
-- body end --
total round trip time (request+response): 0.054 secs
---- response end ----
----------------------
DEBUG: Retrying download from byte 1411897102 after exception: <class 'apitools.base.py.exceptions.TransferRetryError'>. Trace: <traceback object at 0x7bea7ace5a40>
Traceback (most recent call last):
File "/snap/google-cloud-cli/311/platform/bundledpythonunix/lib/python3.12/multiprocessing/queues.py", line 264, in _feed
obj = _ForkingPickler.dumps(obj)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/snap/google-cloud-cli/311/platform/bundledpythonunix/lib/python3.12/multiprocessing/reduction.py", line 51, in dumps
cls(buf, protocol).dump(obj)
TypeError: cannot pickle 'traceback' object
⠼=======================279.2GiB | 3.0MiB/s
==== request start ====
uri: https://storage.googleapis.com/download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288...
method: GET
== headers start ==
b'content-length': b'0'
b'range': b'bytes=806798344-1008497929'
b'user-agent': b'google-cloud-sdk gcloud/512.0.0 command/gcloud.storage.cp invocation-id/0afba3139ca14d2298f918df7890a412 environment/None environment-version/None client-os/LINUX client-os-ver/6.8.0 client-pltf-arch/x86_64 interactive/False from-script/False python/3.12.8 term/xterm-256color (Linux 6.8.0-52-generic)'
== headers end ==
== body start ==

== body end ==
==== request end ====
DEBUG: https://storage.googleapis.com:443 "GET /download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288db25/o/20250218T172148Z%2FResource:%20-339802026859650876%2Ftakeout-20250218T172150Z-004.zip?generation=1739899871337449&alt=media HTTP/11" 401 176
DEBUG: Skipping response_handler as response is invalid.
---- response start ----
status: 401
-- headers start --
Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
Cache-Control: private, max-age=0
Content-Length: 176
Content-Type: text/html; charset=UTF-8
Date: Wed, 05 Mar 2025 08:42:28 GMT
Expires: Wed, 05 Mar 2025 08:42:28 GMT
Server: UploadServer
Vary: Origin, X-Origin
WWW-Authenticate: Bearer realm="https://accounts.google.com/"
X-GUploader-UploadID: AHMx-iFbElWWxaINIPYaj0sslUNVJAPsVMrHuZOlyEYxxS39wzzb8pY1UYPoW6Oi2VWMmZYs
-- headers end --
-- body start --
<streaming body>
-- body end --
total round trip time (request+response): 0.057 secs
---- response end ----
----------------------
DEBUG: Retrying download from byte 806798344 after exception: <class 'apitools.base.py.exceptions.TransferRetryError'>. Trace: <traceback object at 0x7bea7ad04580>
Traceback (most recent call last):
File "/snap/google-cloud-cli/311/platform/bundledpythonunix/lib/python3.12/multiprocessing/queues.py", line 264, in _feed
obj = _ForkingPickler.dumps(obj)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/snap/google-cloud-cli/311/platform/bundledpythonunix/lib/python3.12/multiprocessing/reduction.py", line 51, in dumps
cls(buf, protocol).dump(obj)
TypeError: cannot pickle 'traceback' object
⠹=======================279.2GiB | 3.0MiB/s
==== request start ====
uri: https://storage.googleapis.com/download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288...
method: GET
== headers start ==
b'content-length': b'0'
b'range': b'bytes=605098758-806798343'
b'user-agent': b'google-cloud-sdk gcloud/512.0.0 command/gcloud.storage.cp invocation-id/0afba3139ca14d2298f918df7890a412 environment/None environment-version/None client-os/LINUX client-os-ver/6.8.0 client-pltf-arch/x86_64 interactive/False from-script/False python/3.12.8 term/xterm-256color (Linux 6.8.0-52-generic)'
== headers end ==
== body start ==

== body end ==
==== request end ====
DEBUG: https://storage.googleapis.com:443 "GET /download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288db25/o/20250218T172148Z%2FResource:%20-339802026859650876%2Ftakeout-20250218T172150Z-004.zip?generation=1739899871337449&alt=media HTTP/11" 401 176
DEBUG: Skipping response_handler as response is invalid.
---- response start ----
status: 401
-- headers start --
Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
Cache-Control: private, max-age=0
Content-Length: 176
Content-Type: text/html; charset=UTF-8
Date: Wed, 05 Mar 2025 08:42:32 GMT
Expires: Wed, 05 Mar 2025 08:42:32 GMT
Server: UploadServer
Vary: Origin, X-Origin
WWW-Authenticate: Bearer realm="https://accounts.google.com/"
X-GUploader-UploadID: AHMx-iE86OOntWiFDwiRo5lZeg4GKDErChlURh597ACL5XoGZH72KomMATiuU6tlWQ_7LFoq
-- headers end --
-- body start --
<streaming body>
-- body end --
total round trip time (request+response): 0.152 secs
---- response end ----
----------------------
DEBUG: Retrying download from byte 605098758 after exception: <class 'apitools.base.py.exceptions.TransferRetryError'>. Trace: <traceback object at 0x7bea7ad08980>
Traceback (most recent call last):
File "/snap/google-cloud-cli/311/platform/bundledpythonunix/lib/python3.12/multiprocessing/queues.py", line 264, in _feed
obj = _ForkingPickler.dumps(obj)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/snap/google-cloud-cli/311/platform/bundledpythonunix/lib/python3.12/multiprocessing/reduction.py", line 51, in dumps
cls(buf, protocol).dump(obj)
TypeError: cannot pickle 'traceback' object
⠧=======================279.2GiB | 3.0MiB/s
==== request start ====
uri: https://storage.googleapis.com/download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288...
method: GET
== headers start ==
b'content-length': b'0'
b'range': b'bytes=201699586-403399171'
b'user-agent': b'google-cloud-sdk gcloud/512.0.0 command/gcloud.storage.cp invocation-id/0afba3139ca14d2298f918df7890a412 environment/None environment-version/None client-os/LINUX client-os-ver/6.8.0 client-pltf-arch/x86_64 interactive/False from-script/False python/3.12.8 term/xterm-256color (Linux 6.8.0-52-generic)'
== headers end ==
== body start ==

== body end ==
==== request end ====
⠏DEBUG: https://storage.googleapis.com:443 "GET /download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288db25/o/20250218T172148Z%2FResource:%20-339802026859650876%2Ftakeout-20250218T172150Z-004.zip?generation=1739899871337449&alt=media HTTP/11" 401 176
DEBUG: Skipping response_handler as response is invalid.
---- response start ----
status: 401
-- headers start --
Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
Cache-Control: private, max-age=0
Content-Length: 176
Content-Type: text/html; charset=UTF-8
Date: Wed, 05 Mar 2025 08:42:33 GMT
Expires: Wed, 05 Mar 2025 08:42:33 GMT
Server: UploadServer
Vary: Origin, X-Origin
WWW-Authenticate: Bearer realm="https://accounts.google.com/"
X-GUploader-UploadID: AHMx-iH4bvkBSUDTx3Fx0sbVAFVbOgnHOQVY04KHeYmFeMRt-ROTb24X6hpji8MoJhwyDSAQ
-- headers end --
-- body start --
<streaming body>
-- body end --
total round trip time (request+response): 0.062 secs
---- response end ----
----------------------
DEBUG: Retrying download from byte 201699586 after exception: <class 'apitools.base.py.exceptions.TransferRetryError'>. Trace: <traceback object at 0x7bea7ad16300>
Traceback (most recent call last):
File "/snap/google-cloud-cli/311/platform/bundledpythonunix/lib/python3.12/multiprocessing/queues.py", line 264, in _feed
obj = _ForkingPickler.dumps(obj)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/snap/google-cloud-cli/311/platform/bundledpythonunix/lib/python3.12/multiprocessing/reduction.py", line 51, in dumps
cls(buf, protocol).dump(obj)
TypeError: cannot pickle 'traceback' object
⠶=======================279.2GiB | 3.0MiB/s
==== request start ====
uri: https://storage.googleapis.com/download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288...
method: GET
== headers start ==
b'content-length': b'0'
b'range': b'bytes=644212845-858949855'
b'user-agent': b'google-cloud-sdk gcloud/512.0.0 command/gcloud.storage.cp invocation-id/0afba3139ca14d2298f918df7890a412 environment/None environment-version/None client-os/LINUX client-os-ver/6.8.0 client-pltf-arch/x86_64 interactive/False from-script/False python/3.12.8 term/xterm-256color (Linux 6.8.0-52-generic)'
== headers end ==
== body start ==

== body end ==
==== request end ====
DEBUG: https://storage.googleapis.com:443 "GET /download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288db25/o/20250218T172148Z%2FResource:%201867897127803802125%2Ftakeout-20250218T172150Z-263.zip?generation=1739901296033613&alt=media HTTP/11" 401 176
DEBUG: Skipping response_handler as response is invalid.
---- response start ----
status: 401
-- headers start --
Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
Cache-Control: private, max-age=0
Content-Length: 176
Content-Type: text/html; charset=UTF-8
Date: Wed, 05 Mar 2025 08:42:35 GMT
Expires: Wed, 05 Mar 2025 08:42:35 GMT
Server: UploadServer
Vary: Origin, X-Origin
WWW-Authenticate: Bearer realm="https://accounts.google.com/"
X-GUploader-UploadID: AHMx-iGu6w380PcWwhi-4ZYW41s95W1YktMstAXzIAMBE6wJC5bwJ7GFEoOFJLc3nB-yDPDU
-- headers end --
-- body start --
<streaming body>
-- body end --
total round trip time (request+response): 0.053 secs
---- response end ----
----------------------
DEBUG: Retrying download from byte 644212845 after exception: <class 'apitools.base.py.exceptions.TransferRetryError'>. Trace: <traceback object at 0x7bea7b00cd80>
⠛=======================279.2GiB | 3.0MiB/s
==== request start ====
uri: https://storage.googleapis.com/download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288...
method: GET
== headers start ==
b'content-length': b'0'
b'range': b'bytes=429475276-644212391'
b'user-agent': b'google-cloud-sdk gcloud/512.0.0 command/gcloud.storage.cp invocation-id/0afba3139ca14d2298f918df7890a412 environment/None environment-version/None client-os/LINUX client-os-ver/6.8.0 client-pltf-arch/x86_64 interactive/False from-script/False python/3.12.8 term/xterm-256color (Linux 6.8.0-52-generic)'
== headers end ==
== body start ==

== body end ==
==== request end ====
=======================
==== request start ====
uri: https://storage.googleapis.com/download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288...
method: GET
== headers start ==
b'content-length': b'0'
b'range': b'bytes=5-214737463'
b'user-agent': b'google-cloud-sdk gcloud/512.0.0 command/gcloud.storage.cp invocation-id/0afba3139ca14d2298f918df7890a412 environment/None environment-version/None client-os/LINUX client-os-ver/6.8.0 client-pltf-arch/x86_64 interactive/False from-script/False python/3.12.8 term/xterm-256color (Linux 6.8.0-52-generic)'
== headers end ==
== body start ==

== body end ==
==== request end ====
DEBUG: https://storage.googleapis.com:443 "GET /download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288db25/o/20250218T172148Z%2FResource:%201867897127803802125%2Ftakeout-20250218T172150Z-263.zip?generation=1739901296033613&alt=media HTTP/11" 401 176
DEBUG: Skipping response_handler as response is invalid.
---- response start ----
status: 401
-- headers start --
Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
Cache-Control: private, max-age=0
Content-Length: 176
Content-Type: text/html; charset=UTF-8
Date: Wed, 05 Mar 2025 08:42:36 GMT
Expires: Wed, 05 Mar 2025 08:42:36 GMT
Server: UploadServer
Vary: Origin, X-Origin
WWW-Authenticate: Bearer realm="https://accounts.google.com/"
X-GUploader-UploadID: AHMx-iGEjF7TgzP_8FqscWXkchj3lyFUZRV1BwvKwkRkhN_mdABzjBT41_NrkKEw8PdslUws
-- headers end --
-- body start --
<streaming body>
DEBUG: https://storage.googleapis.com:443 "GET /download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288db25/o/20250218T172148Z%2FResource:%201867897127803802125%2Ftakeout-20250218T172150Z-263.zip?generation=1739901296033613&alt=media HTTP/11" 401 176
-- body end --
total round trip time (request+response): 0.057 secs
---- response end ----
DEBUG: Skipping response_handler as response is invalid.
----------------------
DEBUG: Retrying download from byte 429475276 after exception: <class 'apitools.base.py.exceptions.TransferRetryError'>. Trace: <traceback object at 0x7bea7acd7740>
---- response start ----
status: 401
-- headers start --
Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
Cache-Control: private, max-age=0
Content-Length: 176
Traceback (most recent call last):
Content-Type: text/html; charset=UTF-8
Date: Wed, 05 Mar 2025 08:42:36 GMT
File "/snap/google-cloud-cli/311/platform/bundledpythonunix/lib/python3.12/multiprocessing/queues.py", line 264, in _feed
obj = _ForkingPickler.dumps(obj)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/snap/google-cloud-cli/311/platform/bundledpythonunix/lib/python3.12/multiprocessing/reduction.py", line 51, in dumps
cls(buf, protocol).dump(obj)
TypeError: cannot pickle 'traceback' object
Expires: Wed, 05 Mar 2025 08:42:36 GMT
Server: UploadServer
Vary: Origin, X-Origin
WWW-Authenticate: Bearer realm="https://accounts.google.com/"
X-GUploader-UploadID: AHMx-iES1si9t25Qvc2bus3HSq6e2UVn6SS-asv8pZQfQCk5PWtSjk1d-PkpWI1l8Itm51Ft
-- headers end --
-- body start --
<streaming body>
-- body end --
total round trip time (request+response): 0.053 secs
---- response end ----
----------------------
DEBUG: Retrying download from byte 5 after exception: <class 'apitools.base.py.exceptions.TransferRetryError'>. Trace: <traceback object at 0x7bea7ad0aac0>
Traceback (most recent call last):
File "/snap/google-cloud-cli/311/platform/bundledpythonunix/lib/python3.12/multiprocessing/queues.py", line 264, in _feed
obj = _ForkingPickler.dumps(obj)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/snap/google-cloud-cli/311/platform/bundledpythonunix/lib/python3.12/multiprocessing/reduction.py", line 51, in dumps
cls(buf, protocol).dump(obj)
TypeError: cannot pickle 'traceback' object
⠧=======================279.2GiB | 3.0MiB/s
==== request start ====
uri: https://storage.googleapis.com/download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288...
method: GET
== headers start ==
b'content-length': b'0'
b'range': b'bytes=1503162271-1717899711'
b'user-agent': b'google-cloud-sdk gcloud/512.0.0 command/gcloud.storage.cp invocation-id/0afba3139ca14d2298f918df7890a412 environment/None environment-version/None client-os/LINUX client-os-ver/6.8.0 client-pltf-arch/x86_64 interactive/False from-script/False python/3.12.8 term/xterm-256color (Linux 6.8.0-52-generic)'
== headers end ==
== body start ==

== body end ==
==== request end ====
DEBUG: https://storage.googleapis.com:443 "GET /download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288db25/o/20250218T172148Z%2FResource:%201867897127803802125%2Ftakeout-20250218T172150Z-263.zip?generation=1739901296033613&alt=media HTTP/11" 401 176
DEBUG: Skipping response_handler as response is invalid.
---- response start ----
status: 401
-- headers start --
Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
Cache-Control: private, max-age=0
Content-Length: 176
Content-Type: text/html; charset=UTF-8
Date: Wed, 05 Mar 2025 08:42:38 GMT
Expires: Wed, 05 Mar 2025 08:42:38 GMT
Server: UploadServer
Vary: Origin, X-Origin
WWW-Authenticate: Bearer realm="https://accounts.google.com/"
X-GUploader-UploadID: AHMx-iHR86Zn6bFEsG6q7DCvFVqaqB21XUhb3Sk29DF78hz-bAZaIQI6zCwrfYVbOpmKFN2_
-- headers end --
-- body start --
<streaming body>
-- body end --
total round trip time (request+response): 0.050 secs
---- response end ----
----------------------
DEBUG: Retrying download from byte 1503162271 after exception: <class 'apitools.base.py.exceptions.TransferRetryError'>. Trace: <traceback object at 0x7bea7acf7500>
⠛=======================279.2GiB | 3.0MiB/s
==== request start ====
uri: https://storage.googleapis.com/download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288...
method: GET
== headers start ==
b'content-length': b'0'
b'range': b'bytes=1932637450-2147374630'
b'user-agent': b'google-cloud-sdk gcloud/512.0.0 command/gcloud.storage.cp invocation-id/0afba3139ca14d2298f918df7890a412 environment/None environment-version/None client-os/LINUX client-os-ver/6.8.0 client-pltf-arch/x86_64 interactive/False from-script/False python/3.12.8 term/xterm-256color (Linux 6.8.0-52-generic)'
== headers end ==
== body start ==

== body end ==
==== request end ====
DEBUG: https://storage.googleapis.com:443 "GET /download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288db25/o/20250218T172148Z%2FResource:%201867897127803802125%2Ftakeout-20250218T172150Z-263.zip?generation=1739901296033613&alt=media HTTP/11" 401 176
DEBUG: Skipping response_handler as response is invalid.
---- response start ----
status: 401
-- headers start --
Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
Cache-Control: private, max-age=0
Content-Length: 176
Content-Type: text/html; charset=UTF-8
Date: Wed, 05 Mar 2025 08:42:39 GMT
Expires: Wed, 05 Mar 2025 08:42:39 GMT
Server: UploadServer
Vary: Origin, X-Origin
WWW-Authenticate: Bearer realm="https://accounts.google.com/"
X-GUploader-UploadID: AHMx-iG0lj7lEdxgfKOWpjIxeiLXSHBaOUxvzaI3FxnCTxij4fwBH4dDrwlbIIYdinm_KXfo
-- headers end --
-- body start --
<streaming body>
-- body end --
total round trip time (request+response): 0.172 secs
---- response end ----
----------------------
DEBUG: Retrying download from byte 1932637450 after exception: <class 'apitools.base.py.exceptions.TransferRetryError'>. Trace: <traceback object at 0x7bea7ac811c0>
⠛=======================279.2GiB | 3.0MiB/s
==== request start ====
uri: https://storage.googleapis.com/download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288...
method: GET
== headers start ==
b'content-length': b'0'
b'range': b'bytes=858950157-1073687319'
b'user-agent': b'google-cloud-sdk gcloud/512.0.0 command/gcloud.storage.cp invocation-id/0afba3139ca14d2298f918df7890a412 environment/None environment-version/None client-os/LINUX client-os-ver/6.8.0 client-pltf-arch/x86_64 interactive/False from-script/False python/3.12.8 term/xterm-256color (Linux 6.8.0-52-generic)'
== headers end ==
== body start ==

== body end ==
==== request end ====
⠹DEBUG: https://storage.googleapis.com:443 "GET /download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288db25/o/20250218T172148Z%2FResource:%201867897127803802125%2Ftakeout-20250218T172150Z-263.zip?generation=1739901296033613&alt=media HTTP/11" 401 176
DEBUG: Skipping response_handler as response is invalid.
---- response start ----
status: 401
-- headers start --
Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
Cache-Control: private, max-age=0
Content-Length: 176
Content-Type: text/html; charset=UTF-8
Date: Wed, 05 Mar 2025 08:42:42 GMT
Expires: Wed, 05 Mar 2025 08:42:42 GMT
Server: UploadServer
Vary: Origin, X-Origin
WWW-Authenticate: Bearer realm="https://accounts.google.com/"
X-GUploader-UploadID: AHMx-iH8tr6eaAvdSElyIwiT6yeHrGmsTtuRcKObvT1qcASEUKBbRsEm8v0AdIrJwPhmbSCm
-- headers end --
-- body start --
<streaming body>
-- body end --
total round trip time (request+response): 0.184 secs
---- response end ----
----------------------
DEBUG: Retrying download from byte 858950157 after exception: <class 'apitools.base.py.exceptions.TransferRetryError'>. Trace: <traceback object at 0x7bea7ad1f440>
⠏=======================279.2GiB | 3.0MiB/s
==== request start ====
uri: https://storage.googleapis.com/download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288...
method: GET
== headers start ==
b'content-length': b'0'
b'range': b'bytes=1288425041-1503162247'
b'user-agent': b'google-cloud-sdk gcloud/512.0.0 command/gcloud.storage.cp invocation-id/0afba3139ca14d2298f918df7890a412 environment/None environment-version/None client-os/LINUX client-os-ver/6.8.0 client-pltf-arch/x86_64 interactive/False from-script/False python/3.12.8 term/xterm-256color (Linux 6.8.0-52-generic)'
== headers end ==
== body start ==

== body end ==
==== request end ====
DEBUG: https://storage.googleapis.com:443 "GET /download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288db25/o/20250218T172148Z%2FResource:%201867897127803802125%2Ftakeout-20250218T172150Z-263.zip?generation=1739901296033613&alt=media HTTP/11" 401 176
DEBUG: Skipping response_handler as response is invalid.
---- response start ----
status: 401
-- headers start --
Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
Cache-Control: private, max-age=0
Content-Length: 176
Content-Type: text/html; charset=UTF-8
Date: Wed, 05 Mar 2025 08:42:43 GMT
Expires: Wed, 05 Mar 2025 08:42:43 GMT
Server: UploadServer
Vary: Origin, X-Origin
WWW-Authenticate: Bearer realm="https://accounts.google.com/"
X-GUploader-UploadID: AHMx-iGGdIqgssO_E4IPou0jZV0fVFhnRWqsduaYexf9rsQ_xWbW-Mpt2m9Ps6cuKjmMyn81
-- headers end --
-- body start --
<streaming body>
-- body end --
total round trip time (request+response): 0.052 secs
---- response end ----
----------------------
DEBUG: Retrying download from byte 1288425041 after exception: <class 'apitools.base.py.exceptions.TransferRetryError'>. Trace: <traceback object at 0x7bea7ad033c0>
Traceback (most recent call last):
File "/snap/google-cloud-cli/311/platform/bundledpythonunix/lib/python3.12/multiprocessing/queues.py", line 264, in _feed
obj = _ForkingPickler.dumps(obj)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/snap/google-cloud-cli/311/platform/bundledpythonunix/lib/python3.12/multiprocessing/reduction.py", line 51, in dumps
cls(buf, protocol).dump(obj)
TypeError: cannot pickle 'traceback' object
⠏=======================279.2GiB | 3.0MiB/s
==== request start ====
uri: https://storage.googleapis.com/download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288...
method: GET
== headers start ==
b'content-length': b'0'
b'range': b'bytes=1717899720-1932637175'
b'user-agent': b'google-cloud-sdk gcloud/512.0.0 command/gcloud.storage.cp invocation-id/0afba3139ca14d2298f918df7890a412 environment/None environment-version/None client-os/LINUX client-os-ver/6.8.0 client-pltf-arch/x86_64 interactive/False from-script/False python/3.12.8 term/xterm-256color (Linux 6.8.0-52-generic)'
== headers end ==
== body start ==

== body end ==
==== request end ====
⠛DEBUG: https://storage.googleapis.com:443 "GET /download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288db25/o/20250218T172148Z%2FResource:%201867897127803802125%2Ftakeout-20250218T172150Z-263.zip?generation=1739901296033613&alt=media HTTP/11" 401 176
DEBUG: Skipping response_handler as response is invalid.
---- response start ----
status: 401
-- headers start --
Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
Cache-Control: private, max-age=0
Content-Length: 176
Content-Type: text/html; charset=UTF-8
Date: Wed, 05 Mar 2025 08:42:45 GMT
Expires: Wed, 05 Mar 2025 08:42:45 GMT
Server: UploadServer
Vary: Origin, X-Origin
WWW-Authenticate: Bearer realm="https://accounts.google.com/"
X-GUploader-UploadID: AHMx-iHlDTibOk2x6y-dD1SJHJfW79-uEkAZzfol9451677TOdRPMyuXJcQFEZFJdaZdajyh
-- headers end --
-- body start --
<streaming body>
-- body end --
total round trip time (request+response): 0.061 secs
---- response end ----
----------------------
DEBUG: Retrying download from byte 1717899720 after exception: <class 'apitools.base.py.exceptions.TransferRetryError'>. Trace: <traceback object at 0x7bea7ad1cdc0>
⠹=======================279.2GiB | 3.0MiB/s
==== request start ====
uri: https://storage.googleapis.com/download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288...
method: GET
== headers start ==
b'content-length': b'0'
b'range': b'bytes=214737667-429474927'
b'user-agent': b'google-cloud-sdk gcloud/512.0.0 command/gcloud.storage.cp invocation-id/0afba3139ca14d2298f918df7890a412 environment/None environment-version/None client-os/LINUX client-os-ver/6.8.0 client-pltf-arch/x86_64 interactive/False from-script/False python/3.12.8 term/xterm-256color (Linux 6.8.0-52-generic)'
== headers end ==
== body start ==

== body end ==
==== request end ====
⠼DEBUG: https://storage.googleapis.com:443 "GET /download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288db25/o/20250218T172148Z%2FResource:%201867897127803802125%2Ftakeout-20250218T172150Z-263.zip?generation=1739901296033613&alt=media HTTP/11" 401 176
DEBUG: Skipping response_handler as response is invalid.
---- response start ----
status: 401
-- headers start --
Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
Cache-Control: private, max-age=0
Content-Length: 176
Content-Type: text/html; charset=UTF-8
Date: Wed, 05 Mar 2025 08:42:46 GMT
Expires: Wed, 05 Mar 2025 08:42:46 GMT
Server: UploadServer
Vary: Origin, X-Origin
WWW-Authenticate: Bearer realm="https://accounts.google.com/"
X-GUploader-UploadID: AHMx-iGCfvu1eERWx8nd97hLtqb2pFpHWWZc3mlTxW-bKlNUpeTqQk3lTJJ-iEDo31RJxErk
-- headers end --
-- body start --
<streaming body>
-- body end --
total round trip time (request+response): 0.058 secs
---- response end ----
----------------------
DEBUG: Retrying download from byte 214737667 after exception: <class 'apitools.base.py.exceptions.TransferRetryError'>. Trace: <traceback object at 0x7bea7ad2d740>
⠶=======================279.2GiB | 3.0MiB/s
==== request start ====
uri: https://storage.googleapis.com/download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288...
method: GET
== headers start ==
b'content-length': b'0'
b'range': b'bytes=1073687787-1288424783'
b'user-agent': b'google-cloud-sdk gcloud/512.0.0 command/gcloud.storage.cp invocation-id/0afba3139ca14d2298f918df7890a412 environment/None environment-version/None client-os/LINUX client-os-ver/6.8.0 client-pltf-arch/x86_64 interactive/False from-script/False python/3.12.8 term/xterm-256color (Linux 6.8.0-52-generic)'
== headers end ==
== body start ==

== body end ==
==== request end ====
⠧DEBUG: https://storage.googleapis.com:443 "GET /download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288db25/o/20250218T172148Z%2FResource:%201867897127803802125%2Ftakeout-20250218T172150Z-263.zip?generation=1739901296033613&alt=media HTTP/11" 401 176
DEBUG: Skipping response_handler as response is invalid.
---- response start ----
status: 401
-- headers start --
Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
Cache-Control: private, max-age=0
Content-Length: 176
Content-Type: text/html; charset=UTF-8
Date: Wed, 05 Mar 2025 08:42:48 GMT
Expires: Wed, 05 Mar 2025 08:42:48 GMT
Server: UploadServer
Vary: Origin, X-Origin
WWW-Authenticate: Bearer realm="https://accounts.google.com/"
X-GUploader-UploadID: AHMx-iE2mUYZut8uVvY6XvUfiTayjwl42GqQRm0lSsvqdJQHshS-1JewtvITMQOh1KaaWgRX
-- headers end --
-- body start --
<streaming body>
-- body end --
total round trip time (request+response): 0.090 secs
---- response end ----
----------------------
DEBUG: Retrying download from byte 1073687787 after exception: <class 'apitools.base.py.exceptions.TransferRetryError'>. Trace: <traceback object at 0x7bea7acf5000>
⠹=======================279.2GiB | 3.0MiB/s
==== request start ====
uri: https://storage.googleapis.com/download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288...
method: GET
== headers start ==
b'content-length': b'0'
b'range': b'bytes=644212845-858949855'
b'user-agent': b'google-cloud-sdk gcloud/512.0.0 command/gcloud.storage.cp invocation-id/0afba3139ca14d2298f918df7890a412 environment/None environment-version/None client-os/LINUX client-os-ver/6.8.0 client-pltf-arch/x86_64 interactive/False from-script/False python/3.12.8 term/xterm-256color (Linux 6.8.0-52-generic)'
== headers end ==
== body start ==

== body end ==
==== request end ====
DEBUG: https://storage.googleapis.com:443 "GET /download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288db25/o/20250218T172148Z%2FResource:%201867897127803802125%2Ftakeout-20250218T172150Z-263.zip?generation=1739901296033613&alt=media HTTP/11" 401 176
DEBUG: Skipping response_handler as response is invalid.
---- response start ----
status: 401
-- headers start --
Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
Cache-Control: private, max-age=0
Content-Length: 176
Content-Type: text/html; charset=UTF-8
Date: Wed, 05 Mar 2025 08:43:07 GMT
Expires: Wed, 05 Mar 2025 08:43:07 GMT
Server: UploadServer
Vary: Origin, X-Origin
WWW-Authenticate: Bearer realm="https://accounts.google.com/"
X-GUploader-UploadID: AHMx-iEiCwNEl6W3ciBbvDCbl2OreLezcRa_9emYf0PpQ5vzJ5iwMbIxtwrWUbJQiLRjuH1t
-- headers end --
-- body start --
<streaming body>
-- body end --
total round trip time (request+response): 0.055 secs
---- response end ----
----------------------
DEBUG: Retrying download from byte 644212845 after exception: <class 'apitools.base.py.exceptions.TransferRetryError'>. Trace: <traceback object at 0x7bea7ad02d80>
⠼=======================279.2GiB | 3.0MiB/s
==== request start ====
uri: https://storage.googleapis.com/download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288...
method: GET
== headers start ==
b'content-length': b'0'
b'range': b'bytes=1503162271-1717899711'
b'user-agent': b'google-cloud-sdk gcloud/512.0.0 command/gcloud.storage.cp invocation-id/0afba3139ca14d2298f918df7890a412 environment/None environment-version/None client-os/LINUX client-os-ver/6.8.0 client-pltf-arch/x86_64 interactive/False from-script/False python/3.12.8 term/xterm-256color (Linux 6.8.0-52-generic)'
== headers end ==
== body start ==

== body end ==
==== request end ====
⠶DEBUG: https://storage.googleapis.com:443 "GET /download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288db25/o/20250218T172148Z%2FResource:%201867897127803802125%2Ftakeout-20250218T172150Z-263.zip?generation=1739901296033613&alt=media HTTP/11" 401 176
DEBUG: Skipping response_handler as response is invalid.
---- response start ----
status: 401
-- headers start --
Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
Cache-Control: private, max-age=0
Content-Length: 176
Content-Type: text/html; charset=UTF-8
Date: Wed, 05 Mar 2025 08:43:10 GMT
Expires: Wed, 05 Mar 2025 08:43:10 GMT
Server: UploadServer
Vary: Origin, X-Origin
WWW-Authenticate: Bearer realm="https://accounts.google.com/"
X-GUploader-UploadID: AHMx-iE0S3290-dsZ5O06nzYFFOS56-_5VL7OKLXwAgIohR_M7JIkCxT85vYbNAtjSgIs161
-- headers end --
-- body start --
<streaming body>
-- body end --
total round trip time (request+response): 0.137 secs
---- response end ----
----------------------
DEBUG: Retrying download from byte 1503162271 after exception: <class 'apitools.base.py.exceptions.TransferRetryError'>. Trace: <traceback object at 0x7bea7acf6180>
⠧=======================279.2GiB | 3.0MiB/s
==== request start ====
uri: https://storage.googleapis.com/download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288...
method: GET
== headers start ==
b'content-length': b'0'
b'range': b'bytes=1932637450-2147374630'
b'user-agent': b'google-cloud-sdk gcloud/512.0.0 command/gcloud.storage.cp invocation-id/0afba3139ca14d2298f918df7890a412 environment/None environment-version/None client-os/LINUX client-os-ver/6.8.0 client-pltf-arch/x86_64 interactive/False from-script/False python/3.12.8 term/xterm-256color (Linux 6.8.0-52-generic)'
== headers end ==
== body start ==

== body end ==
==== request end ====
⠏DEBUG: https://storage.googleapis.com:443 "GET /download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288db25/o/20250218T172148Z%2FResource:%201867897127803802125%2Ftakeout-20250218T172150Z-263.zip?generation=1739901296033613&alt=media HTTP/11" 401 176
DEBUG: Skipping response_handler as response is invalid.
---- response start ----
status: 401
-- headers start --
Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
Cache-Control: private, max-age=0
Content-Length: 176
Content-Type: text/html; charset=UTF-8
Date: Wed, 05 Mar 2025 08:43:12 GMT
Expires: Wed, 05 Mar 2025 08:43:12 GMT
Server: UploadServer
Vary: Origin, X-Origin
WWW-Authenticate: Bearer realm="https://accounts.google.com/"
X-GUploader-UploadID: AHMx-iE_E7C8RoES-8qg4VSY3kYgdkrmrT2aD7AANHQBylyXsX4Q-en1BVyI_oJoGoQFh2pZ
-- headers end --
-- body start --
<streaming body>
-- body end --
total round trip time (request+response): 0.069 secs
---- response end ----
----------------------
DEBUG: Retrying download from byte 1932637450 after exception: <class 'apitools.base.py.exceptions.TransferRetryError'>. Trace: <traceback object at 0x7bea7acb1bc0>
Traceback (most recent call last):
File "/snap/google-cloud-cli/311/platform/bundledpythonunix/lib/python3.12/multiprocessing/queues.py", line 264, in _feed
obj = _ForkingPickler.dumps(obj)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/snap/google-cloud-cli/311/platform/bundledpythonunix/lib/python3.12/multiprocessing/reduction.py", line 51, in dumps
cls(buf, protocol).dump(obj)
TypeError: cannot pickle 'traceback' object
⠏=======================279.2GiB | 3.0MiB/s
==== request start ====
uri: https://storage.googleapis.com/download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288...
method: GET
== headers start ==
b'content-length': b'0'
b'range': b'bytes=858950157-1073687319'
b'user-agent': b'google-cloud-sdk gcloud/512.0.0 command/gcloud.storage.cp invocation-id/0afba3139ca14d2298f918df7890a412 environment/None environment-version/None client-os/LINUX client-os-ver/6.8.0 client-pltf-arch/x86_64 interactive/False from-script/False python/3.12.8 term/xterm-256color (Linux 6.8.0-52-generic)'
== headers end ==
== body start ==

== body end ==
==== request end ====
DEBUG: https://storage.googleapis.com:443 "GET /download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288db25/o/20250218T172148Z%2FResource:%201867897127803802125%2Ftakeout-20250218T172150Z-263.zip?generation=1739901296033613&alt=media HTTP/11" 401 176
DEBUG: Skipping response_handler as response is invalid.
---- response start ----
status: 401
-- headers start --
Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
Cache-Control: private, max-age=0
Content-Length: 176
Content-Type: text/html; charset=UTF-8
Date: Wed, 05 Mar 2025 08:43:14 GMT
Expires: Wed, 05 Mar 2025 08:43:14 GMT
Server: UploadServer
Vary: Origin, X-Origin
WWW-Authenticate: Bearer realm="https://accounts.google.com/"
X-GUploader-UploadID: AHMx-iFqPfugpSShHpV_9Z6avGOmrB3qQLkyr2b47ltldVPmbUuubjIAaae8F55RmPdqCVWO
-- headers end --
-- body start --
<streaming body>
-- body end --
total round trip time (request+response): 0.055 secs
---- response end ----
----------------------
DEBUG: Retrying download from byte 858950157 after exception: <class 'apitools.base.py.exceptions.TransferRetryError'>. Trace: <traceback object at 0x7bea7af85040>
⠧=======================279.2GiB | 3.0MiB/s
==== request start ====
uri: https://storage.googleapis.com/download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288...
method: GET
== headers start ==
b'content-length': b'0'
b'range': b'bytes=1717899720-1932637175'
b'user-agent': b'google-cloud-sdk gcloud/512.0.0 command/gcloud.storage.cp invocation-id/0afba3139ca14d2298f918df7890a412 environment/None environment-version/None client-os/LINUX client-os-ver/6.8.0 client-pltf-arch/x86_64 interactive/False from-script/False python/3.12.8 term/xterm-256color (Linux 6.8.0-52-generic)'
== headers end ==
== body start ==

== body end ==
==== request end ====
DEBUG: https://storage.googleapis.com:443 "GET /download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288db25/o/20250218T172148Z%2FResource:%201867897127803802125%2Ftakeout-20250218T172150Z-263.zip?generation=1739901296033613&alt=media HTTP/11" 401 176
DEBUG: Skipping response_handler as response is invalid.
---- response start ----
status: 401
-- headers start --
Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
Cache-Control: private, max-age=0
Content-Length: 176
Content-Type: text/html; charset=UTF-8
Date: Wed, 05 Mar 2025 08:43:17 GMT
Expires: Wed, 05 Mar 2025 08:43:17 GMT
Server: UploadServer
Vary: Origin, X-Origin
WWW-Authenticate: Bearer realm="https://accounts.google.com/"
X-GUploader-UploadID: AHMx-iFXdvAiOF1VkqcshXxDKAYJ_ePF8dyNs4ltWcUTEVso8PKOBwYOiLY9913xKQ-APr_M
-- headers end --
-- body start --
<streaming body>
-- body end --
total round trip time (request+response): 0.122 secs
---- response end ----
----------------------
DEBUG: Retrying download from byte 1717899720 after exception: <class 'apitools.base.py.exceptions.TransferRetryError'>. Trace: <traceback object at 0x7bea7acffa00>
Traceback (most recent call last):
File "/snap/google-cloud-cli/311/platform/bundledpythonunix/lib/python3.12/multiprocessing/queues.py", line 264, in _feed
obj = _ForkingPickler.dumps(obj)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/snap/google-cloud-cli/311/platform/bundledpythonunix/lib/python3.12/multiprocessing/reduction.py", line 51, in dumps
cls(buf, protocol).dump(obj)
TypeError: cannot pickle 'traceback' object
⠛=======================279.2GiB | 3.0MiB/s
==== request start ====
uri: https://storage.googleapis.com/download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288...
method: GET
== headers start ==
b'content-length': b'0'
b'range': b'bytes=214737667-429474927'
b'user-agent': b'google-cloud-sdk gcloud/512.0.0 command/gcloud.storage.cp invocation-id/0afba3139ca14d2298f918df7890a412 environment/None environment-version/None client-os/LINUX client-os-ver/6.8.0 client-pltf-arch/x86_64 interactive/False from-script/False python/3.12.8 term/xterm-256color (Linux 6.8.0-52-generic)'
== headers end ==
== body start ==

== body end ==
==== request end ====
DEBUG: https://storage.googleapis.com:443 "GET /download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288db25/o/20250218T172148Z%2FResource:%201867897127803802125%2Ftakeout-20250218T172150Z-263.zip?generation=1739901296033613&alt=media HTTP/11" 401 176
DEBUG: Skipping response_handler as response is invalid.
---- response start ----
status: 401
-- headers start --
Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
Cache-Control: private, max-age=0
Content-Length: 176
Content-Type: text/html; charset=UTF-8
Date: Wed, 05 Mar 2025 08:43:18 GMT
Expires: Wed, 05 Mar 2025 08:43:18 GMT
Server: UploadServer
Vary: Origin, X-Origin
WWW-Authenticate: Bearer realm="https://accounts.google.com/"
X-GUploader-UploadID: AHMx-iHFFxYcphWwCUp_6IBlnN_ZpMAgh34HGGhs5_ci8GUYugB2zqH_QXfT1WgI3hrHoKIa
-- headers end --
-- body start --
<streaming body>
-- body end --
total round trip time (request+response): 0.058 secs
---- response end ----
----------------------
DEBUG: Retrying download from byte 214737667 after exception: <class 'apitools.base.py.exceptions.TransferRetryError'>. Trace: <traceback object at 0x7bea7ad0ef00>
⠹=======================279.2GiB | 3.0MiB/s
==== request start ====
uri: https://storage.googleapis.com/download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288...
method: GET
== headers start ==
b'content-length': b'0'
b'range': b'bytes=1073687787-1288424783'
b'user-agent': b'google-cloud-sdk gcloud/512.0.0 command/gcloud.storage.cp invocation-id/0afba3139ca14d2298f918df7890a412 environment/None environment-version/None client-os/LINUX client-os-ver/6.8.0 client-pltf-arch/x86_64 interactive/False from-script/False python/3.12.8 term/xterm-256color (Linux 6.8.0-52-generic)'
== headers end ==
== body start ==

== body end ==
==== request end ====
⠼DEBUG: https://storage.googleapis.com:443 "GET /download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288db25/o/20250218T172148Z%2FResource:%201867897127803802125%2Ftakeout-20250218T172150Z-263.zip?generation=1739901296033613&alt=media HTTP/11" 401 176
DEBUG: Skipping response_handler as response is invalid.
---- response start ----
status: 401
-- headers start --
Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
Cache-Control: private, max-age=0
Content-Length: 176
Content-Type: text/html; charset=UTF-8
Date: Wed, 05 Mar 2025 08:43:21 GMT
Expires: Wed, 05 Mar 2025 08:43:21 GMT
Server: UploadServer
Vary: Origin, X-Origin
WWW-Authenticate: Bearer realm="https://accounts.google.com/"
X-GUploader-UploadID: AHMx-iETM5D_6cpzTAC20CBFqbAEdNt3J-ws4Q_-yoVkRK3iEml0tcK4mxQPivvDCcgsWIsv
-- headers end --
-- body start --
<streaming body>
-- body end --
total round trip time (request+response): 0.060 secs
---- response end ----
----------------------
DEBUG: Retrying download from byte 1073687787 after exception: <class 'apitools.base.py.exceptions.TransferRetryError'>. Trace: <traceback object at 0x7bea7acf4540>
⠏=======================279.2GiB | 3.0MiB/s
==== request start ====
uri: https://storage.googleapis.com/download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288...
method: GET
== headers start ==
b'content-length': b'0'
b'range': b'bytes=644212845-858949855'
b'user-agent': b'google-cloud-sdk gcloud/512.0.0 command/gcloud.storage.cp invocation-id/0afba3139ca14d2298f918df7890a412 environment/None environment-version/None client-os/LINUX client-os-ver/6.8.0 client-pltf-arch/x86_64 interactive/False from-script/False python/3.12.8 term/xterm-256color (Linux 6.8.0-52-generic)'
== headers end ==
== body start ==

== body end ==
==== request end ====
DEBUG: https://storage.googleapis.com:443 "GET /download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288db25/o/20250218T172148Z%2FResource:%201867897127803802125%2Ftakeout-20250218T172150Z-263.zip?generation=1739901296033613&alt=media HTTP/11" 401 176
DEBUG: Skipping response_handler as response is invalid.
---- response start ----
status: 401
-- headers start --
Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
Cache-Control: private, max-age=0
Content-Length: 176
Content-Type: text/html; charset=UTF-8
Date: Wed, 05 Mar 2025 08:43:39 GMT
Expires: Wed, 05 Mar 2025 08:43:39 GMT
Server: UploadServer
Vary: Origin, X-Origin
WWW-Authenticate: Bearer realm="https://accounts.google.com/"
X-GUploader-UploadID: AHMx-iEral4SWwsPdXz35-ZTfmGsRMvYnVgpzPLQSU34ywec3cFj57pF_SizDeDAJhRoyNIy
-- headers end --
-- body start --
<streaming body>
-- body end --
total round trip time (request+response): 0.054 secs
---- response end ----
----------------------
DEBUG: Retrying download from byte 644212845 after exception: <class 'apitools.base.py.exceptions.TransferRetryError'>. Trace: <traceback object at 0x7bea7acb0540>
⠹=======================279.2GiB | 3.0MiB/s
==== request start ====
uri: https://storage.googleapis.com/download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288...
method: GET
== headers start ==
b'content-length': b'0'
b'range': b'bytes=1503162271-1717899711'
b'user-agent': b'google-cloud-sdk gcloud/512.0.0 command/gcloud.storage.cp invocation-id/0afba3139ca14d2298f918df7890a412 environment/None environment-version/None client-os/LINUX client-os-ver/6.8.0 client-pltf-arch/x86_64 interactive/False from-script/False python/3.12.8 term/xterm-256color (Linux 6.8.0-52-generic)'
== headers end ==
== body start ==

== body end ==
==== request end ====
DEBUG: https://storage.googleapis.com:443 "GET /download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288db25/o/20250218T172148Z%2FResource:%201867897127803802125%2Ftakeout-20250218T172150Z-263.zip?generation=1739901296033613&alt=media HTTP/11" 401 176
DEBUG: Skipping response_handler as response is invalid.
---- response start ----
status: 401
-- headers start --
Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
Cache-Control: private, max-age=0
Content-Length: 176
Content-Type: text/html; charset=UTF-8
Date: Wed, 05 Mar 2025 08:43:42 GMT
Expires: Wed, 05 Mar 2025 08:43:42 GMT
Server: UploadServer
Vary: Origin, X-Origin
WWW-Authenticate: Bearer realm="https://accounts.google.com/"
X-GUploader-UploadID: AHMx-iGIbiP60PE_njEw3RfWIiCN4xVzJjJGVj0qFHX7KWn_c-T0KdyrVvfJa50HsGWqSQSp
-- headers end --
-- body start --
<streaming body>
-- body end --
total round trip time (request+response): 0.060 secs
---- response end ----
----------------------
DEBUG: Retrying download from byte 1503162271 after exception: <class 'apitools.base.py.exceptions.TransferRetryError'>. Trace: <traceback object at 0x7bea7acdf980>
⠶=======================279.2GiB | 3.0MiB/s
==== request start ====
uri: https://storage.googleapis.com/download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288...
method: GET
== headers start ==
b'content-length': b'0'
b'range': b'bytes=858950157-1073687319'
b'user-agent': b'google-cloud-sdk gcloud/512.0.0 command/gcloud.storage.cp invocation-id/0afba3139ca14d2298f918df7890a412 environment/None environment-version/None client-os/LINUX client-os-ver/6.8.0 client-pltf-arch/x86_64 interactive/False from-script/False python/3.12.8 term/xterm-256color (Linux 6.8.0-52-generic)'
== headers end ==
== body start ==

== body end ==
==== request end ====
DEBUG: https://storage.googleapis.com:443 "GET /download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288db25/o/20250218T172148Z%2FResource:%201867897127803802125%2Ftakeout-20250218T172150Z-263.zip?generation=1739901296033613&alt=media HTTP/11" 401 176
DEBUG: Skipping response_handler as response is invalid.
---- response start ----
status: 401
-- headers start --
Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
Cache-Control: private, max-age=0
Content-Length: 176
Content-Type: text/html; charset=UTF-8
Date: Wed, 05 Mar 2025 08:43:46 GMT
Expires: Wed, 05 Mar 2025 08:43:46 GMT
Server: UploadServer
Vary: Origin, X-Origin
WWW-Authenticate: Bearer realm="https://accounts.google.com/"
X-GUploader-UploadID: AHMx-iGNUXjo3bmA30s0OFyLW9N6cGMEZUxnf3ZTj2BGh688P3vE3bN6xk3J2KZ_-REVAhGq
-- headers end --
-- body start --
<streaming body>
-- body end --
total round trip time (request+response): 0.057 secs
---- response end ----
----------------------
DEBUG: Retrying download from byte 858950157 after exception: <class 'apitools.base.py.exceptions.TransferRetryError'>. Trace: <traceback object at 0x7bea7ad1f440>
⠧=======================279.2GiB | 3.0MiB/s
==== request start ====
uri: https://storage.googleapis.com/download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288...
method: GET
== headers start ==
b'content-length': b'0'
b'range': b'bytes=214737667-429474927'
b'user-agent': b'google-cloud-sdk gcloud/512.0.0 command/gcloud.storage.cp invocation-id/0afba3139ca14d2298f918df7890a412 environment/None environment-version/None client-os/LINUX client-os-ver/6.8.0 client-pltf-arch/x86_64 interactive/False from-script/False python/3.12.8 term/xterm-256color (Linux 6.8.0-52-generic)'
== headers end ==
== body start ==

== body end ==
==== request end ====
DEBUG: https://storage.googleapis.com:443 "GET /download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288db25/o/20250218T172148Z%2FResource:%201867897127803802125%2Ftakeout-20250218T172150Z-263.zip?generation=1739901296033613&alt=media HTTP/11" 401 176
DEBUG: Skipping response_handler as response is invalid.
---- response start ----
status: 401
-- headers start --
Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
Cache-Control: private, max-age=0
Content-Length: 176
Content-Type: text/html; charset=UTF-8
Date: Wed, 05 Mar 2025 08:43:50 GMT
Expires: Wed, 05 Mar 2025 08:43:50 GMT
Server: UploadServer
Vary: Origin, X-Origin
WWW-Authenticate: Bearer realm="https://accounts.google.com/"
X-GUploader-UploadID: AHMx-iEQn0qFyTyPKdJCRpurwJp55JpmHdupyBphQzkw4QctNykON89eDZZSXhM93_IZ-VJI
-- headers end --
-- body start --
<streaming body>
-- body end --
total round trip time (request+response): 0.119 secs
---- response end ----
----------------------
DEBUG: Retrying download from byte 214737667 after exception: <class 'apitools.base.py.exceptions.TransferRetryError'>. Trace: <traceback object at 0x7bea7ad0db40>
⠛=======================279.2GiB | 3.0MiB/s
==== request start ====
uri: https://storage.googleapis.com/download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288...
method: GET
== headers start ==
b'content-length': b'0'
b'range': b'bytes=1073687787-1288424783'
b'user-agent': b'google-cloud-sdk gcloud/512.0.0 command/gcloud.storage.cp invocation-id/0afba3139ca14d2298f918df7890a412 environment/None environment-version/None client-os/LINUX client-os-ver/6.8.0 client-pltf-arch/x86_64 interactive/False from-script/False python/3.12.8 term/xterm-256color (Linux 6.8.0-52-generic)'
== headers end ==
== body start ==

== body end ==
==== request end ====
DEBUG: https://storage.googleapis.com:443 "GET /download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288db25/o/20250218T172148Z%2FResource:%201867897127803802125%2Ftakeout-20250218T172150Z-263.zip?generation=1739901296033613&alt=media HTTP/11" 401 176
DEBUG: Skipping response_handler as response is invalid.
---- response start ----
status: 401
-- headers start --
Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
Cache-Control: private, max-age=0
Content-Length: 176
Content-Type: text/html; charset=UTF-8
Date: Wed, 05 Mar 2025 08:43:53 GMT
Expires: Wed, 05 Mar 2025 08:43:53 GMT
Server: UploadServer
Vary: Origin, X-Origin
WWW-Authenticate: Bearer realm="https://accounts.google.com/"
X-GUploader-UploadID: AHMx-iEnbCgm8E4d-IGvxsrr2pvJX_sIhMI3QzqHs3vpcT8Sv545YIe9n2T_FxPPituvOIZ7
-- headers end --
-- body start --
<streaming body>
-- body end --
total round trip time (request+response): 0.050 secs
---- response end ----
----------------------
DEBUG: Retrying download from byte 1073687787 after exception: <class 'apitools.base.py.exceptions.TransferRetryError'>. Trace: <traceback object at 0x7bea7ad00100>
Traceback (most recent call last):
File "/snap/google-cloud-cli/311/platform/bundledpythonunix/lib/python3.12/multiprocessing/queues.py", line 264, in _feed
obj = _ForkingPickler.dumps(obj)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/snap/google-cloud-cli/311/platform/bundledpythonunix/lib/python3.12/multiprocessing/reduction.py", line 51, in dumps
cls(buf, protocol).dump(obj)
TypeError: cannot pickle 'traceback' object
⠶=======================279.2GiB | 3.0MiB/s
==== request start ====
uri: https://storage.googleapis.com/download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288...
method: GET
== headers start ==
b'content-length': b'0'
b'range': b'bytes=644212845-858949855'
b'user-agent': b'google-cloud-sdk gcloud/512.0.0 command/gcloud.storage.cp invocation-id/0afba3139ca14d2298f918df7890a412 environment/None environment-version/None client-os/LINUX client-os-ver/6.8.0 client-pltf-arch/x86_64 interactive/False from-script/False python/3.12.8 term/xterm-256color (Linux 6.8.0-52-generic)'
== headers end ==
== body start ==

== body end ==
==== request end ====
⠧DEBUG: https://storage.googleapis.com:443 "GET /download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288db25/o/20250218T172148Z%2FResource:%201867897127803802125%2Ftakeout-20250218T172150Z-263.zip?generation=1739901296033613&alt=media HTTP/11" 401 176
DEBUG: Skipping response_handler as response is invalid.
---- response start ----
status: 401
-- headers start --
Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
Cache-Control: private, max-age=0
Content-Length: 176
Content-Type: text/html; charset=UTF-8
Date: Wed, 05 Mar 2025 08:44:11 GMT
Expires: Wed, 05 Mar 2025 08:44:11 GMT
Server: UploadServer
Vary: Origin, X-Origin
WWW-Authenticate: Bearer realm="https://accounts.google.com/"
X-GUploader-UploadID: AHMx-iHpz0VxBmhIID73_6CO9tcjrCsnVpeZfC8L36ojZ0ivL_o8jOhKIDtRABiAQq8t1X_i
-- headers end --
-- body start --
<streaming body>
-- body end --
total round trip time (request+response): 0.142 secs
---- response end ----
----------------------
DEBUG: Retrying download from byte 644212845 after exception: <class 'apitools.base.py.exceptions.TransferRetryError'>. Trace: <traceback object at 0x7bea7b7ac500>
⠏=======================279.2GiB | 3.0MiB/s
==== request start ====
uri: https://storage.googleapis.com/download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288...
method: GET
== headers start ==
b'content-length': b'0'
b'range': b'bytes=1503162271-1717899711'
b'user-agent': b'google-cloud-sdk gcloud/512.0.0 command/gcloud.storage.cp invocation-id/0afba3139ca14d2298f918df7890a412 environment/None environment-version/None client-os/LINUX client-os-ver/6.8.0 client-pltf-arch/x86_64 interactive/False from-script/False python/3.12.8 term/xterm-256color (Linux 6.8.0-52-generic)'
== headers end ==
== body start ==

== body end ==
==== request end ====
DEBUG: https://storage.googleapis.com:443 "GET /download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288db25/o/20250218T172148Z%2FResource:%201867897127803802125%2Ftakeout-20250218T172150Z-263.zip?generation=1739901296033613&alt=media HTTP/11" 401 176
DEBUG: Skipping response_handler as response is invalid.
---- response start ----
status: 401
-- headers start --
Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
Cache-Control: private, max-age=0
Content-Length: 176
Content-Type: text/html; charset=UTF-8
Date: Wed, 05 Mar 2025 08:44:14 GMT
Expires: Wed, 05 Mar 2025 08:44:14 GMT
Server: UploadServer
Vary: Origin, X-Origin
WWW-Authenticate: Bearer realm="https://accounts.google.com/"
X-GUploader-UploadID: AHMx-iHx3eh2nbpwC5TC-ZAcFQKNNwpxu2Ohd8QDWOLRnMPne6BBGJmLPJ1jBrdvj3PU-VP_
-- headers end --
-- body start --
<streaming body>
-- body end --
total round trip time (request+response): 0.057 secs
---- response end ----
----------------------
DEBUG: Retrying download from byte 1503162271 after exception: <class 'apitools.base.py.exceptions.TransferRetryError'>. Trace: <traceback object at 0x7bea7ad00900>
Traceback (most recent call last):
File "/snap/google-cloud-cli/311/platform/bundledpythonunix/lib/python3.12/multiprocessing/queues.py", line 264, in _feed
obj = _ForkingPickler.dumps(obj)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/snap/google-cloud-cli/311/platform/bundledpythonunix/lib/python3.12/multiprocessing/reduction.py", line 51, in dumps
cls(buf, protocol).dump(obj)
TypeError: cannot pickle 'traceback' object
⠹=======================279.2GiB | 3.0MiB/s
==== request start ====
uri: https://storage.googleapis.com/download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288...
method: GET
== headers start ==
b'content-length': b'0'
b'range': b'bytes=858950157-1073687319'
b'user-agent': b'google-cloud-sdk gcloud/512.0.0 command/gcloud.storage.cp invocation-id/0afba3139ca14d2298f918df7890a412 environment/None environment-version/None client-os/LINUX client-os-ver/6.8.0 client-pltf-arch/x86_64 interactive/False from-script/False python/3.12.8 term/xterm-256color (Linux 6.8.0-52-generic)'
== headers end ==
== body start ==

== body end ==
==== request end ====
DEBUG: https://storage.googleapis.com:443 "GET /download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288db25/o/20250218T172148Z%2FResource:%201867897127803802125%2Ftakeout-20250218T172150Z-263.zip?generation=1739901296033613&alt=media HTTP/11" 401 176
DEBUG: Skipping response_handler as response is invalid.
---- response start ----
status: 401
-- headers start --
Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
Cache-Control: private, max-age=0
Content-Length: 176
Content-Type: text/html; charset=UTF-8
Date: Wed, 05 Mar 2025 08:44:18 GMT
Expires: Wed, 05 Mar 2025 08:44:18 GMT
Server: UploadServer
Vary: Origin, X-Origin
WWW-Authenticate: Bearer realm="https://accounts.google.com/"
X-GUploader-UploadID: AHMx-iEq39ZhxRxvpeC2l-KoRYXBCTaVn1Izb0irGyAZ_0ObHFo9Lj7AAMDEEaRhO1x4y6MZ
-- headers end --
-- body start --
<streaming body>
-- body end --
total round trip time (request+response): 0.056 secs
---- response end ----
----------------------
DEBUG: Retrying download from byte 858950157 after exception: <class 'apitools.base.py.exceptions.TransferRetryError'>. Trace: <traceback object at 0x7bea7acf96c0>
Traceback (most recent call last):
File "/snap/google-cloud-cli/311/platform/bundledpythonunix/lib/python3.12/multiprocessing/queues.py", line 264, in _feed
obj = _ForkingPickler.dumps(obj)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/snap/google-cloud-cli/311/platform/bundledpythonunix/lib/python3.12/multiprocessing/reduction.py", line 51, in dumps
cls(buf, protocol).dump(obj)
TypeError: cannot pickle 'traceback' object
⠼=======================279.2GiB | 3.0MiB/s
==== request start ====
uri: https://storage.googleapis.com/download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288...
method: GET
== headers start ==
b'content-length': b'0'
b'range': b'bytes=214737667-429474927'
b'user-agent': b'google-cloud-sdk gcloud/512.0.0 command/gcloud.storage.cp invocation-id/0afba3139ca14d2298f918df7890a412 environment/None environment-version/None client-os/LINUX client-os-ver/6.8.0 client-pltf-arch/x86_64 interactive/False from-script/False python/3.12.8 term/xterm-256color (Linux 6.8.0-52-generic)'
== headers end ==
== body start ==

== body end ==
==== request end ====
DEBUG: https://storage.googleapis.com:443 "GET /download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288db25/o/20250218T172148Z%2FResource:%201867897127803802125%2Ftakeout-20250218T172150Z-263.zip?generation=1739901296033613&alt=media HTTP/11" 401 176
DEBUG: Skipping response_handler as response is invalid.
---- response start ----
status: 401
-- headers start --
Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
Cache-Control: private, max-age=0
Content-Length: 176
Content-Type: text/html; charset=UTF-8
Date: Wed, 05 Mar 2025 08:44:22 GMT
Expires: Wed, 05 Mar 2025 08:44:22 GMT
Server: UploadServer
Vary: Origin, X-Origin
WWW-Authenticate: Bearer realm="https://accounts.google.com/"
X-GUploader-UploadID: AHMx-iFBwuJaZ-mIBHRBj8NDW1uLF-xiaGcyDsp4Kph31SY2sO79svGkTFnFU8gY7LjT43JI
-- headers end --
-- body start --
<streaming body>
-- body end --
total round trip time (request+response): 0.053 secs
---- response end ----
----------------------
DEBUG: Retrying download from byte 214737667 after exception: <class 'apitools.base.py.exceptions.TransferRetryError'>. Trace: <traceback object at 0x7bea7ad0c240>
Traceback (most recent call last):
File "/snap/google-cloud-cli/311/platform/bundledpythonunix/lib/python3.12/multiprocessing/queues.py", line 264, in _feed
obj = _ForkingPickler.dumps(obj)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/snap/google-cloud-cli/311/platform/bundledpythonunix/lib/python3.12/multiprocessing/reduction.py", line 51, in dumps
cls(buf, protocol).dump(obj)
TypeError: cannot pickle 'traceback' object
⠼=======================279.2GiB | 3.0MiB/s
==== request start ====
uri: https://storage.googleapis.com/download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288...
method: GET
== headers start ==
b'content-length': b'0'
b'range': b'bytes=644212845-858949855'
b'user-agent': b'google-cloud-sdk gcloud/512.0.0 command/gcloud.storage.cp invocation-id/0afba3139ca14d2298f918df7890a412 environment/None environment-version/None client-os/LINUX client-os-ver/6.8.0 client-pltf-arch/x86_64 interactive/False from-script/False python/3.12.8 term/xterm-256color (Linux 6.8.0-52-generic)'
== headers end ==
== body start ==

== body end ==
==== request end ====
DEBUG: https://storage.googleapis.com:443 "GET /download/storage/v1/b/takeout-export-702211d7-1df7-4aa8-b015-92a41288db25/o/20250218T172148Z%2FResource:%201867897127803802125%2Ftakeout-20250218T172150Z-263.zip?generation=1739901296033613&alt=media HTTP/11" 401 176
DEBUG: Skipping response_handler as response is invalid.
---- response start ----
status: 401
-- headers start --
Alt-Svc: h3=":443"; ma=2592000,h3-29=":443"; ma=2592000
Cache-Control: private, max-age=0
Content-Length: 176
Content-Type: text/html; charset=UTF-8
Date: Wed, 05 Mar 2025 08:44:43 GMT
Expires: Wed, 05 Mar 2025 08:44:43 GMT
Server: UploadServer
Vary: Origin, X-Origin
WWW-Authenticate: Bearer realm="https://accounts.google.com/"
X-GUploader-UploadID: AHMx-iGgVPjQooYcUkyfIQu_C_JvWYsUKWuxze88ROX10Gtc5nZI2rKWKED0wPZGvwFcoyev
-- headers end --
-- body start --
<streaming body>
-- body end --
total round trip time (request+response): 0.058 secs
---- response end ----
----------------------
DEBUG: Retrying download from byte 644212845 after exception: <class 'apitools.base.py.exceptions.TransferRetryError'>. Trace: <traceback object at 0x7bea7ad02d80>
Traceback (most recent call last):
File "/snap/google-cloud-cli/311/platform/bundledpythonunix/lib/python3.12/multiprocessing/queues.py", line 264, in _feed
obj = _ForkingPickler.dumps(obj)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/snap/google-cloud-cli/311/platform/bundledpythonunix/lib/python3.12/multiprocessing/reduction.py", line 51, in dumps
cls(buf, protocol).dump(obj)
TypeError: cannot pickle 'traceback' object
⠼^Completed files 142 | 279.2GiB | 3.0MiB/s

Solved Solved
1 6 427
1 ACCEPTED SOLUTION

So! After countless retrying, and with the help of @DarwinVinoth, I manage to download the whole content of my Google Takeout Bucket : 1.2 TB over a 40 Mbps bandwith connection, so ±70 hours of download time.

Unfortunately, Google Cloud does not seem to be configured to have access that long, even with the different tricks provided by @DarwinVinoth. That's a shame because I think that a lot of my folks do have a "low speed internet connection". Here in Quebec 50Mbps Down / 10 Mbps Up is considered has highspeed internet when you are not in urban centre.

Nevertheless, I will write exactly what I did in the hope that it serve somebody in the future.

Basically, the trick is to use "storage rsync" instead of "storage cp" to be able to resume downloads after the connection drops, and to run a cron job to keep the connection alive as long as possible (24 hours max in my experience). 

I'm not sure all the commands below are necessary, please comment to improve the following how-to.

---How to download large amount of data exported via Google Workspace Takeout via the Google Cloud Bucket---

  1. Start the Google Takeout export in Google Workspace Admin
  2. Get your Google Cloud Bucket link to download the data when the export is finished
  3. Install google-cloud-cli for linux (snap package or else, info from Google Workspace Admin Help - Export all your organization's data)
  4. Then we need to run some commands :

1. Open your terminal

2. Go to the folder where you want to dump the data

3. Authenticate with google-cloud-cli auth login command

 

gcloud auth login

 

This will give you access to the Google Cloud Bucket with google-cloud-cli

4. Authenticate with auth application-default login

 

gloud auth application-default login

 

5. Start the data dump with verbose mode activated for feedback during the operation.
Note that gs://takeout-export-**** must be replaced by the provided google cloud bucket link.
Also note that the "." at the end indicate to dump the data in the active folder. It could be replaced by any folder like /media/DATA or else.
Note the usage of "rsync" instead of "cp"

 

gcloud storage rsync --continue-on-error --recursive --log-http --verbosity=debug   "gs://takeout-export-***-***-***-***-***"   .

 

 6. In another terminal window, start the cron job to keep the connection alive

 

while true; do gcloud auth print-access-token > token.txt; sleep 3000 # Refresh every 50 minutes

 

 7. Monitor the operation, especially the #6 print-access-token job.
If you ever see 

 

Reauthentication required.

 

You need to run the whole operation again from the start. To kill any pending jobs, press CTRL+C to kill the running command and restart from the authentication. Usually, the files will be able to resume from where they started.

8. Hopefully, after a long long time (70 hours for me!), you downloaded the whole content of your Google Takeout Cloud Bucket!

Ho, by the way, Google Devs, if you are somewhat listening to this, why not providing a simple tool to download something that big as a Google Takeout Bucket? Or a simple interface to stay logged into that job and be able to download as long as it take, like few days?

Maybe I'm getting old, but downloading during few days large files was something I did back in the 2000s 😉

I wish you the best luck!

View solution in original post

6 REPLIES 6

It looks like your authentication token is expiring during the rsync process.

By default, authentication tokens are valid for 60 minutes. If your rsync operation takes longer than an hour, consider the following:

  • Reduce the number of files in each sync operation by splitting the source into multiple folders and syncing them individually.
  • Use gcloud auth application-default login to refresh authentication before starting the sync.

Let me know if you need further guidance.

Hi @DarwinVinoth !

That's what I was concluding this morning, that it might be the auth process. Would there be any way to make the auth token last for 48-72 hours ? I have limited internet speed and would want to let the operation run by itself!

I'll check how to separate the Google Takeout Bucket, I'm not sure I can because I don't actually have a Google Cloud active subscription. The bucket was created by Google Workspace Takekout process...

Conclusion : downloading all your data is very complicated with Google 😡!

I'll keep you posted, thanks for the help!

Automating Token Renewal (For OAuth Authentication):

Since you can't extend the access token duration, you can automate refreshing the token every hour:

a) Generate an OAuth refresh token:

gcloud auth application-default login --update-adc

b) Automate token renewal every hour:

Create a cron job or script:


#!/bin/bash
while true; do
gcloud auth print-access-token > token.txt
sleep 3600 # Refresh every hour
done

So, unfortunately 

gcloud auth application-default login --update-adc

returns:

ERROR: (gcloud.auth.application-default.login) unrecognized arguments: --update-adc
To search the help text of gcloud commands, run:
gcloud help -- SEARCH_TERMS

Here's what I did, but I'm not sure it will work!

  1. gcloud auth application-default login
    returned
    Credentials saved to file: [/home/USER/.config/gcloud/application_default_credentials.json]
    These credentials will be used by any library that requests Application Default Credentials (ADC).
  2. I had to run
    gcloud auth login
    because running rsync dry returned
    DEBUG: (gcloud.storage.rsync) You do not currently have an active account selected.
  3. Then I could run
    gcloud auth print-access-token > token.txt
    which did write the access token in the newly created token.txt file
  4. I did start the cron job you provided
  5. Did start the gcloud storage rsync job again

Will see if that works!

So! After countless retrying, and with the help of @DarwinVinoth, I manage to download the whole content of my Google Takeout Bucket : 1.2 TB over a 40 Mbps bandwith connection, so ±70 hours of download time.

Unfortunately, Google Cloud does not seem to be configured to have access that long, even with the different tricks provided by @DarwinVinoth. That's a shame because I think that a lot of my folks do have a "low speed internet connection". Here in Quebec 50Mbps Down / 10 Mbps Up is considered has highspeed internet when you are not in urban centre.

Nevertheless, I will write exactly what I did in the hope that it serve somebody in the future.

Basically, the trick is to use "storage rsync" instead of "storage cp" to be able to resume downloads after the connection drops, and to run a cron job to keep the connection alive as long as possible (24 hours max in my experience). 

I'm not sure all the commands below are necessary, please comment to improve the following how-to.

---How to download large amount of data exported via Google Workspace Takeout via the Google Cloud Bucket---

  1. Start the Google Takeout export in Google Workspace Admin
  2. Get your Google Cloud Bucket link to download the data when the export is finished
  3. Install google-cloud-cli for linux (snap package or else, info from Google Workspace Admin Help - Export all your organization's data)
  4. Then we need to run some commands :

1. Open your terminal

2. Go to the folder where you want to dump the data

3. Authenticate with google-cloud-cli auth login command

 

gcloud auth login

 

This will give you access to the Google Cloud Bucket with google-cloud-cli

4. Authenticate with auth application-default login

 

gloud auth application-default login

 

5. Start the data dump with verbose mode activated for feedback during the operation.
Note that gs://takeout-export-**** must be replaced by the provided google cloud bucket link.
Also note that the "." at the end indicate to dump the data in the active folder. It could be replaced by any folder like /media/DATA or else.
Note the usage of "rsync" instead of "cp"

 

gcloud storage rsync --continue-on-error --recursive --log-http --verbosity=debug   "gs://takeout-export-***-***-***-***-***"   .

 

 6. In another terminal window, start the cron job to keep the connection alive

 

while true; do gcloud auth print-access-token > token.txt; sleep 3000 # Refresh every 50 minutes

 

 7. Monitor the operation, especially the #6 print-access-token job.
If you ever see 

 

Reauthentication required.

 

You need to run the whole operation again from the start. To kill any pending jobs, press CTRL+C to kill the running command and restart from the authentication. Usually, the files will be able to resume from where they started.

8. Hopefully, after a long long time (70 hours for me!), you downloaded the whole content of your Google Takeout Cloud Bucket!

Ho, by the way, Google Devs, if you are somewhat listening to this, why not providing a simple tool to download something that big as a Google Takeout Bucket? Or a simple interface to stay logged into that job and be able to download as long as it take, like few days?

Maybe I'm getting old, but downloading during few days large files was something I did back in the 2000s 😉

I wish you the best luck!

I'm glad we were able to solve this issue. Thank you for sharing such a detailed and practical walkthrough. @JonathanPineaul  Thank you for the mention. 

Your steps highlight key challenges—like maintaining long-term authentication and handling intermittent connectivity—which are critical when downloading large volumes of data over a slow connection.

 I appreciate your collaboration and look forward to your further contributions, which will help us make GCP  more resilient. 

Thanks, 
Darwin Vinoth.
Linkedin 

Top Solution Authors