About alec_6b12

alec_6b12 · 08-30-2023

I have a 3GB parquet file in GCS I am trying to load into a BigQuery table. I see two errors related to the job on the console: Resources exceeded during query execution: The query could not be executed in the allotted memory. Peak usage: 101% of lim...

alec_6b12 · 07-17-2023

We are using the preview for Virtual PyPI repositories in Artifact Registry. Our setup is simplePrivate package repositoryProxy to PyPIVirtual PyPI repository that points to the two previous repositories as upstream resourcesThis worked flawlessly un...

alec_6b12 · 11-16-2022

We've started using google batch to test some ETL processes. 19 hours in it appeared to be shut down automatically. It's not clear to me what triggered this shutdown, other than it being in a GCE Managed Instance Group. There's no documentation on th...

alec_6b12 · 07-19-2023

Thank you for passing this information on!

alec_6b12 · 07-19-2023

Thank you. These steps were all performed, and the virtual repository was working previously.

alec_6b12 · 11-18-2022

The job is listed as failed. Okay, I finally found the reason in the logs (exit status 137) which implies the job ran OOM.

alec_6b12 · 11-17-2022

Sorry, I made it overcomplicated. My single instance batch job is stopping around 19 hours in. I see no evidence of errors, but I do see the above message in the logs that GCE is deleting the instance. Is this expected behavior? Can I get the job to ...

My Stats

BIKRAM-09's Bio

Badges alec_6b12 Earned

Recent Activity

Error loading 3GB parquet file from GCS to BigQuery

Virtual PyPI no longer finding private upstream packages

Google Batch instance group preemption or timeout

Re: Virtual PyPI no longer finding private upstream packages

Re: Virtual PyPI no longer finding private upstream packages

Re: Google Batch instance group preemption or timeout

Re: Google Batch instance group preemption or timeout