Hi,
I want to run a PySpark stored procedure using a custom container image, but when I do, I receive the following error:
‘Job failed. Please check logs at EXECUTION DETAILS from the console or Cloud Logging.’
However, when I check the Execution Details, there is no information displayed.
I’ve set up the connection and service account with all the required permissions. The custom Docker image is uploaded to the Artifact Registry.
Initially, I received errors indicating that the user couldn’t pull the image due to insufficient permissions, but after fixing that, no further information regarding the error is displayed. I only get the following message: ‘Job failed. Please check logs at EXECUTION DETAILS from the console or Cloud Logging,’ with no information in the Execution Details.
Can someone help me?
Thanks in advance,