Hi all,
I've been trying to connect to an Iceberg table that I created through a bigquery stored procedure. My goal is to perform CRUD operations using pyspark via dataproc serverless. To achieve this, I've been working on creating an interactive template to run spark in jupyterlab workbench.
Despite my efforts, I'm facing significant challenges in establishing this connection. The process has been more complicated than anticipated, and it's causing me a lot of stress. Has anyone successfully navigated this setup or can offer guidance on the best practices to follow? Any help or insights would be greatly appreciated.
LinkedIn
Twitter
