Vertex AI - running pyspark in jupyter notebook

[logan_branson]

Hi,

I am currently converting some Alteryx workflows into pyspark and wanted to test the codes for debugging and results validation.

For the testing purpose, I've created a jupyter notebook instance in workbench, but the thing is I am not able to install pyspark in the vertex AI jupyter notebook.

I did a lot of searching as well but haven't got a good resource yet.

It will be really helpful if you could guide me.

Thanks