spark-on-k8s-operator

[pablo_sweepr]

I was using the Spark Operator for Kubernetes under https://googlecloudplatform.github.io/spark-on-k8s-operator and now it's missing, the url throws a 404.

Does anybody know why was this repo deleted or if it was moved? I've found about https://github.com/kubeflow/spark-operator but that still uses the old url when adding the helm repo

$ helm repo add spark-operator https://googlecloudplatform.github.io/spark-on-k8s-operator

Thanks in advance

[RonEtch]

Hi @pablo_sweepr 

Welcome to Google Cloud Community!

Unfortunately the said project is not actively supported as of the moment.

Alternatively, based on Apache Spark docs, it is publishing images such as apache/spark:3.5.1-scala2.12-java17-python3-r-ubuntu that can be used to rebuild by following kubeflow github instructions.

I hope this information is helpful.

If you need further assistance, you can always file a ticket on our support team.

[pablo_sweepr]

Ok Ron, thanks for your reply

[zevisert · Accepted solution]

Pablo, Ron's answer is a bit misleading. Spark-on-k8s-operator was donated to the kubeflow community, so it's being maintained by them now instead of Google. The github project you found is the correct location now, and the helm URL was just an artifact from the transition period. The helm chart locations are updated in the Readme there now. 

[pablo_sweepr]

Hey @zevisert, thanks for the heads up! That is good to know, I'll take a look.

Cheers