DataProc error - Component: PRESTO not available Please choose the appropriate image version

[davorceman]

Hello,

I'm trying to deploy presto with support for delta lake.

Latest image which is currently 2.0.51-debian10 has Presto 340 version.

I checked release notes here
https://cloud.google.com/dataproc/docs/release-notes

and I see that image versions

2.1.0-RC2-debian11
2.1.0-RC2-rocky8
2.1.0-RC2-ubuntu20

have Presto 376

But if I try to deploy that Image, i'm getting error from the Subject of this thread.

In documentation
https://cloud.google.com/dataproc/docs/concepts/versioning/dataproc-release-2.1
I see that Presto is not mentioned at all for release 2.1

Could you please direct me how to run Presto 376 on DataProc?

[ricconoel]

It seems that you were able to use Presto based from your other question.

[davorceman]

Hello,

thank you for your response.

Sorry if I was not asked question clearly.

That from question was with the "latest"  2.0.51-debian10 image, where Presto is version 340 and I was able to install it. But that version is old and does not support delta lake. 

In release notes you can see that image version 2.1.0-RC2-debian11 has Prest 376 but when I try to use it, I'm getting error from the subject. That old Presto version currently blocking me to finishing current project I'm working on.

[davorceman]

Hello @ricconoel 

did you find a time to check this one?

Here is example how to run it

gcloud beta dataproc clusters create dev-with-presto  \
 --project=<your project>\
 --subnet <your subnet or use default one> \
 --tags <your tag for firewall rule to allow communication between nodes, or just use default vpc> \
 --region=europe-west1 \
 --num-workers=2 \
 --scopes=cloud-platform \
 --optional-components=PRESTO \
 --image-version=2.0.51-debian10 \
 --enable-component-gateway \
 --properties=presto-catalog:prodhive.connector.name=hive,presto-catalog:prodhive.hive.metastore.uri=thrift://10.167.64.19:9083

 I'm getting error

ERROR: (gcloud.beta.dataproc.clusters.create) FAILED_PRECONDITION: Feature 'Component: PRESTO' not available on cluster 'dev-with-presto'. Please choose the appropriate image version, or contact support if you have any questions  

 As I mentioned above, we need never Presto version which is announced announced in Release Notes. Currently old Presto is blocker for moving forward with our project.