Get hands-on experience with 20+ free Google Cloud products and $300 in free credit for new customers.

Gluten plugin for Dataproc Spark

Does Dataproc support the Gluten Spark plugin?
If so, does it appear on the dashboard or as a cli option?

0 1 83
1 REPLY 1

Hi @sumokiama

Welcome to the Google Cloud Community!

Currently, Google Cloud Dataproc does not have built-in, native support for the Gluten Spark plugin. However, it is possible to manually install and configure the Gluten plugin on Dataproc clusters.

For detailed instructions, please refer to the official Dataproc documentation. This documentation will provide you with insights on how to configure Spark with native libraries. For guidance on configuration and integration practices, you should also review Gluten's official documentation.

Was this helpful? If so, please accept this answer as “Solution”. If you need additional assistance, reply here within 2 business days and I’ll be happy to help.