Pipeline provisioning status takes too long

[joao_probe]

Hi,

        I'm using CDF with ephemeral cluster on dataproc. The machine has this typology:

Master Machine Type:e2, Number of masters:1,Master Cores:2,Master Memory (GB):8,Master Disk Size (GB):1000,Worker Cores:2,Worker Memory (GB):8,Worker Disk Size (GB):200,Worker Machine Type:e2

          Even with a simple pipeline it takes ate least 3-5 minutes to provisioning...
          Could be the master core and memory?

Thank you
        

[joao_probe · Accepted solution]

I solved this issue by creating a new compute profile, upgrading the machine type from E2 to N2, and increasing the master memory to 16GB .