Dataform - Cannot create workspace

[ikercb]

Hello!
I'm migrating my project from Dataform Legacy to GCP and found out that I cannot create a workspace. I got the following 400 error:

"Retrieving remote files took too long; repository or diff is too large."

However, making a release configuration or a workflow works without problems. Any advice on how to troubleshoot this?

[kvandres]

Good day @ikercb,

Welcome to Google Cloud Community!

You are encountering this error due to the limits of Dataform compilation resources, by default, there is a usage limit to the CPU time usage, Maximum heap memory, maximum number of actions per repository compilation, etc. you can check this link for more information: https://cloud.google.com/dataform/docs/quotas#compilation_resources_limits
It is recommended that you split the repositories if you are encountering compilation timeout on workspace, you can check this link for more information on how to split repositories: https://cloud.google.com/dataform/docs/splitting-repositories

This is also a known issue, you can check this issue tracker for more information: https://issuetracker.google.com/issues/277791311

Hope this helps!

[ikercb]

Hi @kvandres ,

Thank you very much for your answer. I'm not sure if we refer to the same problem. I am able to make a release configuration using my Github repository and compile it. That process never failed. However, I am unable to open the repository in a workspace to modify it. How both actions differ?