Moving (or copying) doc processors under a single project

[sivramk]

Hello, we started exploring Doc AI by trying multiple processors under several projects. We are now consolidating them into dev, test and production projects, each with a version of the processors.

Our goal is to first train the processors in the test project and then copy/move them into the production project.

How can we copy over processors from one project to another? We are unable to find any documentation that would help us accomplish this.

[kvandres]

Good day @sivramk,

Welcome to Google Cloud Community!

You can try importing a processor version using Document AI Workbench to a different project. The destination project is where you will import the processor version while the source project is where the processor version resides. There are multiple requirements for this, you can check the following: 

1. Processor types and schemas must match.
2. Destination processer must be enabled and it can have existing versions/datasets.
3. The version of the source processor must be in the following states: Deployed, Deploying, Undeployed and Undeploying. 

In order to avoid permission errors, you must add a Document AI Editor permission to DocumentAI Service Agent. 

You can check this documentation to learn more: https://cloud.google.com/document-ai/docs/manage-processor-versions#import

Hope this helps!

[ander_merketegi]

Hi! I am trying to move one whole custom processor from dev project into production, but the only option I currently see available is to create a new custom project in prod environment, copy the full schema manually and then finally import the processor version from dev project.
Taking into account that our schemas are pretty large and that this would imply a considerable task of re-working, isn't there any way to directly move a processor from one project to another and avoid all that re-working?

Thank you!

[Expertopinionsa]

Hi,

You can copy or move processors from one project to another in Doc AI, you can use the Google Cloud Console or the Cloud SDK command-line tools. To copy processors from one project to another in Doc AI, export the processor from the source project using gcloud doc-ai processors export, and then import it into the target project using gcloud doc-ai processors import. This is how we work at Triotech Systems. 

[ander_merketegi]

Hi! I am trying to move one whole custom processor from dev project into production, but the only option I currently see available is to create a new custom project in prod environment, copy the full schema manually and then finally import the processor version from dev project.
Taking into account that out schemas are pretty large and that this would imply a considerable task of re-working, does your solution mean that we can directly move a processor from one project to another without having to copy all the schema again?

Thank you!

[Expertopinionsa]

Hi @ander_merketegi 

Thank you for reaching out. Fortunately, the process I mentioned can indeed help you move a custom processor from one project to another without manually copying the full schema.

When using the gcloud doc-ai processors export command, it exports not only the processor configuration but also the associated schema. This means you won't have to recreate the entire schema manually in the production project. The export command packages everything you need into a format that can be easily imported into another project.

Here's a step-by-step guide to clarify:

Export the processor from the development project:

gcloud doc-ai processors export PROCESSOR_ID --location=LOCATION --project=SOURCE_PROJECT > processor_export.json

Import the processor into the production project:

gcloud doc-ai processors import processor_export.json --location=LOCATION --project=TARGET_PROJECT

This way, you can move your custom processor, including its schema, from the development project to the production project. It should save you from the manual effort of recreating the entire schema. Thnks!

[ander_merketegi]

Hi @Expertopinionsa 

Thanks a lot for the response. I will try to follow the steps you defined.

[edevena]

I am afraid that I get a "invalid choice" answer:

ERROR: (gcloud) Invalid choice: 'doc-ai'.
Maybe you meant:
gcloud ai custom-jobs
gcloud ai endpoints
gcloud ai hp-tuning-jobs
gcloud ai index-endpoints
gcloud ai indexes
gcloud ai model-monitoring-jobs
gcloud ai models
gcloud ai operations
gcloud ai tensorboards

do I need to install a gcloud component ?