w.r.t. this problem: We have an application that has a dependency DAG. To build the application we need to build the DAG in topological order. Each element in the DAG has its own Git repository with a cloudbuild.yaml file. How can we build the overall application?
one way to solve it is through cloud composer by creating a workflow that has cloud build as its steps. refer this:
create_build_from_repo_body: dict[str, Any] = {
"source": {"repo_source": {"repo_name": GCP_SOURCE_REPOSITORY_NAME, "branch_name": "master"}},
"steps": [{"name": "ubuntu", "args": ["echo", "Hello world"]}],
}
question: we have a complex cloudbuild whose config is stored in a cloudbuild.yaml file. how do we tell airflow or cloud composer to use the cloudbuild.yaml in the source repository instead of duplicating the steps in python code?
LinkedIn
Twitter
