Is there any way that I can create and assign reservations(slots) to specific airflow dags within same project? Our project is shared by entire DE team. I want to check if I can reserve some bandwidth for our few crucial pipelines. Also, looking forward to understand more on better slot utilization.
The BigQuery Reservation API requires you to purchase commitments where you can create pools of slots called reservations.
Here is the documentation[1] you can follow to create slot reservations. Also, here is a documentation[2] about understanding slots.
[1] https://cloud.google.com/bigquery/docs/reservations-tasks
We already have reservations and projects under it. My ask is within a project can we assign dedicated slots for certain pipelines and not all under the same project.
Hey @Ronnie_thd were you able to find the info you were looking for in the resources @Poala_Tenorio shared?