How to stop insertion of failed records while using Assertion in Dataform

[alokb12]

I am trying to prevent the insertion of failed records while creating table by using assertion in Data Form. I am able to get the failed status of the pipeline in the execution logs and also able to track those failed records in GBQ.

But facing issue for how we can block insertion of those failed records as well in the table/view which we are creating.

[kvandres]

Good day @alokb12,

Welcome to Google Cloud Community!

Please note that assertion is a data quality test query, it looks for rows that break one or more of the rules given in the query. The assertion fails if any rows are returned by the query. Views in BigQuery that contain compiled assertion queries are automatically created by Dataform. Dataform produces these views in an assertions schema where you can check the assertion results as specified in your dataform.json configuration file. You can check this link to learn more: https://cloud.google.com/dataform/docs/assertions#about_assertions
You can remove the assertion option if you just want to create a table then insert it into bigquery. You can check this link for more information: 

Hope this helps!