Rule named 'NOT NULL' not found for the user_id column in the data quality task

[alajangi]

Hi Experts,

I am getting the following message while running "check my progress" "Challenge Lab" Build a data mesh with dataplex, but the task is succeeded,

Rule named 'NOT NULL' not found for the user_id column in the data quality task. Please re-create the task including this rule as mentioned in the instructions,

No clue what I am doing wrong, appreciate your help,

below is my specifications file,

metadata_registry_defaults:
dataplex:
projects: Project ID
locations: Region
lakes: sales-lake
zones: raw-customer-zone
row_filters:
NONE:
filter_sql_expr: |-
True
INTERNATIONAL_ITEMS:
filter_sql_expr: |-
REGEXP_CONTAINS(item_id, 'INTNL')
rule_dimensions:
- consistency
- correctness
- duplication
- completeness
- conformance
- integrity
- timeliness
- accuracy
rules:
NOT_NULL:
rule_type: NOT_NULL
dimension: completeness
rule_bindings:
user_id:
entity_uri: bigquery://projects/qwiklabs-gcp-04-121f9ea41f1b/datasets/customer_orders/tables/ordered_items
column_id: user_id
row_filter_id: NONE
rule_ids:
- NOT_NULL
order_id:
entity_uri: bigquery://projects/qwiklabs-gcp-04-121f9ea41f1b/datasets/customer_orders/tables/ordered_items
column_id: order_id
row_filter_id: NONE
rule_ids:
- NOT_NULL

[matthewreader]

I'm having the same issue too.  I've tried renaming the rule to NOT_NULL, NOT NULL, "NOT NULL", and 'NOT NULL'.  Nothing works.  I'll follow-up if I finally get this working.

[rmsteja]

change zones value. zones: curated-customer-zone

[matthewreader]

You are an absolute life saver!  I've re-tried this lab a handful of times and always get stuck at the last step of this lab.  And, it's the last step of the last lab to complete the Build a Data Mesh with Dataplex module in the Data Engineer Learning Path.

I looked at my original YAML file and I was erroneously trying to perform the check on the raw zone, not the curated zone.

[AlexHeringer]

Hi experts.

I'm trying to finish the Build a Data Mesh with Dataplex: Challenge Lab.

I'm consistently receiving the same error, but im doing in the right zone: 
Rule named 'NOT NULL' not found for the user_id column in the data quality task. Please re-create the task including this rule as mentioned in the instructions.

Could anyone help me? I already tried to change the rule name to NOT_NULL, NOT NULL,NOT_NULL_1 & NOT_NULL_2 and it always persists with the same error.  

I've checked the zone, the project id... everything is ok. In fact, it produces a valid data quality result, but i don't know why it don't find the rule to user_id, even if it exists and the results are published on big query. 

Follow below the yaml I'm using. 

metadata_registry_defaults:
  dataplex:
    projects: qwiklabs-gcp-03-2106b87ca1ea
    locations: us-west1
    lake: Sales Lake
    zone: curated-customer-zone
row_filters:
  NONE:
    filter_sql_expr: |-
      True

rule_dimensions:
  - consistency
  - correctness
  - duplication
  - completeness
  - conformance
  - integrity
  - timeliness
  - accuracy
rules:
  NOT_NULL:
    rule_type: NOT_NULL
    dimension: completeness

rule_bindings:
  USER_ID:
    entity_uri: bigquery://projects/qwiklabs-gcp-03-2106b87ca1ea/datasets/customer_orders/tables/ordered_items
    column_id: user_id
    row_filter_id: NONE
    rule_ids:
      - NOT_NULL
  ORDER_ID:
    entity_uri: bigquery://projects/qwiklabs-gcp-03-2106b87ca1ea/datasets/customer_orders/tables/ordered_items
    column_id: order_id
    row_filter_id: NONE
    rule_ids:
      - NOT_NULL

[Nikka]

Maybe lakes: sales-lake