Cannot update incremental table due to EXECUTE IMMEDIATE procedure

[toyoshi]

Does anyone have same issue and know solution for this?

• I get this message when I execute an incremental type sqlx file:  "reason:"invalidQuery" location:"query" message:"Syntax error: Illegal escape sequence: \\. at [144:44]": invalid argument"
• I executed this sqlx file almost every day but I had never gotten this error until yesterday. (And I don't make any changes on since then)
• I found that the error occurs inside EXECUTE IMMEDIATE procedure, which doesn't exist in my sqlx file but in "Query" log generated after execution. So I think it has something to do with some updates on dataform yesterday.
• I don't get this error message when executing it with "Run with full refresh". And also I found that EXECUTE IMMEDIATE is not used for "Run with full refresh". So for sure there is something wrong with this procedure.

Dataform version : 2.6.0

[benjamin_yakuto]

Hi Toyoshi, 

I am also having the same issue and haven't been able to find a solution. I've raised issue #1514 on GitHub, so hopefully we'll hear back soon. 

[toyoshi]

Hello

Thanks for raising issue. Now I can produce the bug with this simple example.

config {
    type: "incremental"
    , schema: "dp_stage_dev"
}

select
    current_timestamp() as event_timestamp
    , regexp_extract("test\?text\?test", r"\?.*\?") as text_col

If you run the code with "Run with full refresh", no errors. But without it you get error.
Apparently one of error triggers is to meet the following conditions.
- use raw string (r"...") for regexp-function's argument
- use escape for the raw string (e.g. r"...\...")

I also found some other triggers but this is one of the most critical one...

[lewish]

Just to update you that we are aware of the issue and are currently working on rolling out a fix for this

[dmytro2023]

@lewish Could you provide an estimate for this fix? Thank you!

[psandmann]

hi @lewish Do you have any updates? Thank you for your help.