InsertLoadJob action Bigquery issue

[Davido5]

Hello ,

I set an integration about bigquery to execute InsertLoadJob action but it doesn't work.

I followed these instruction BigQuery  |  Integration Connectors  |  Google Cloud

But it seems that something is wrong on SourceURIS. Please help.

[DMulchandani]

The error message suggests that the Cloud Storage URI might not be in the correct format. To ensure proper formatting, please refer to the Cloud Storage URI guidelines at the following link:

Cloud Storage URI Format Guidelines

If the issue persists, request you to share the project ID and connection name for further troubleshooting.

[Davido21]

Thank you.

It works now.

I faced to another problem in this integration : When I execute my integration a message about missing input variables happen. I already add mapping task.

[gargrajesh]

You can ignore this warning for your use case. We can define input variables to an integration. Integration runners are prompted to provide the value of such variables at every run. More details here : 

https://cloud.google.com/application-integration/docs/variables#integration_var

[Davido21]

When I execute this integration my log shows this (No connectorOutputPayload) :

[gargrajesh]

Please verify if the filter query is correct as the results will be returned based on the filter. Here is the doc that talks about filter clause : https://cloud.google.com/application-integration/docs/connectors-task#filter 

[Davido21]

I already add the filterclause but it doesn't work (see the screenshot)

[gargrajesh]

I can see from your previous screenshot that you are trying to use LIKE operator. Please make sure to use Wildcard % if you are looking for a substring match. E.g to match "/firstname/lastname" you can specify the filter clause as :-
name LIKE '/firstname/last%' 

[Davido21]

It works well now. Thank you

I met another on the same integration: My bigquery table doesn't load data.

My task: 

Please help.

[salonijuneja]

Hi Davido21,
Looks like you are using FOR_EACH incorrectly, GET_PROPERTY("Name") function should have been called on obj1 (inside FOR_EACH) and not on FOR_EACH. Thus it is giving error. However, looking at your use case(create a string of Names with space separated values), it cannot be achieved using Data Mapper Task. We would recommend to use Data Transformer Task for the same:
Example of script to achieve the above use case and also trim extra whitespace at the end:

local f = import "functions";
local names = f.map(function(x) x.Name, f.extVar("ConnectorOutputPayload"));
{
"output": f.stripChars(f.foldl(function(a,b) a+" "+b, names, ""), " ")
}

Please note this is just an example, please use variable names according to your integration. More details on data transformer task with sample can be found here.