Google Cloud Storage integration connector - get a list of objects in the bucket

[miketimchenko]

I use a task Connector in my integration what suppose to return a list of objects in the Cloud Storage bucket.
My current "filterClause" is "Bucket = 'bucket_01'". The task returns only 25 objects in my case but the bucket has more. Also, listEntitiesNextPageToken is empty. I have two questions: 1. how to filter objects? 2. how to handle the objects limit?

[anjalisoni3655]

Hello Mike,

To filter objects you can use the Name field in the Objects table. Name supports the '=,LIKE' comparisons. Eg;  Name = 'TestObject', Name LIKE 'Test%'

[shaaland]

The default page size is 25.  You can increase this as needed by setting the input variable "listEntitiesPageSize" to a larger number.  See the documentation page with this info here.  The current max message size is 10mb, so as long as your list results are less than that maximum, you can list everything in one page.

If your List results would be more than the page size, you should see a value in the "listEntitiesNextPageToken" variable.  Please note this requirement for the next page token from the same documentation page :

• Unless your table or dataset has a primary key, you must set the listEntitiesSortByColumns parameter to use listEntitiesPageToken.