Streaming Ingestion into Vertex AI Feature Store

[yufeng-zhang]

I'm just wondering if Vertex AI Feature Store supports streaming ingestions rather than just batch ingestion as seen here (https://cloud.google.com/vertex-ai/docs/featurestore/ingesting-batch). I figured that the presence of an online store (https://cloud.google.com/vertex-ai/pricing) means that there is a way to store the most up-to-date data and serve them.

Thanks!

[Eduardo_Ortiz]

Hello, at the moment it’s impossible to stream ingestion onto vertex, what you could do is to create a feature request.

If you find an issue or feature request that matches yours, star it.

If you don't see a matching issue or feature request, you can create one:

1. In the following tables of issue trackers, locate the product.
2. Click on the link to create a new issue.
3. In the form's Template drop-down menu, select either Defect report to report an issue or Feature request to request a feature.
4. In the Description text box, complete the rest of the form using the prompts provided.
5. Click Create.

[yufeng-zhang]

Hi Eduardo,

Thanks for the reply! Then could I check, what features would populate the online store then? Would it just be the latest features from any batch ingestion?

[yufeng-zhang]

Also, what is the online store based on? Is it a BigTable?

[Eduardo_Ortiz]

You would need to wait for the Release note since i don't really have an answer for your first question, secondly, the store is based on cloud storage if i'm not mistaken.