🎃[Provider Request]: Implement Milvus as an Vector DB

[shabbyjoon]

Description

A Vector Database provider is designed to facilitate nearest-neighbor lookups.

Milvus is a popular open-source vector database that stores, indexes, and manages vector embeddings.

Featureform supports vector databases like Pinecone, Redis, and Weaviate.

In Featureform, Vector DBs share several similarities with an inference store but are distinguished by their support for the client.nearest API. Configuration is typically done when registering an embedding associated with an entity. This setup enables efficient retrieval of nearest neighbors based on feature vectors.

Current Behavior

No response

Desired Behavior

Implement Milvus as a vector database so that it can be registered as a provider in Featureform.

Benefits

With Milvus provider support, users can manage and version their ML embeddings with Featureform while leveraging Milvus's indexing, storage, and nearest neighbor lookups.

Possible Implementation

It should implement the https://github.com/featureform/featureform/blob/main/provider/online.go#L36 interface.

Look at https://github.com/featureform/featureform/blob/main/provider/pinecone.go for inspiration

Additional Context

No response

[Vishalk91-4]

@shabbyjoon, could you please assign this issue to me|

[error9098x]

I would like to work on this issue if possible.

[LuciAkirami]

Hey @shabbyjoon , can I work on this? Previously I have contributed on integrating Zilliz(Milvus Client) to an open source project, I think I can apply the same knowledge here.

[shabbyjoon]

Hi @LuciAkirami! We added a couple more Hacktoberfest tickets for technical contributions, you can check them out here: https://github.com/featureform/featureform/issues

Thanks again for your support! :)

[xiaofan-luan]

Hi @shabbyjoon

James from Milvus community here. glad to talk deeper about the integration and further collaborate and partenership
let me how we can connect ~

[xiaofan-luan]

And we'd like to the contribution if no one else volunteered