How to lazy load a model/EmbeddingFunction #1171
Replies: 1 comment
-
Its not really lazyloading, but internally most of the available embedding functions cache the model so it's only loaded once in memory per instance. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi team,
Just a QQ: is there way to lazy load a model that is used as
EmbeddingFunction
?More context: loading a sizable model into memory could take a couple seconds or more.
Just wondering if there is a way to lazy load a model when defining a LanceDB schema, e.g. the
Image
class below.Beta Was this translation helpful? Give feedback.
All reactions