-
I see the new-added command as the following: #To run Open WebUI with Nvidia GPU support, use this command: This optional command confused me, because based on the introduction open_webui is just a webui of ollama running as server side, so theoretically it doesn't need the GPU. So my question is why there is this command, or when should I use this command to install open_webui? PLease help. |
Beta Was this translation helpful? Give feedback.
Replies: 2 comments 2 replies
-
Open WebUI has features that can take advantage of GPU acceleration. Right now these include:
|
Beta Was this translation helpful? Give feedback.
-
The proper answer as of now is that this is for advanced users, that wish to use larger embedding or STT models. Will we have more uses for GPU support in future? Definitely. |
Beta Was this translation helpful? Give feedback.
Open WebUI has features that can take advantage of GPU acceleration. Right now these include: