Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Models page doesn't list anything #2320

Open
greaterthanstar opened this issue May 13, 2024 · 4 comments
Open

Models page doesn't list anything #2320

greaterthanstar opened this issue May 13, 2024 · 4 comments
Labels
bug Something isn't working unconfirmed

Comments

@greaterthanstar
Copy link

LocalAI version:
LocalAI Version v2.15.0 (f69de3b)
I am running Unraid, using the Cuda 11 docker of LocalAI

Describe the bug
Click "Models" tab. Nothing is listed. It's worked before, so I know what it should look like. See: logs.

Expected behavior
A list of models is shown

Logs

4:49PM INF Success ip=10.0.0.172 latency=28.218659ms method=GET status=200 url=/
4:49PM INF Success ip=10.0.0.172 latency="25.955µs" method=GET status=200 url=/static/general.css
4:49PM DBG YAML errors: line 1: cannot unmarshal !!map into []*gallery.GalleryModel

wreckage of models: []
4:49PM INF Success ip=10.0.0.172 latency=178.998323ms method=GET status=200 url=/browse/

Additional context
Clearly, something is wrong with the parsing of a YAML file around the models page, preventing it from listing the models. Unfortunately I dont know where to dig for further info .

@greaterthanstar greaterthanstar added bug Something isn't working unconfirmed labels May 13, 2024
@greaterthanstar
Copy link
Author

Additional info:
GALLERIES is set to
[{"name":"localai", "url":"github:mudler/localai/gallery/index.yaml"},{"name":"skynet", "url":"github:go-skynet/model-gallery/index.yaml"}]
docker execution looks like

docker run
  -d
  --name='LocalAI'
  --net='bridge'
  -e TZ="America/Los_Angeles"
  -e HOST_OS="Unraid"
  -e HOST_HOSTNAME="niz"
  -e HOST_CONTAINERNAME="LocalAI"
  -e 'DEBUG'='true'
  -e 'GALLERIES'='[{"name":"localai", "url":"github:mudler/localai/gallery/index.yaml"},{"name":"skynet", "url":"github:go-skynet/model-gallery/index.yaml"}]'
  -l net.unraid.docker.managed=dockerman
  -l net.unraid.docker.webui='http://[IP]:[PORT:8080]/'
  -l net.unraid.docker.icon='https://github.com/go-skynet/LocalAI/assets/2420543/0966aa2a-166e-4f99-a3e5-6c915fc997dd?raw=1'
  -p '8080:8080/tcp'
  -v '/mnt/user/appdata/local_ai/models':'/build/models':'rw'
  --gpus=all 'localai/localai:latest-aio-gpu-nvidia-cuda-12'

5d49007cf02f0b8548e037867c6e3ee38a50f3dfb162b7ec2f6750e3cc819273

@greaterthanstar
Copy link
Author

I got it to work. I removed the default gallery from the GALLERIES string and just used the go-skynet one. So uh, the index.yaml of the default mudler gallery isn't parsing correctly. I noticed the files look different. the top of the mudler one looks like

---
### START parler-tts
- &parler-tts
  url: "github:mudler/LocalAI/gallery/parler-tts.yaml@master"
  name: parler-tts-mini-v0.1

with that triple dash thing. I don't know enough about yaml to know if that's legit or not. Maybe you guys were updating the format of the index.yaml file and your changes aren't in sync with the parser or something?

@mudler
Copy link
Owner

mudler commented May 14, 2024

@greaterthanstar all works here - what if you unset GALLERIES and let default take over?

@greaterthanstar
Copy link
Author

  • I completely removed the GALLERIES variable and ... it worked. showing your repo
  • I added back GALLERIES with the value [{"name":"localai", "url":"github:mudler/localai/gallery/index.yaml"},{"name":"skynet", "url":"github:go-skynet/model-gallery/index.yaml"}]
    and it failed again. (note that it does say "showing 2 repositories" at the top)
  • I stripped out the mudler repo and it worked, showing 1 repo (skynet)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working unconfirmed
Projects
None yet
Development

No branches or pull requests

2 participants