[MacOS] Enchanted app compatibility workaround for "HEAD /ollama/ HTTP/1.1" 405 Method Not Allowed

[rsik]

Bug Report

AugustDev/enchanted#64

Description

The Enchanted macos app is not seemingly compatible with open-webui, this is a workaround and maybe insight to a bug. I am not sure if this is the only app with this issue, but I wanted to take advantage of the easy auth with JWT. I serve multiple vlans and family members and servers, so this was a win for me; maybe it'll help someone.

I also have a non-typical set up because of a mac studio and docker cannot reach GPU on Apple Silicon. So this is the tldr setup:

User > Enchanted (or app) > router: HAProxy (multiple vlans) > caddy + open-webui/ollama docker > mac studio: caddy + ollama (* origins)

Despite the above, I have tried it directly to open-webui without HAProxy or base Caddyfile and error without workaround. This is the Caddyfile for caddy + open-webui/ollama docker part:

:443 {
    tls /etc/caddy/cert.pem /etc/caddy/key.pem

    # Rewrite / path HEAD requests to /ollama path HEAD requests
    @head {
        method HEAD
    }
    rewrite @head /ollama

    # Reverse proxy all other requests to the Docker container
    reverse_proxy open-webui:8080
}

I am not sure of the security implications of this yet, but wanted to note this finally worked after quite a bit of troubleshooting.

Bug Summary:
Enchanted requests "GET /ollama/api/tags HTTP/1.1" and follows up with a HEAD /ollama request to the base ollama API url, in this case https://site.tld/ollama but greeted with "HEAD /ollama/ HTTP/1.1" 405 Method Not Allowed and Enchanted cannot "reach" the server.

Steps to Reproduce:

1. Set Enchanted base Ollama URL and token to open-webui/ollama and the token
2. docker compose logs and see error

Expected Behavior:
Send request and "HEAD /ollama HTTP/1.1" 200 OK

Actual Behavior:
Send request and "HEAD /ollama/ HTTP/1.1" 405 Method Not Allowed

Environment

• Operating System: MacOS Sonoma 14.2.1

Reproduction Details

Confirmation:

• I have read and followed all the instructions provided in the README.md.
• I am on the latest version of both Open WebUI and Ollama.
• I have included the browser console logs.
• I have included the Docker container logs.
  ^relevant ones posted above

Logs and Screenshots

Installation Method

Docker + separate ollama API

Additional Information

See description.

[tjbck]

Just added /ollama route to our dev branch, let us know if that fixes the issue!

[rsik]

Yes! Confirmed that works, commented out my caddy change. Thanks ✅

Caddyfile

:443 {
    tls /etc/caddy/cert.pem /etc/caddy/key.pem

    # Rewrite / path HEAD requests to /ollama path HEAD requests
    # @head {
    #    method HEAD
    # }
    # rewrite @head /ollama

    # Reverse proxy all other requests to the Docker container
    reverse_proxy open-webui:8080
}

Log

open-webui  | INFO:apps.ollama.main:get_all_models()
open-webui  | INFO:apps.ollama.main:get_all_models()
open-webui  | INFO:     10.x.x.1:0 - "GET /ollama/api/tags HTTP/1.1" 200 OK
open-webui  | INFO:     10.x.x.1:0 - "HEAD /ollama/ HTTP/1.1" 200 OK
open-webui  | INFO:apps.ollama.main:url: https://x.x.x.x
open-webui  | INFO:     10.x.x.1:0 - "POST /ollama/api/chat HTTP/1.1" 200 OK
open-webui  | INFO:     10.x.x.1:0 - "HEAD /ollama/ HTTP/1.1" 200 OK

[arsaboo]

@rsik what end point did you add in Enchanted for this to work and authenticate?