Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Error running transcriptions on M2 MacBook Pro #2275

Open
mynnx opened this issue May 8, 2024 · 1 comment
Open

Error running transcriptions on M2 MacBook Pro #2275

mynnx opened this issue May 8, 2024 · 1 comment
Labels
bug Something isn't working unconfirmed

Comments

@mynnx
Copy link

mynnx commented May 8, 2024 •
edited

LocalAI version:
6559ac1

Environment, CPU architecture, OS, and Version:
Darwin plompom 23.2.0 Darwin Kernel Version 23.2.0: Wed Nov 15 21:55:06 PST 2023; root:xnu-10002.61.3~2/RELEASE_ARM64_T6020 arm64
(2023 M2 MacBook Pro w/32GB RAM)

Describe the bug
Trying to run transcriptions using cURL or local-ai transcript crashes the Go process for some reason. An error occurs.

To Reproduce
Use any Whisper model and attempt to transcribe using LocalAI. I have succeeded in compiling whisper.cpp on this hardware and running transcriptions successfully on another project using the same input, so I know it's possible - but I'd love to do it over HTTP!

I have also succeeded in getting Llama3 models to respond to chat completion requests in LocalAI, so at least I know my LocalAI is setup and installed correctly.

Expected behavior
transcriptions

Logs

❯ ./local-ai transcript --model=whisper-1 ~/Development/whisper-wise/best-year-yet/audios/1T7NOeyeWUZiVhRFzaEJOI_ds4yk93XEe.wav --log-level=debug
11:13PM INF loading environment variables from file envFile=.env
11:13PM DBG Setting logging to debug
11:13PM INF Loading model 'ggml-small.en.bin' with backend whisper
11:13PM DBG Loading model in memory from file: /Users/mynnx/Development/whisper-wise/local-ai/LocalAI/models/ggml-small.en.bin
11:13PM DBG Loading Model ggml-small.en.bin with gRPC (file: /Users/mynnx/Development/whisper-wise/local-ai/LocalAI/models/ggml-small.en.bin) (backend: whisper): {backendString:whisper model:ggml-small.en.bin threads:1 assetDir:/tmp/localai/backend_data context:{emptyCtx:{}} gRPCOptions:0x140004b6000 externalBackends:map[] grpcAttempts:20 grpcAttemptsDelay:2 singleActiveBackend:false parallelRequests:false}
11:13PM DBG Loading GRPC Process: /tmp/localai/backend_data/backend-assets/grpc/whisper
11:13PM DBG GRPC Service for ggml-small.en.bin will be running at: '127.0.0.1:59431'
11:13PM DBG GRPC Service state dir: /var/folders/_q/c4f71pn54gvbxgty8t96z8x00000gn/T/go-processmanager3803593630
11:13PM DBG GRPC Service Started
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr 2024/05/07 23:13:32 gRPC Server listening at 127.0.0.1:59431
11:13PM DBG GRPC Service Ready
11:13PM DBG GRPC: Loading model with options: {state:{NoUnkeyedLiterals:{} DoNotCompare:[] DoNotCopy:[] atomicMessageInfo:<nil>} sizeCache:0 unknownFields:[] Model:ggml-small.en.bin ContextSize:0 Seed:0 NBatch:0 F16Memory:false MLock:false MMap:false VocabOnly:false LowVRAM:false Embeddings:false NUMA:false NGPULayers:0 MainGPU: TensorSplit: Threads:0 LibrarySearchPath: RopeFreqBase:0 RopeFreqScale:0 RMSNormEps:0 NGQA:0 ModelFile:/Users/mynnx/Development/whisper-wise/local-ai/LocalAI/models/ggml-small.en.bin Device: UseTriton:false ModelBaseName: UseFastTokenizer:false PipelineType: SchedulerType: CUDA:false CFGScale:0 IMG2IMG:false CLIPModel: CLIPSubfolder: CLIPSkip:0 ControlNet: Tokenizer: LoraBase: LoraAdapter: LoraScale:0 NoMulMatQ:false DraftModel: AudioPath: Quantization: GPUMemoryUtilization:0 TrustRemoteCode:false EnforceEager:false SwapSpace:0 MaxModelLen:0 TensorParallelSize:0 MMProj: RopeScaling: YarnExtFactor:0 YarnAttnFactor:0 YarnBetaFast:0 YarnBetaSlow:0 Type:}
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr whisper_init_from_file_with_params_no_state: loading model from '/Users/mynnx/Development/whisper-wise/local-ai/LocalAI/models/ggml-small.en.bin'
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr whisper_model_load: loading model
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr whisper_model_load: n_vocab       = 51864
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr whisper_model_load: n_audio_ctx   = 1500
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr whisper_model_load: n_audio_state = 768
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr whisper_model_load: n_audio_head  = 12
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr whisper_model_load: n_audio_layer = 12
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr whisper_model_load: n_text_ctx    = 448
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr whisper_model_load: n_text_state  = 768
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr whisper_model_load: n_text_head   = 12
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr whisper_model_load: n_text_layer  = 12
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr whisper_model_load: n_mels        = 80
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr whisper_model_load: ftype         = 1
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr whisper_model_load: qntvr         = 0
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr whisper_model_load: type          = 3 (small)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr whisper_model_load: adding 1607 extra tokens
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr whisper_model_load: n_langs       = 99
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr whisper_backend_init: using Metal backend
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr ggml_metal_init: allocating
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr ggml_metal_init: found device: Apple M2 Pro
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr ggml_metal_init: picking default device: Apple M2 Pro
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr ggml_metal_init: loading '/tmp/localai/backend_data/backend-assets/grpc/default.metallib'
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr ggml_metal_init: GPU name:   Apple M2 Pro
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr ggml_metal_init: GPU family: MTLGPUFamilyApple8  (1008)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr ggml_metal_init: GPU family: MTLGPUFamilyCommon3 (3003)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr ggml_metal_init: GPU family: MTLGPUFamilyMetal3  (5001)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr ggml_metal_init: simdgroup reduction support   = true
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr ggml_metal_init: simdgroup matrix mul. support = true
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr ggml_metal_init: hasUnifiedMemory              = true
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr ggml_metal_init: recommendedMaxWorkingSetSize  = 22906.50 MB
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr -[MTLComputePipelineDescriptorInternal setComputeFunction:withType:]:722: failed assertion `computeFunction must not be nil.'
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr SIGABRT: abort
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr PC=0x18c37a0dc m=0 sigcode=0
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr signal arrived during cgo execution
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr 
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr goroutine 19 gp=0x14000185500 m=0 mp=0x10303c8e0 [syscall]:
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.cgocall(0x102a1bf98, 0x140000c17e8)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/cgocall.go:157 +0x44 fp=0x140000c17b0 sp=0x140000c1770 pc=0x102616bf4
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr github.com/ggerganov/whisper.cpp/bindings/go._Cfunc_whisper_init_from_file_with_params(0x150804080, {0x1, 0x0, 0x0, 0x0, 0xffffffff, {0x0, 0x0}, 0x8000000})
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     _cgo_gotypes.go:517 +0x34 fp=0x140000c17e0 sp=0x140000c17b0 pc=0x102a0b9d4
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr github.com/ggerganov/whisper.cpp/bindings/go.Whisper_init({0x1400022c240?, 0x55?})
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /Users/mynnx/Development/whisper-wise/local-ai/LocalAI/sources/whisper.cpp/bindings/go/whisper.go:105 +0x9c fp=0x140000c1890 sp=0x140000c17e0 pc=0x102a0d01c
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr github.com/ggerganov/whisper.cpp/bindings/go/pkg/whisper.New({0x1400022c240, 0x55})
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /Users/mynnx/Development/whisper-wise/local-ai/LocalAI/sources/whisper.cpp/bindings/go/pkg/whisper/model.go:30 +0x4c fp=0x140000c18c0 sp=0x140000c1890 pc=0x102a1494c
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr main.(*Whisper).Load(0x1400000ed50, 0x6b?)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /Users/mynnx/Development/whisper-wise/local-ai/LocalAI/backend/go/transcribe/whisper.go:19 +0x2c fp=0x140000c18e0 sp=0x140000c18c0 pc=0x102a1ac9c
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr github.com/go-skynet/LocalAI/pkg/grpc.(*server).LoadModel(0x1400003b770, {0x102ca48c0?, 0x140000789d8?}, 0x14000261a00)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /Users/mynnx/Development/whisper-wise/local-ai/LocalAI/pkg/grpc/server.go:50 +0xb8 fp=0x140000c1990 sp=0x140000c18e0 pc=0x102a088a8
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr github.com/go-skynet/LocalAI/pkg/grpc/proto._Backend_LoadModel_Handler({0x102ca48c0, 0x1400003b770}, {0x102cd19e0, 0x1400022af00}, 0x14000258400, 0x0)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /Users/mynnx/Development/whisper-wise/local-ai/LocalAI/pkg/grpc/proto/backend_grpc.pb.go:352 +0x1c0 fp=0x140000c19e0 sp=0x140000c1990 pc=0x102a046c0
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr google.golang.org/grpc.(*Server).processUnaryRPC(0x140001e61e0, {0x102cd19e0, 0x1400022ae40}, {0x102cd4fa0, 0x140000b0ea0}, 0x14000252120, 0x140001fa450, 0x102feedf0, 0x0)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /Users/mynnx/go/pkg/mod/google.golang.org/grpc@v1.59.0/server.go:1343 +0xb40 fp=0x140000c1de0 sp=0x140000c19e0 pc=0x1029ed100
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr google.golang.org/grpc.(*Server).handleStream(0x140001e61e0, {0x102cd4fa0, 0x140000b0ea0}, 0x14000252120)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /Users/mynnx/go/pkg/mod/google.golang.org/grpc@v1.59.0/server.go:1737 +0x95c fp=0x140000c1f60 sp=0x140000c1de0 pc=0x1029f12dc
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr google.golang.org/grpc.(*Server).serveStreams.func1.1()
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /Users/mynnx/go/pkg/mod/google.golang.org/grpc@v1.59.0/server.go:986 +0x88 fp=0x140000c1fd0 sp=0x140000c1f60 pc=0x1029eb288
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.goexit({})
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/asm_arm64.s:1222 +0x4 fp=0x140000c1fd0 sp=0x140000c1fd0 pc=0x102680a04
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr created by google.golang.org/grpc.(*Server).serveStreams.func1 in goroutine 13
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /Users/mynnx/go/pkg/mod/google.golang.org/grpc@v1.59.0/server.go:997 +0x14c
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr 
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr goroutine 1 gp=0x140000021c0 m=nil [IO wait]:
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x8?)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/proc.go:402 +0xc8 fp=0x140001dbac0 sp=0x140001dbaa0 pc=0x10264cc18
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.netpollblock(0x140001dbb58?, 0x26eadd4?, 0x1?)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/netpoll.go:573 +0x158 fp=0x140001dbb00 sp=0x140001dbac0 pc=0x102646628
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr internal/poll.runtime_pollWait(0x1035c2770, 0x72)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/netpoll.go:345 +0xa0 fp=0x140001dbb30 sp=0x140001dbb00 pc=0x10267ac20
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr internal/poll.(*pollDesc).wait(0x1400019ad80?, 0x8?, 0x0)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/internal/poll/fd_poll_runtime.go:84 +0x28 fp=0x140001dbb60 sp=0x140001dbb30 pc=0x1026e6438
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr internal/poll.(*pollDesc).waitRead(...)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/internal/poll/fd_poll_runtime.go:89
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr internal/poll.(*FD).Accept(0x1400019ad80)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/internal/poll/fd_unix.go:611 +0x250 fp=0x140001dbc10 sp=0x140001dbb60 pc=0x1026eaec0
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr net.(*netFD).accept(0x1400019ad80)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/net/fd_unix.go:172 +0x28 fp=0x140001dbcd0 sp=0x140001dbc10 pc=0x102775d88
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr net.(*TCPListener).accept(0x140000885c0)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/net/tcpsock_posix.go:159 +0x28 fp=0x140001dbd00 sp=0x140001dbcd0 pc=0x10278bd58
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr net.(*TCPListener).Accept(0x140000885c0)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/net/tcpsock.go:327 +0x2c fp=0x140001dbd40 sp=0x140001dbd00 pc=0x10278afcc
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr google.golang.org/grpc.(*Server).Serve(0x140001e61e0, {0x102cd0f90, 0x140000885c0})
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /Users/mynnx/go/pkg/mod/google.golang.org/grpc@v1.59.0/server.go:852 +0x44c fp=0x140001dbe80 sp=0x140001dbd40 pc=0x1029e9f0c
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr github.com/go-skynet/LocalAI/pkg/grpc.StartServer({0x16d7f165d?, 0x140000202b0?}, {0x102cd7550, 0x1400000ed50})
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /Users/mynnx/Development/whisper-wise/local-ai/LocalAI/pkg/grpc/server.go:226 +0x150 fp=0x140001dbf10 sp=0x140001dbe80 pc=0x102a0aa30
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr main.main()
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /Users/mynnx/Development/whisper-wise/local-ai/LocalAI/backend/go/transcribe/main.go:18 +0x94 fp=0x140001dbf40 sp=0x140001dbf10 pc=0x102a1a0d4
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.main()
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/proc.go:271 +0x28c fp=0x140001dbfd0 sp=0x140001dbf40 pc=0x10264c7ec
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.goexit({})
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/asm_arm64.s:1222 +0x4 fp=0x140001dbfd0 sp=0x140001dbfd0 pc=0x102680a04
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr 
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr goroutine 2 gp=0x14000002c40 m=nil [force gc (idle)]:
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/proc.go:402 +0xc8 fp=0x14000066f90 sp=0x14000066f70 pc=0x10264cc18
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.goparkunlock(...)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/proc.go:408
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.forcegchelper()
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/proc.go:326 +0xb8 fp=0x14000066fd0 sp=0x14000066f90 pc=0x10264caa8
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.goexit({})
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/asm_arm64.s:1222 +0x4 fp=0x14000066fd0 sp=0x14000066fd0 pc=0x102680a04
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr created by runtime.init.6 in goroutine 1
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/proc.go:314 +0x24
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr 
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr goroutine 3 gp=0x14000003180 m=nil [GC sweep wait]:
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/proc.go:402 +0xc8 fp=0x14000067760 sp=0x14000067740 pc=0x10264cc18
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.goparkunlock(...)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/proc.go:408
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.bgsweep(0x140000320e0)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/mgcsweep.go:278 +0xa0 fp=0x140000677b0 sp=0x14000067760 pc=0x1026389f0
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.gcenable.gowrap1()
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/mgc.go:203 +0x28 fp=0x140000677d0 sp=0x140000677b0 pc=0x10262cbf8
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.goexit({})
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/asm_arm64.s:1222 +0x4 fp=0x140000677d0 sp=0x140000677d0 pc=0x102680a04
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr created by runtime.gcenable in goroutine 1
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/mgc.go:203 +0x6c
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr 
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr goroutine 4 gp=0x14000003340 m=nil [GC scavenge wait]:
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.gopark(0x140000320e0?, 0x102b93f60?, 0x1?, 0x0?, 0x14000003340?)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/proc.go:402 +0xc8 fp=0x14000067f60 sp=0x14000067f40 pc=0x10264cc18
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.goparkunlock(...)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/proc.go:408
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.(*scavengerState).park(0x10303b800)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/mgcscavenge.go:425 +0x5c fp=0x14000067f90 sp=0x14000067f60 pc=0x1026363dc
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.bgscavenge(0x140000320e0)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/mgcscavenge.go:653 +0x44 fp=0x14000067fb0 sp=0x14000067f90 pc=0x102636934
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.gcenable.gowrap2()
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/mgc.go:204 +0x28 fp=0x14000067fd0 sp=0x14000067fb0 pc=0x10262cb98
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.goexit({})
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/asm_arm64.s:1222 +0x4 fp=0x14000067fd0 sp=0x14000067fd0 pc=0x102680a04
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr created by runtime.gcenable in goroutine 1
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/mgc.go:204 +0xac
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr 
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr goroutine 5 gp=0x14000003c00 m=nil [finalizer wait]:
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.gopark(0x0?, 0x0?, 0xb8?, 0x65?, 0x10267beb4?)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/proc.go:402 +0xc8 fp=0x14000066580 sp=0x14000066560 pc=0x10264cc18
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.runfinq()
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/mfinal.go:194 +0x108 fp=0x140000667d0 sp=0x14000066580 pc=0x10262bcc8
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.goexit({})
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/asm_arm64.s:1222 +0x4 fp=0x140000667d0 sp=0x140000667d0 pc=0x102680a04
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr created by runtime.createfing in goroutine 1
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/mfinal.go:164 +0x80
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr 
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr goroutine 11 gp=0x14000185180 m=nil [select]:
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.gopark(0x1400030fef8?, 0x2?, 0x0?, 0x0?, 0x1400030fec4?)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/proc.go:402 +0xc8 fp=0x1400030fd70 sp=0x1400030fd50 pc=0x10264cc18
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.selectgo(0x1400030fef8, 0x1400030fec0, 0x1400030fed8?, 0x0, 0x1?, 0x1)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/select.go:327 +0x614 fp=0x1400030fe80 sp=0x1400030fd70 pc=0x10265f564
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr google.golang.org/grpc/internal/transport.(*controlBuffer).get(0x1400009ca00, 0x1)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /Users/mynnx/go/pkg/mod/google.golang.org/grpc@v1.59.0/internal/transport/controlbuf.go:418 +0x14c fp=0x1400030ff20 sp=0x1400030fe80 pc=0x10296a6ec
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr google.golang.org/grpc/internal/transport.(*loopyWriter).run(0x140001e8d90)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /Users/mynnx/go/pkg/mod/google.golang.org/grpc@v1.59.0/internal/transport/controlbuf.go:552 +0x7c fp=0x1400030ff80 sp=0x1400030ff20 pc=0x10296af5c
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr google.golang.org/grpc/internal/transport.NewServerTransport.func2()
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /Users/mynnx/go/pkg/mod/google.golang.org/grpc@v1.59.0/internal/transport/http2_server.go:336 +0xd8 fp=0x1400030ffd0 sp=0x1400030ff80 pc=0x10297f3a8
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.goexit({})
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/asm_arm64.s:1222 +0x4 fp=0x1400030ffd0 sp=0x1400030ffd0 pc=0x102680a04
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr created by google.golang.org/grpc/internal/transport.NewServerTransport in goroutine 10
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /Users/mynnx/go/pkg/mod/google.golang.org/grpc@v1.59.0/internal/transport/http2_server.go:333 +0x1414
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr 
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr goroutine 12 gp=0x14000185880 m=nil [select]:
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.gopark(0x14000316f28?, 0x4?, 0x88?, 0x6d?, 0x14000316ea8?)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/proc.go:402 +0xc8 fp=0x14000316d40 sp=0x14000316d20 pc=0x10264cc18
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.selectgo(0x14000316f28, 0x14000316ea0, 0x0?, 0x0, 0x0?, 0x1)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/select.go:327 +0x614 fp=0x14000316e50 sp=0x14000316d40 pc=0x10265f564
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr google.golang.org/grpc/internal/transport.(*http2Server).keepalive(0x140000b0ea0)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /Users/mynnx/go/pkg/mod/google.golang.org/grpc@v1.59.0/internal/transport/http2_server.go:1152 +0x174 fp=0x14000316fb0 sp=0x14000316e50 pc=0x1029859a4
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr google.golang.org/grpc/internal/transport.NewServerTransport.gowrap1()
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /Users/mynnx/go/pkg/mod/google.golang.org/grpc@v1.59.0/internal/transport/http2_server.go:339 +0x28 fp=0x14000316fd0 sp=0x14000316fb0 pc=0x10297f298
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.goexit({})
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/asm_arm64.s:1222 +0x4 fp=0x14000316fd0 sp=0x14000316fd0 pc=0x102680a04
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr created by google.golang.org/grpc/internal/transport.NewServerTransport in goroutine 10
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /Users/mynnx/go/pkg/mod/google.golang.org/grpc@v1.59.0/internal/transport/http2_server.go:339 +0x1454
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr 
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr goroutine 13 gp=0x14000185a40 m=nil [IO wait]:
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.gopark(0xffffffffffffffff?, 0xffffffffffffffff?, 0x23?, 0x0?, 0x1026cdf80?)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/proc.go:402 +0xc8 fp=0x1400007ea40 sp=0x1400007ea20 pc=0x10264cc18
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.netpollblock(0x0?, 0x0?, 0x0?)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/netpoll.go:573 +0x158 fp=0x1400007ea80 sp=0x1400007ea40 pc=0x102646628
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr internal/poll.runtime_pollWait(0x1035c2678, 0x72)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/netpoll.go:345 +0xa0 fp=0x1400007eab0 sp=0x1400007ea80 pc=0x10267ac20
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr internal/poll.(*pollDesc).wait(0x1400019af00?, 0x1400011a000?, 0x0)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/internal/poll/fd_poll_runtime.go:84 +0x28 fp=0x1400007eae0 sp=0x1400007eab0 pc=0x1026e6438
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr internal/poll.(*pollDesc).waitRead(...)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/internal/poll/fd_poll_runtime.go:89
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr internal/poll.(*FD).Read(0x1400019af00, {0x1400011a000, 0x8000, 0x8000})
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/internal/poll/fd_unix.go:164 +0x200 fp=0x1400007eb80 sp=0x1400007eae0 pc=0x1026e7780
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr net.(*netFD).Read(0x1400019af00, {0x1400011a000?, 0x1400007ebf8?, 0x10266c12c?})
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/net/fd_posix.go:55 +0x28 fp=0x1400007ebd0 sp=0x1400007eb80 pc=0x1027741a8
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr net.(*conn).Read(0x1400006a3e0, {0x1400011a000?, 0x1400007ecc8?, 0x10262041c?})
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/net/net.go:179 +0x34 fp=0x1400007ec20 sp=0x1400007ebd0 pc=0x1027835a4
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr net.(*TCPConn).Read(0x1400007ec78?, {0x1400011a000?, 0xa532c4bd5316?, 0x1400021ea80?})
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     <autogenerated>:1 +0x2c fp=0x1400007ec50 sp=0x1400007ec20 pc=0x10279454c
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr bufio.(*Reader).Read(0x14000045aa0, {0x14000186660, 0x9, 0x140001fa840?})
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/bufio/bufio.go:241 +0x1b4 fp=0x1400007ec90 sp=0x1400007ec50 pc=0x102734dd4
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr io.ReadAtLeast({0x102cce580, 0x14000045aa0}, {0x14000186660, 0x9, 0x9}, 0x9)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/io/io.go:335 +0xa0 fp=0x1400007ece0 sp=0x1400007ec90 pc=0x1026c4180
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr io.ReadFull(...)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/io/io.go:354
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr golang.org/x/net/http2.readFrameHeader({0x14000186660, 0x9, 0x102681900?}, {0x102cce580?, 0x14000045aa0?})
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /Users/mynnx/go/pkg/mod/golang.org/x/net@v0.24.0/http2/frame.go:237 +0x58 fp=0x1400007ed30 sp=0x1400007ece0 pc=0x1029575f8
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr golang.org/x/net/http2.(*Framer).ReadFrame(0x14000186620)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /Users/mynnx/go/pkg/mod/golang.org/x/net@v0.24.0/http2/frame.go:498 +0x78 fp=0x1400007ede0 sp=0x1400007ed30 pc=0x102957ce8
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr google.golang.org/grpc/internal/transport.(*http2Server).HandleStreams(0x140000b0ea0, 0x140001faa50)
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /Users/mynnx/go/pkg/mod/google.golang.org/grpc@v1.59.0/internal/transport/http2_server.go:636 +0x110 fp=0x1400007eef0 sp=0x1400007ede0 pc=0x102981e30
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr google.golang.org/grpc.(*Server).serveStreams(0x140001e61e0, {0x102cd4fa0, 0x140000b0ea0})
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /Users/mynnx/go/pkg/mod/google.golang.org/grpc@v1.59.0/server.go:979 +0x188 fp=0x1400007ef70 sp=0x1400007eef0 pc=0x1029eb028
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr google.golang.org/grpc.(*Server).handleRawConn.func1()
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /Users/mynnx/go/pkg/mod/google.golang.org/grpc@v1.59.0/server.go:920 +0x44 fp=0x1400007efd0 sp=0x1400007ef70 pc=0x1029ea914
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr runtime.goexit({})
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /opt/homebrew/Cellar/go/1.22.3/libexec/src/runtime/asm_arm64.s:1222 +0x4 fp=0x1400007efd0 sp=0x1400007efd0 pc=0x102680a04
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr created by google.golang.org/grpc.(*Server).handleRawConn in goroutine 10
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr     /Users/mynnx/go/pkg/mod/google.golang.org/grpc@v1.59.0/server.go:919 +0x150
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr 
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r0      0x0
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r1      0x0
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r2      0x0
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r3      0x0
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r4      0x73
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r5      0x2e
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r6      0x0
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r7      0x0
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r8      0x303fa79e02c0afdc
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r9      0x303fa79fe079bfdc
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r10     0xa
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r11     0x0
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r12     0x37
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r13     0x14a45c110
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r14     0x1000001e2ba85d9
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r15     0x1e2ba85d8
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r16     0x148
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r17     0x1ebc03340
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r18     0x0
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r19     0x6
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r20     0x1e2b91000
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r21     0x103
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r22     0x1e2b910e0
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r23     0xffffffffffffffff
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r24     0x1e1a0a000
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r25     0x1e1b71000
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r26     0x1966bfbd9
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r27     0x16d7f0bf0
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r28     0x102ba532c
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr r29     0x16d7f0730
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr lr      0x18c3b1cc0
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr sp      0x16d7f0710
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr pc      0x18c37a0dc
11:13PM DBG GRPC(ggml-small.en.bin-127.0.0.1:59431): stderr fault   0x18c37a0dc
11:13PM ERR unable to stop all grpc processes error="process does not exist"
local-ai: error: could not load model: rpc error: code = Unavailable desc = error reading from server: EOF

Additional context
@mynnx mynnx added bug Something isn't working unconfirmed labels May 8, 2024
@localai-bot
Copy link
Contributor

error reading from server: EOF

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working unconfirmed
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@mynnx @localai-bot