Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Failed to get LLM params: INVALID_ARGUMENT: LLM model file is null #5310 #5401

Open
yuimo opened this issue May 14, 2024 · 2 comments
Open

Failed to get LLM params: INVALID_ARGUMENT: LLM model file is null #5310 #5401

yuimo opened this issue May 14, 2024 · 2 comments
Assignees
@kuaashish
Labels
platform:android Issues with Android as Platform stale stat:awaiting response Waiting for user response task:LLM inference Issues related to MediaPipe LLM Inference Gen AI setup type:bug Bug in the Source Code of MediaPipe Solution

Comments

@yuimo
Copy link

yuimo commented May 14, 2024 •
edited

Have I written custom code (as opposed to using a stock example script provided in MediaPipe)

None

OS Platform and Distribution

android 14

Mobile device if the issue happens on mobile device

tecno common 30

Browser and version if the issue happens on browser

No response

Programming Language and version

java/c++

MediaPipe version

latest

Bazel version

No response

Solution

no

Android Studio, NDK, SDK versions (if issue is related to building in Android environment)

No response

Xcode & Tulsi version (if issue is related to building for iOS)

No response

Describe the actual behavior

Failed to get LLM params: INVALID_ARGUMENT: LLM model file is null

Describe the expected behaviour

gemma in mediapipe works well any time and any where

Standalone code/steps you may have used to try to get what you need

old issue is here:
[Failed to get LLM params: INVALID_ARGUMENT: LLM model file is null](https://github.com/google/mediapipe/issues/5310)

Other info / Complete Logs

2022-05-08 05:17:00.083 10092-10092 native                  pid-10092                            A  F0000 00:00:1651958220.083185   10092 llm_inference_engine.cc:92] Failed to get LLM params: INVALID_ARGUMENT: LLM model file is null
2022-05-08 05:17:00.083 10092-10092 native                  pid-10092                            A  terminating.
2022-05-08 05:17:00.083 10092-10092 native                  pid-10092                            A  F0000 00:00:1651958220.083185   10092 llm_inference_engine.cc:92] Failed to get LLM params: INVALID_ARGUMENT: LLM model file is null
2022-05-08 05:17:00.083 10092-10092 native                  pid-10092                            A  terminating.
2022-05-08 05:17:00.083 10092-10092 libc                    pid-10092                            A  Fatal signal 6 (SIGABRT), code -1 (SI_QUEUE) in tid 10092 (sion.aicore.llm), pid 10092 (sion.aicore.llm)
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A  *** *** *** *** *** *** *** *** *** *** *** *** *** *** *** ***
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A  Build fingerprint: 'TECNO/CL8-OP/TECNO-CL8:14/UP1A.231005.007/200101V1:user/release-keys'
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A  Revision: '0'
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A  ABI: 'arm64'
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A  Timestamp: 2022-05-07 22:17:00.122597467+0100
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A  Process uptime: 1s
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A  Cmdline: com.transsion.aicore.llm
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A  pid: 10092, tid: 10092, name: sion.aicore.llm  >>> com.transsion.aicore.llm <<<
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A  uid: 10262
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A  tagged_addr_ctrl: 0000000000000001 (PR_TAGGED_ADDR_ENABLE)
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A  signal 6 (SIGABRT), code -1 (SI_QUEUE), fault addr --------
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A  Abort message: 'F0000 00:00:1651958220.083185   10092 llm_inference_engine.cc:92] Failed to get LLM params: INVALID_ARGUMENT: LLM model file is null'
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A      x0  0000000000000000  x1  000000000000276c  x2  0000000000000006  x3  0000007fc51609a0
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A      x4  6470ff092d666d68  x5  6470ff092d666d68  x6  6470ff092d666d68  x7  7f7f7f7f7f7f7f7f
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A      x8  00000000000000f0  x9  0000007cbf693080  x10 0000000000000001  x11 0000007cbf6dcb60
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A      x12 0000000000000000  x13 000000000000000e  x14 0000007fc515f800  x15 000000005310cf9f
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A      x16 0000007cbf748cf8  x17 0000007cbf7254a0  x18 0000007cc9354000  x19 000000000000276c
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A      x20 000000000000276c  x21 00000000ffffffff  x22 0000000000000069  x23 0000000000000007
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A      x24 0000000000000007  x25 0000000012f230c0  x26 0000000012f1ffa0  x27 0000000070df4608
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A      x28 0000000012f29480  x29 0000007fc5160a20
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A      lr  0000007cbf6cd178  sp  0000007fc5160980  pc  0000007cbf6cd1a4  pst 0000000000001000
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A  36 total frames
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A  backtrace:
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A        #00 pc 000000000005c1a4  /apex/com.android.runtime/lib64/bionic/libc.so (abort+164) (BuildId: e2d9c5ba32145bb6e11e59494ee68593)
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A        #01 pc 00000000002f9480  /data/app/~~6WFoVMOF6Id4hM2vC-L9qA==/com.transsion.aicore.llm-hkMeP_5wnS7BChOqycT5BQ==/base.apk!libllm_inference_engine_jni.so (offset 0x1548000)
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A        #02 pc 00000000002f9800  /data/app/~~6WFoVMOF6Id4hM2vC-L9qA==/com.transsion.aicore.llm-hkMeP_5wnS7BChOqycT5BQ==/base.apk!libllm_inference_engine_jni.so (offset 0x1548000)
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A        #03 pc 00000000002f95a0  /data/app/~~6WFoVMOF6Id4hM2vC-L9qA==/com.transsion.aicore.llm-hkMeP_5wnS7BChOqycT5BQ==/base.apk!libllm_inference_engine_jni.so (offset 0x1548000)
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A        #04 pc 00000000002f9438  /data/app/~~6WFoVMOF6Id4hM2vC-L9qA==/com.transsion.aicore.llm-hkMeP_5wnS7BChOqycT5BQ==/base.apk!libllm_inference_engine_jni.so (offset 0x1548000)
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A        #05 pc 00000000002f985c  /data/app/~~6WFoVMOF6Id4hM2vC-L9qA==/com.transsion.aicore.llm-hkMeP_5wnS7BChOqycT5BQ==/base.apk!libllm_inference_engine_jni.so (offset 0x1548000)
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A        #06 pc 00000000000908b0  /data/app/~~6WFoVMOF6Id4hM2vC-L9qA==/com.transsion.aicore.llm-hkMeP_5wnS7BChOqycT5BQ==/base.apk!libllm_inference_engine_jni.so (offset 0x1548000) (LlmInferenceEngine_CreateSession+1024)
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A        #07 pc 000000000008e61c  /data/app/~~6WFoVMOF6Id4hM2vC-L9qA==/com.transsion.aicore.llm-hkMeP_5wnS7BChOqycT5BQ==/base.apk!libllm_inference_engine_jni.so (offset 0x1548000) (Java_com_google_mediapipe_tasks_core_LlmTaskRunner_nativeCreateSession+232)
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A        #08 pc 000000000004a850  /data/app/~~6WFoVMOF6Id4hM2vC-L9qA==/com.transsion.aicore.llm-hkMeP_5wnS7BChOqycT5BQ==/oat/arm64/base.odex (art_jni_trampoline+128)
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A        #09 pc 000000000006df74  /data/app/~~6WFoVMOF6Id4hM2vC-L9qA==/com.transsion.aicore.llm-hkMeP_5wnS7BChOqycT5BQ==/oat/arm64/base.odex (com.google.mediapipe.tasks.core.LlmTaskRunner.<init>+1540)
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A        #10 pc 000000000006e3ec  /data/app/~~6WFoVMOF6Id4hM2vC-L9qA==/com.transsion.aicore.llm-hkMeP_5wnS7BChOqycT5BQ==/oat/arm64/base.odex (com.google.mediapipe.tasks.genai.llminference.LlmInference.<init>+300)
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A        #11 pc 000000000006f9e0  /data/app/~~6WFoVMOF6Id4hM2vC-L9qA==/com.transsion.aicore.llm-hkMeP_5wnS7BChOqycT5BQ==/oat/arm64/base.odex (com.google.mediapipe.tasks.genai.llminference.LlmInference.createFromOptions+5488)
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A        #12 pc 0000000000075910  /data/app/~~6WFoVMOF6Id4hM2vC-L9qA==/com.transsion.aicore.llm-hkMeP_5wnS7BChOqycT5BQ==/oat/arm64/base.odex (com.transsion.aicore.llm.mediepipe.InferenceModel.init+2160)
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A        #13 pc 0000000000075dcc  /data/app/~~6WFoVMOF6Id4hM2vC-L9qA==/com.transsion.aicore.llm-hkMeP_5wnS7BChOqycT5BQ==/oat/arm64/base.odex (com.transsion.aicore.llm.mediepipe.MediaPipeUtils.initModel+428)
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A        #14 pc 00000000000b0168  /data/app/~~6WFoVMOF6Id4hM2vC-L9qA==/com.transsion.aicore.llm-hkMeP_5wnS7BChOqycT5BQ==/oat/arm64/base.odex (com.transsion.aicore.llm.AICoreLLMApiService.lambda$initModel$0$com-transsion-aicore-llm-AICoreLLMApiService+504)
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A        #15 pc 00000000000747d0  /data/app/~~6WFoVMOF6Id4hM2vC-L9qA==/com.transsion.aicore.llm-hkMeP_5wnS7BChOqycT5BQ==/oat/arm64/base.odex (com.transsion.aicore.llm.AICoreLLMApiService$$ExternalSyntheticLambda0.run+80)
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A        #16 pc 000000000062023c  /system/framework/arm64/boot-framework.oat (android.os.Handler.dispatchMessage+76) (BuildId: cc881085891eba9fb970bb93a56e9ac7de8c9c6f)
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A        #17 pc 00000000006237c0  /system/framework/arm64/boot-framework.oat (android.os.Looper.loopOnce+1072) (BuildId: cc881085891eba9fb970bb93a56e9ac7de8c9c6f)
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A        #18 pc 00000000006232cc  /system/framework/arm64/boot-framework.oat (android.os.Looper.loop+572) (BuildId: cc881085891eba9fb970bb93a56e9ac7de8c9c6f)
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A        #19 pc 00000000003adc48  /system/framework/arm64/boot-framework.oat (android.app.ActivityThread.main+1752) (BuildId: cc881085891eba9fb970bb93a56e9ac7de8c9c6f)
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A        #20 pc 0000000000210c80  /apex/com.android.art/lib64/libart.so (art_quick_invoke_static_stub+640) (BuildId: a3cea21e79058ac67d5ce4ec31bd4ac1)
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A        #21 pc 0000000000253be0  /apex/com.android.art/lib64/libart.so (art::ArtMethod::Invoke(art::Thread*, unsigned int*, unsigned int, art::JValue*, char const*)+224) (BuildId: a3cea21e79058ac67d5ce4ec31bd4ac1)
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A        #22 pc 0000000000643184  /apex/com.android.art/lib64/libart.so (_jobject* art::InvokeMethod<(art::PointerSize)8>(art::ScopedObjectAccessAlreadyRunnable const&, _jobject*, _jobject*, _jobject*, unsigned long)+1588) (BuildId: a3cea21e79058ac67d5ce4ec31bd4ac1)
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A        #23 pc 00000000005bb120  /apex/com.android.art/lib64/libart.so (art::Method_invoke(_JNIEnv*, _jobject*, _jobject*, _jobjectArray*) (.__uniq.165753521025965369065708152063621506277)+32) (BuildId: a3cea21e79058ac67d5ce4ec31bd4ac1)
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A        #24 pc 00000000000a2578  /system/framework/arm64/boot.oat (art_jni_trampoline+120) (BuildId: 03ae76c91aed671d06f6689b2e02547bd9c551fa)
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A        #25 pc 0000000000801a34  /system/framework/arm64/boot-framework.oat (com.android.internal.os.RuntimeInit$MethodAndArgsCaller.run+132) (BuildId: cc881085891eba9fb970bb93a56e9ac7de8c9c6f)
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A        #26 pc 000000000080c284  /system/framework/arm64/boot-framework.oat (com.android.internal.os.ZygoteInit.main+3332) (BuildId: cc881085891eba9fb970bb93a56e9ac7de8c9c6f)
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A        #27 pc 0000000000210c80  /apex/com.android.art/lib64/libart.so (art_quick_invoke_static_stub+640) (BuildId: a3cea21e79058ac67d5ce4ec31bd4ac1)
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A        #28 pc 0000000000253be0  /apex/com.android.art/lib64/libart.so (art::ArtMethod::Invoke(art::Thread*, unsigned int*, unsigned int, art::JValue*, char const*)+224) (BuildId: a3cea21e79058ac67d5ce4ec31bd4ac1)
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A        #29 pc 0000000000643a08  /apex/com.android.art/lib64/libart.so (art::JValue art::InvokeWithVarArgs<art::ArtMethod*>(art::ScopedObjectAccessAlreadyRunnable const&, _jobject*, art::ArtMethod*, std::__va_list)+408) (BuildId: a3cea21e79058ac67d5ce4ec31bd4ac1)
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A        #30 pc 0000000000643fe0  /apex/com.android.art/lib64/libart.so (art::JValue art::InvokeWithVarArgs<_jmethodID*>(art::ScopedObjectAccessAlreadyRunnable const&, _jobject*, _jmethodID*, std::__va_list)+80) (BuildId: a3cea21e79058ac67d5ce4ec31bd4ac1)
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A        #31 pc 000000000050f8f4  /apex/com.android.art/lib64/libart.so (art::JNI<true>::CallStaticVoidMethodV(_JNIEnv*, _jclass*, _jmethodID*, std::__va_list)+692) (BuildId: a3cea21e79058ac67d5ce4ec31bd4ac1)
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A        #32 pc 00000000000deca8  /system/lib64/libandroid_runtime.so (_JNIEnv::CallStaticVoidMethod(_jclass*, _jmethodID*, ...)+104) (BuildId: f45e76513594458f01bae94c4f2f016b)
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A        #33 pc 00000000000eae2c  /system/lib64/libandroid_runtime.so (android::AndroidRuntime::start(char const*, android::Vector<android::String8> const&, bool)+940) (BuildId: f45e76513594458f01bae94c4f2f016b)
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A        #34 pc 000000000000254c  /system/bin/app_process64 (main+1260) (BuildId: b8d2813b499be9f10b5755c6bdb63d8b)
2022-05-08 05:17:00.252 10123-10123 DEBUG                   pid-10123                            A        #35 pc 00000000000546e8  /apex/com.android.runtime/lib64/bionic/libc.so (__libc_init+104) (BuildId: e2d9c5ba32145bb6e11e59494ee68593)
@yuimo yuimo added the type:bug Bug in the Source Code of MediaPipe Solution label May 14, 2024
@kuaashish kuaashish added platform:android Issues with Android as Platform task:LLM inference Issues related to MediaPipe LLM Inference Gen AI setup labels May 14, 2024
@schmidt-sebastian
Copy link
Collaborator

Do you have a code snipper that shows how you are initializing the inference engine?

@kuaashish kuaashish added the stat:awaiting response Waiting for user response label May 16, 2024
@github-actions GitHub Actions
Copy link

This issue has been marked stale because it has no recent activity since 7 days. It will be closed if no further activity occurs. Thank you.

@github-actions github-actions bot added the stale label May 24, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@kuaashish kuaashish

Labels
platform:android Issues with Android as Platform stale stat:awaiting response Waiting for user response task:LLM inference Issues related to MediaPipe LLM Inference Gen AI setup type:bug Bug in the Source Code of MediaPipe Solution
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@schmidt-sebastian @yuimo @kuaashish