New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

在64核机器上跑ncnn模型，运行时只会调用其中一个核，设置哪些参数能跑指定数量的cpu核心 #5412

Open

mmdzzh opened this issue Apr 7, 2024 · 1 comment

mmdzzh commented Apr 7, 2024

如题，设置ncnn.set_omp_num_threads和net.opt.num_threads都没有效果，采用绑核的方式也没办法调用多个核，系统环境为aarch64

mmdzzh changed the title ~~通过pip3 install ncnn安装的ncnn py库，运行的时候只会占据一个核，怎么才能调用多核~~ 在64核机器上跑ncnn模型，运行时只会调用其中一个核，设置哪些参数能跑指定数量的cpu核心

Contributor

wzyforgit commented Apr 12, 2024

你是跑的什么模型？有些算子是只能串行处理的
另外你可以用openmp起多个extractor来进行多batch并行推理

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment