Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug][Meta-schedule][tensorizing] BERT Meta-schedule tensorizing Runtime Error #17002

Open
SharynHu opened this issue May 16, 2024 · 0 comments
Labels
needs-triage PRs or issues that need to be investigated by maintainers to find the right assignees to address it type: bug

Comments

@SharynHu
Copy link

SharynHu commented May 16, 2024

I was tensorizing BERT using meta schedule and get a runtime error.

Expected behavior

It should

  • Extract task
  • Tune task
  • Give me a tuned model to build

Actual behavior

Raised a runtime error duing task tuning "fused_batch_matmul"

E       RuntimeError: parallel_for_dynamic error with [11:05:35] ~/tvm/src/tir/transforms/unify_thread_binding.cc:112: Check failed: (ana.CanPro
veEqual(dom->extent, new_iter_var->dom->extent)) is false: ValueError: All loops that are bound to `threadIdx.y` should have the same extent. However, there are two
 loops with extent T.int64(32) and T.int64(16), which are not equal

Environment

Hardware: Nvidia/rtx-3060
OS: ubuntu 2204
Commit id: cfe1711
Cuda: 11.8
Llvm: 17

Steps to reproduce

Simply run the official test code located at
~/tvm/tests/python/integration/test_auto_tensorize.py

Triage

  • tune:meta_schedule
@SharynHu SharynHu added needs-triage PRs or issues that need to be investigated by maintainers to find the right assignees to address it type: bug labels May 16, 2024
@SharynHu SharynHu changed the title [Bug] [Bug] BERT Meta-schedule tensoring Runtime Error May 16, 2024
@SharynHu SharynHu changed the title [Bug] BERT Meta-schedule tensoring Runtime Error [Bug] BERT Meta-schedule tensorizing Runtime Error May 17, 2024
@SharynHu SharynHu changed the title [Bug] BERT Meta-schedule tensorizing Runtime Error [Bug][Meta-schedule][tensorizing] BERT Meta-schedule tensorizing Runtime Error May 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
needs-triage PRs or issues that need to be investigated by maintainers to find the right assignees to address it type: bug
Projects
None yet
Development

No branches or pull requests

1 participant