Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

iree-turbine assert in _to_meta_tensor #302

Open
FlintWangacc opened this issue Dec 2, 2024 · 1 comment
Open

iree-turbine assert in _to_meta_tensor #302

FlintWangacc opened this issue Dec 2, 2024 · 1 comment

Comments

@FlintWangacc
Copy link

I am debugging a module with following code snippet.

class StateUpdateModule(CompiledModule):
    ....
   def run_initialize(
         self, x=AbstractTensor(BATCH_SIZE, None, dtype=torch.int64)
    ):
   ....

It seems iree-turbine has some trouble deal with AbstractTensor(BATCH_SIZE, None, dtype=torch.int64).
It will assert when iree-turbine try to compile this code snippet.
It will output the following message.

....
File "iree/turbine/aot/support/procedural/base.py", line 135, in __call__
return current_ir_trace().handle_call(self, args, kwargs)
File "iree/turbine/aot/support/procedural/tracer.py" line 150, in handle_call
return target.resolve_call(self, *args, **kwargs)
File "iree/turbine/aot/builtins/jittable.py", line 187, in resolve_call
ir_arg, pytorch_arg = self._split_py_arg(py_arg)
File "iree/turbine/aot/builtins/jittable.py", line 311, in _split_py_arg
meta_tensor = arg._to_meta_tensor()
File "/iree/turbine/aot/support/procedural/primitives.py", line 209, in _to_meta_tensor
assert not any(
AssertionError: Unsupported dynamic dims in meta tensor
@FollowHeart007
Copy link

I encountered the same issue while trying to deploy the Llama model.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants