You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
%index is converted to int32, but in block 1, scatter function needs data type int64 but got int32.
This is because TensorRT doesn't support int64, so Torch-TensorRT will cast all int64=>int32 to run them in TensorRT. However, when partitioning is enabled, some functions in Torch they still need type int64 to run.
Describe the solution you'd like
This could be supported if every aten::to operation is recorded and then cast the types between torch and tensorrt.
The text was updated successfully, but these errors were encountered:
Is your feature request related to a problem? Please describe.
In this graph:
%index
is converted to int32, but in block 1,scatter
function needs data type int64 but got int32.This is because TensorRT doesn't support int64, so Torch-TensorRT will cast all int64=>int32 to run them in TensorRT. However, when partitioning is enabled, some functions in Torch they still need type int64 to run.
Describe the solution you'd like
This could be supported if every aten::to operation is recorded and then cast the types between torch and tensorrt.
The text was updated successfully, but these errors were encountered: