Skip to content

Commit

Permalink
Remove the launch options entirely since we currently don't have a re…
Browse files Browse the repository at this point in the history
…liable way to perform a multi-threaded triton unittest
  • Loading branch information
dagardner-nv committed Apr 18, 2024
1 parent 1aec440 commit 8444f77
Showing 1 changed file with 0 additions and 4 deletions.
4 changes: 0 additions & 4 deletions morpheus/stages/inference/inference_stage.py
Original file line number Diff line number Diff line change
Expand Up @@ -299,10 +299,6 @@ def set_output_fut(resp: TensorMemory, inner_batch, batch_future: mrc.Future):
else:
node = builder.make_node(self.unique_name, ops.build(py_inference_fn))

# Set the concurrency level to be up with the thread count, intentionally only setting this for python
# implementations to avoid #1639
node.launch_options.pe_count = self._thread_count

builder.make_edge(input_node, node)

return node
Expand Down

0 comments on commit 8444f77

Please sign in to comment.