Skip to content

Commit

Permalink
Update docstring
Browse files Browse the repository at this point in the history
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
  • Loading branch information
tdoublep committed Jul 11, 2024
1 parent 889d6dd commit 3307522
Showing 1 changed file with 4 additions and 0 deletions.
4 changes: 4 additions & 0 deletions vllm/triton_utils/custom_cache_manager.py
Original file line number Diff line number Diff line change
Expand Up @@ -23,6 +23,10 @@ class CustomCacheManager(FileCacheManager):
unique cache directory is created for each process. This is
needed to avoid collisions when running with tp>1 and
using multi-processing as the distributed backend.
Note this issue was fixed by triton-lang/triton/pull/4295,
but the fix is not yet included in triton==v3.0.0. However,
it should be included in the subsequent version.
"""

def __init__(self, key, override=False, dump=False):
Expand Down

0 comments on commit 3307522

Please sign in to comment.