Skip to content

Commit

Permalink
refactor the warning
Browse files Browse the repository at this point in the history
  • Loading branch information
dbogunowicz committed Jul 18, 2023
1 parent 1bcddc1 commit 74a3d09
Showing 1 changed file with 3 additions and 4 deletions.
7 changes: 3 additions & 4 deletions src/deepsparse/transformers/pipelines/text_generation.py
Original file line number Diff line number Diff line change
Expand Up @@ -122,10 +122,9 @@ def __init__(
):
if not cpu_avx512_compatible() and kwargs["engine_type"] == DEEPSPARSE_ENGINE:
warnings.warn(
"Detected CPU is not AVX512 compatible. "
"The kv cache management will not be supported "
"by the optimized engine. The user may experience "
"non optimal performance."
"AVX512 support not detected, disabling internal management "
"of KV cache which may affect performance. To enable full "
"performance, deploy on an AVX512-compatible system."
)
use_deepsparse_cache = False

Expand Down

0 comments on commit 74a3d09

Please sign in to comment.