Skip to content

Commit

Permalink
fmt: run pre-commit
Browse files Browse the repository at this point in the history
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
  • Loading branch information
tjohnson31415 authored and prashantgupta24 committed Aug 14, 2024
1 parent 0500151 commit 7cd77d1
Showing 1 changed file with 3 additions and 2 deletions.
5 changes: 3 additions & 2 deletions src/vllm_tgis_adapter/grpc/grpc_server.py
Original file line number Diff line number Diff line change
Expand Up @@ -607,8 +607,9 @@ async def _validate_and_convert_params(
try:
sampling_params = SamplingParams(
logprobs=logprobs,
prompt_logprobs=logprobs if not self.disable_prompt_logprobs and resp_options.input_tokens \
else None,
prompt_logprobs=logprobs
if not self.disable_prompt_logprobs and resp_options.input_tokens
else None,
max_tokens=max_new_tokens,
min_tokens=min_new_tokens,
repetition_penalty=with_default(decoding.repetition_penalty, 1.0),
Expand Down

0 comments on commit 7cd77d1

Please sign in to comment.