Skip to content

Commit

Permalink
Merge branch 'main' into vivijay/package_update
Browse files Browse the repository at this point in the history
  • Loading branch information
vivijay91 authored Feb 25, 2025
2 parents efeedb1 + ccbef7d commit 2292e58
Show file tree
Hide file tree
Showing 2 changed files with 3 additions and 3 deletions.
2 changes: 1 addition & 1 deletion assets/models/system/Phi-4/spec.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -72,4 +72,4 @@ tags:
save_total_limit: 1
benchmark: "quality"

version: 3
version: 4
Original file line number Diff line number Diff line change
Expand Up @@ -48,7 +48,7 @@ RUN pip install git+https://github.com/stanford-futuredata/megablocks.git@5897cd
# RUN pip install -e ./ --no-cache-dir

# When copied to assets repo, change to install from public pypi
RUN pip install llm-optimized-inference==0.2.17 --no-cache-dir
RUN pip install llm-optimized-inference==0.2.19 --no-cache-dir

RUN pip uninstall -y vllm
RUN pip install https://automlsamplenotebookdata.blob.core.windows.net/vllm/vllm-0.6.3.post1+cu122-cp310-cp310-linux_x86_64.whl
Expand All @@ -63,4 +63,4 @@ RUN chmod +x /var/runit/api_server/run
ENV SVDIR=/var/runit
ENV WORKER_TIMEOUT=3600
EXPOSE 5001
CMD [ "runsvdir", "/var/runit" ]
CMD [ "runsvdir", "/var/runit" ]

0 comments on commit 2292e58

Please sign in to comment.