Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Sop plugin refactoring #75

Open
wants to merge 29 commits into
base: main
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
29 commits
Select commit Hold shift + click to select a range
8dd2228
Adapt SpyreWorker to some changes from upstream.
tdoublep Jan 17, 2025
82bda5c
Working on CPU in TP
tdoublep Jan 17, 2025
bef766f
Resolve issue with TP=1
tdoublep Jan 17, 2025
a0d55de
Working on TP>1; there is a dynamic shape bug though
tdoublep Jan 17, 2025
20f5565
Dynamic shapes works too
tdoublep Jan 17, 2025
9f973d1
Set env vars in CI test
tdoublep Jan 17, 2025
3209382
Remove debug prints
tdoublep Jan 17, 2025
3aa8196
Remove unused code
tdoublep Jan 17, 2025
a3af854
fmt
tdoublep Jan 17, 2025
5510021
Fix embedding model runner + fmt
tdoublep Jan 21, 2025
6e8de27
Remove comment
tdoublep Jan 21, 2025
9703645
Pass template argument
tdoublep Jan 21, 2025
124f3a9
enable CI tests on every PR
tdoublep Jan 21, 2025
857b127
improved code readability (#72)
yannicks1 Jan 27, 2025
bacc8dc
minimal changes in vllm to transform to spyre plugin
sducouedic Jan 29, 2025
c70568c
removal and built-in spyre definition, worker, and executor
sducouedic Jan 29, 2025
d2322f1
To discuss: use 'empty' device and install 'requirements-common.txt'
sducouedic Jan 29, 2025
b1d9d1f
removed additional spyre-related, examples and tests scripts were add…
sducouedic Jan 29, 2025
68ce274
use base class method to validate quantization (rather than manually)…
sducouedic Jan 30, 2025
775fdbb
remove PlatformEnum.SPYRE and use PlatformEnum.OOT in the plugin
sducouedic Jan 30, 2025
756d33c
move 'VLLM_SPYRE_DYNAMO_BACKEND' to envs.py file in spyre plugin
sducouedic Jan 30, 2025
7716448
remove spyre from installation configurations and files
sducouedic Jan 30, 2025
0d6bee9
remove spyre tests from github workflow
sducouedic Jan 30, 2025
ca4a8e7
remove manual setting of device to 'cpu' for Spyre, rather set 'devic…
sducouedic Jan 30, 2025
4e606a6
reformat based on 'bash format.sh'
sducouedic Jan 31, 2025
99d942d
remove 'requirements-spyre.txt
sducouedic Feb 7, 2025
983ffe0
fixed conflicts
sducouedic Feb 10, 2025
caad376
remove 'TODO' comment (resolved)
sducouedic Feb 11, 2025
8c3c29f
Ysc pluggable scheduler (#78)
yannicks1 Feb 20, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
27 changes: 0 additions & 27 deletions .github/workflows/test-spyre.yml

This file was deleted.

2 changes: 0 additions & 2 deletions .yapfignore
Original file line number Diff line number Diff line change
@@ -1,3 +1 @@
collect_env.py

vllm/model_executor/model_loader/spyre_setup.py
28 changes: 0 additions & 28 deletions Dockerfile.spyre

This file was deleted.

60 changes: 0 additions & 60 deletions examples/offline_inference_multi_spyre.py

This file was deleted.

Loading