Code

Sop plugin refactoring#75

Code

Open

sducouedic wants to merge 29 commits intomainIBM/vllm:mainfrom sop-plugin-refactoringIBM/vllm:sop-plugin-refactoringCopy head branch name to clipboard

+20-3,468

Commits

Commits on Jan 17, 2025

• Adapt SpyreWorker to some changes from upstream.

  Show description for 8dd2228
  tdoublep

  committed
  8dd2228

  Copy full SHA for 8dd2228

• Working on CPU in TP

  Show description for 82bda5c
  tdoublep

  committed
  82bda5c

  Copy full SHA for 82bda5c

• Resolve issue with TP=1

  Show description for bef766f
  tdoublep

  committed
  bef766f

  Copy full SHA for bef766f

• Working on TP>1; there is a dynamic shape bug though

  Show description for a0d55de
  tdoublep

  committed
  a0d55de

  Copy full SHA for a0d55de

• Dynamic shapes works too

  Show description for 20f5565
  tdoublep

  committed
  20f5565

  Copy full SHA for 20f5565

• Set env vars in CI test

  Show description for 9f973d1
  tdoublep

  committed
  9f973d1

  Copy full SHA for 9f973d1

• Remove debug prints

  Show description for 3209382
  tdoublep

  committed
  3209382

  Copy full SHA for 3209382

• Remove unused code

  Show description for 3aa8196
  tdoublep

  committed
  3aa8196

  Copy full SHA for 3aa8196

• fmt

  Show description for a3af854
  tdoublep

  committed
  a3af854

  Copy full SHA for a3af854

Commits on Jan 21, 2025

• Fix embedding model runner + fmt

  Show description for 5510021
  tdoublep

  committed
  5510021

  Copy full SHA for 5510021

• Remove comment

  Show description for 6e8de27
  tdoublep

  committed
  6e8de27

  Copy full SHA for 6e8de27

• Pass template argument

  Show description for 9703645
  tdoublep

  committed
  9703645

  Copy full SHA for 9703645

• enable CI tests on every PR

  Show description for 124f3a9
  tdoublep

  committed
  124f3a9

  Copy full SHA for 124f3a9

Commits on Jan 27, 2025

• improved code readability (#72)

  Show description for 857b127
  yannicks1

  authored
  857b127

  Copy full SHA for 857b127

Commits on Jan 29, 2025

• minimal changes in vllm to transform to spyre plugin

  Show description for bacc8dc
  sducouedic

  committed
  bacc8dc

  Copy full SHA for bacc8dc

• removal and built-in spyre definition, worker, and executor

  Show description for c70568c
  sducouedic

  committed
  c70568c

  Copy full SHA for c70568c

• To discuss: use 'empty' device and install 'requirements-common.txt'

  Show description for d2322f1
  sducouedic

  committed
  d2322f1

  Copy full SHA for d2322f1

• removed additional spyre-related, examples and tests scripts were added to pluging and tested

  Show description for b1d9d1f
  sducouedic

  committed
  b1d9d1f

  Copy full SHA for b1d9d1f

Commits on Jan 30, 2025

• use base class method to validate quantization (rather than manually) by setting attribute 'supported_quantization' in the plugin

  Show description for 68ce274
  sducouedic

  committed
  68ce274

  Copy full SHA for 68ce274

• remove PlatformEnum.SPYRE and use PlatformEnum.OOT in the plugin

  Show description for 775fdbb
  sducouedic

  committed
  775fdbb

  Copy full SHA for 775fdbb

• move 'VLLM_SPYRE_DYNAMO_BACKEND' to envs.py file in spyre plugin

  Show description for 756d33c
  sducouedic

  committed
  756d33c

  Copy full SHA for 756d33c

• remove spyre from installation configurations and files

  Show description for 7716448
  sducouedic

  committed
  7716448

  Copy full SHA for 7716448

• remove spyre tests from github workflow

  Show description for 0d6bee9
  sducouedic

  committed
  0d6bee9

  Copy full SHA for 0d6bee9

• remove manual setting of device to 'cpu' for Spyre, rather set 'device_type' in Platform

  Show description for ca4a8e7
  sducouedic

  committed
  ca4a8e7

  Copy full SHA for ca4a8e7

Commits on Jan 31, 2025

• reformat based on 'bash format.sh'

  Show description for 4e606a6
  sducouedic

  committed
  4e606a6

  Copy full SHA for 4e606a6

Commits on Feb 7, 2025

• remove 'requirements-spyre.txt

  Show description for 99d942d
  sducouedic

  committed
  99d942d

  Copy full SHA for 99d942d

Commits on Feb 10, 2025

• fixed conflicts

  sducouedic

  committed
  983ffe0

  Copy full SHA for 983ffe0

Commits on Feb 11, 2025

• remove 'TODO' comment (resolved)

  Show description for caad376
  sducouedic

  committed
  caad376

  Copy full SHA for caad376

Commits on Feb 20, 2025

• Ysc pluggable scheduler (#78)

  Show description for 8c3c29f
  yannicks1

  authored
  8c3c29f

  Copy full SHA for 8c3c29f