From 9cf70081f3bfc00e84331102e7d13b333f17ee26 Mon Sep 17 00:00:00 2001 From: Yu Chin Fabian Lim Date: Fri, 23 Aug 2024 10:33:49 +0000 Subject: [PATCH] fixes to readme and tox Signed-off-by: Yu Chin Fabian Lim --- plugins/accelerated-moe/README.md | 9 ++++++++- plugins/accelerated-moe/requirements-mb.txt | 3 +++ .../src/fms_acceleration_moe/requirements-mb.txt | 1 - 3 files changed, 11 insertions(+), 2 deletions(-) create mode 100644 plugins/accelerated-moe/requirements-mb.txt delete mode 100644 plugins/accelerated-moe/src/fms_acceleration_moe/requirements-mb.txt diff --git a/plugins/accelerated-moe/README.md b/plugins/accelerated-moe/README.md index c187cf20..2ef05b58 100644 --- a/plugins/accelerated-moe/README.md +++ b/plugins/accelerated-moe/README.md @@ -12,8 +12,15 @@ Plugin | Description | Depends | Loading | Augmentation | Callbacks ## Running Benchmarks +Run the below in the top-level directory of this repo: +- the `megablocks` dep is not included by default, so the `-x` switch installs it. + ``` -tox -e run-benches -- 8 8 scenarios.yaml accelerated-moe-megablocks +tox -e run-benches \ + -x testenv:run-benches.deps+="-r plugins/accelerated-moe/requirements-mb.txt" \ + -- \ + 8 8 benchmark_outputs scenarios.yaml accelerated-moe-megablocks + ``` ## Expert-Parallel MoE with Megablocks diff --git a/plugins/accelerated-moe/requirements-mb.txt b/plugins/accelerated-moe/requirements-mb.txt new file mode 100644 index 00000000..7875fc98 --- /dev/null +++ b/plugins/accelerated-moe/requirements-mb.txt @@ -0,0 +1,3 @@ +megablocks @ git+https://github.com/databricks/megablocks.git@bce5d7b2aaf5038bc93b36f76c2baf51c2939bd2 + +# auto_gptq @ git+https://github.com/AutoGPTQ/AutoGPTQ.git@ea829c7bbe83561c2b1de26795b6592992373ef7 diff --git a/plugins/accelerated-moe/src/fms_acceleration_moe/requirements-mb.txt b/plugins/accelerated-moe/src/fms_acceleration_moe/requirements-mb.txt deleted file mode 100644 index fbe690ff..00000000 --- a/plugins/accelerated-moe/src/fms_acceleration_moe/requirements-mb.txt +++ /dev/null @@ -1 +0,0 @@ -pip install git+https://github.com/databricks/megablocks.git@bce5d7b2aaf5038bc93b36f76c2baf51c2939bd2 \ No newline at end of file