Skip to content
Permalink

Comparing changes

Choose two branches to see what’s changed or to start a new pull request. If you need to, you can also or learn more about diff comparisons.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also . Learn more about diff comparisons here.
base repository: kalavai-net/kalavai-client
Failed to load repositories. Confirm that selected base ref is valid, then try again.
Loading
base: v0.3.1
Choose a base ref
...
head repository: kalavai-net/kalavai-client
Failed to load repositories. Confirm that selected head ref is valid, then try again.
Loading
compare: main
Choose a head ref

Commits on Nov 18, 2024

  1. Copy the full SHA
    a44b5ea View commit details

Commits on Nov 19, 2024

  1. fixes

    musoles committed Nov 19, 2024
    Copy the full SHA
    3223ddd View commit details

Commits on Nov 20, 2024

  1. changed to jinja2 templates

    musoles committed Nov 20, 2024
    Copy the full SHA
    a40377f View commit details
  2. fixed dummy template

    musoles committed Nov 20, 2024
    Copy the full SHA
    0c69aa2 View commit details
  3. fixed aphrodite template

    musoles committed Nov 20, 2024
    Copy the full SHA
    72a8e26 View commit details

Commits on Nov 23, 2024

  1. moved templates to jobs

    musoles committed Nov 23, 2024
    Copy the full SHA
    5b5a82d View commit details
  2. templatised pool config

    musoles committed Nov 23, 2024
    Copy the full SHA
    eaed16c View commit details

Commits on Nov 26, 2024

  1. Copy the full SHA
    982720c View commit details
  2. new utils and config defaults

    musoles committed Nov 26, 2024
    Copy the full SHA
    84d2cf9 View commit details

Commits on Dec 2, 2024

  1. Copy the full SHA
    12f563e View commit details
  2. minor documentation changes

    musoles committed Dec 2, 2024
    Copy the full SHA
    ebd66b1 View commit details
  3. template updates

    musoles committed Dec 2, 2024
    Copy the full SHA
    cbc66b8 View commit details
  4. config changes

    musoles committed Dec 2, 2024
    Copy the full SHA
    f8e60c5 View commit details

Commits on Dec 5, 2024

  1. Copy the full SHA
    7120c7e View commit details
  2. added llamacpp template

    musoles committed Dec 5, 2024
    Copy the full SHA
    f1ba006 View commit details

Commits on Dec 9, 2024

  1. minor changes

    musoles committed Dec 9, 2024
    Copy the full SHA
    601207e View commit details

Commits on Dec 19, 2024

  1. new templates

    musoles committed Dec 19, 2024
    Copy the full SHA
    fc19d45 View commit details
  2. update

    musoles committed Dec 19, 2024
    Copy the full SHA
    45f13b9 View commit details
  3. Copy the full SHA
    a524caa View commit details

Commits on Dec 20, 2024

  1. Copy the full SHA
    ee655cf View commit details
  2. added boinc preferences

    musoles committed Dec 20, 2024
    Copy the full SHA
    03821d8 View commit details
  3. new petals template

    musoles committed Dec 20, 2024
    Copy the full SHA
    78e1bc8 View commit details
  4. updated node selector

    musoles committed Dec 20, 2024
    Copy the full SHA
    dc5eb1f View commit details
  5. updated reqs for petal pods

    musoles committed Dec 20, 2024
    Copy the full SHA
    ea3b9b3 View commit details
  6. flexible cpu for petals

    musoles committed Dec 20, 2024
    Copy the full SHA
    1dad278 View commit details
  7. Copy the full SHA
    880f565 View commit details
  8. minor changes to templates

    musoles committed Dec 20, 2024
    Copy the full SHA
    01a6b88 View commit details

Commits on Dec 21, 2024

  1. range reqs for petals

    musoles committed Dec 21, 2024
    Copy the full SHA
    c1171bf View commit details
  2. ephemeral storage update

    musoles committed Dec 21, 2024
    Copy the full SHA
    2775afe View commit details
  3. added extras for petals

    musoles committed Dec 21, 2024
    Copy the full SHA
    5e57daf View commit details
  4. added ephemeral req

    musoles committed Dec 21, 2024
    Copy the full SHA
    5130026 View commit details
  5. added priority class

    musoles committed Dec 21, 2024
    Copy the full SHA
    58096be View commit details

Commits on Dec 22, 2024

  1. added example docs for petals

    musoles committed Dec 22, 2024
    Copy the full SHA
    b9f67fe View commit details
  2. added petals to documentation

    musoles committed Dec 22, 2024
    Copy the full SHA
    61e0e34 View commit details

Commits on Dec 23, 2024

  1. minor docs update

    musoles committed Dec 23, 2024
    Copy the full SHA
    412b4f5 View commit details
  2. more details for petals

    musoles committed Dec 23, 2024
    Copy the full SHA
    3e7676c View commit details
  3. updated readme

    musoles committed Dec 23, 2024
    Copy the full SHA
    7e855fa View commit details
  4. Copy the full SHA
    8baf1d3 View commit details
  5. typo

    musoles committed Dec 23, 2024
    Copy the full SHA
    689ba0d View commit details

Commits on Dec 24, 2024

  1. updated boinc defaults

    musoles committed Dec 24, 2024
    Copy the full SHA
    8a5f703 View commit details
  2. boinc on docs

    musoles committed Dec 24, 2024
    Copy the full SHA
    bc83d0a View commit details
  3. host path for boinc

    musoles committed Dec 24, 2024
    Copy the full SHA
    3a1c84a View commit details

Commits on Jan 2, 2025

  1. update config files

    musoles committed Jan 2, 2025
    Copy the full SHA
    fdefb4e View commit details
  2. base docker image

    musoles committed Jan 2, 2025
    Copy the full SHA
    5094601 View commit details
  3. Copy the full SHA
    87c8bea View commit details
  4. update to template files

    musoles committed Jan 2, 2025
    Copy the full SHA
    2072831 View commit details
  5. updated defaults

    musoles committed Jan 2, 2025
    Copy the full SHA
    97469a7 View commit details
  6. Copy the full SHA
    e2a5b3a View commit details
  7. Copy the full SHA
    9739ff9 View commit details
  8. fixed bug upon init

    musoles committed Jan 2, 2025
    Copy the full SHA
    3cb0603 View commit details
Showing with 9,486 additions and 2,800 deletions.
  1. +119 −0 .github/workflows/release.yml
  2. +3 −0 .gitignore
  3. +3 −0 MANIFEST.in
  4. +143 −158 README.md
  5. +0 −92 assets/apps.yaml
  6. +7 −3 assets/install_client.sh
  7. +0 −32 assets/pvc_template.yaml
  8. +0 −119 assets/seed.yaml
  9. +0 −16 assets/service_template.yaml
  10. +0 −17 assets/storage_class_template.yaml
  11. +0 −43 build.sh
  12. +0 −6 build_specs/.fpm
  13. +34 −0 docker/kalavai-runner/Dockerfile
  14. +26 −0 docker/kalavai-runner/README.md
  15. +5 −0 docker/kalavai-runner/nvidia-runtimeclass.yaml
  16. +99 −0 docker/kalavai-runner/run_agent.sh
  17. +16 −0 docker/ray-base/Dockerfile
  18. +8 −0 docker/ray-base/README.md
  19. 0 {templates/aphrodite → docker/ray-base}/download_hf.py
  20. +36 −0 docker/ray-base/download_model.sh
  21. +22 −22 {templates/aphrodite → docker/ray-base}/ray_init.sh
  22. +59 −0 docker/test.py
  23. +15 −0 docker/utils/Dockerfile
  24. +3 −0 docker/utils/README.md
  25. +41 −0 docker/utils/get_litellm_id.py
  26. +55 −0 docker/utils/register_model.sh
  27. +36 −0 docker/utils/wait_for_service.sh
  28. +12 −0 docker/vpn-keeper/Dockerfile
  29. +31 −0 docker/vpn-keeper/README.md
  30. +75 −0 docker/vpn-keeper/keeper.py
  31. +1 −0 docker/vpn-keeper/requirements.txt
  32. BIN docs/docs/assets/images/boinc_leaderboard.png
  33. BIN docs/docs/assets/images/boinc_shared.png
  34. BIN docs/docs/assets/images/join.png
  35. BIN docs/docs/assets/images/litellm_key.png
  36. BIN docs/docs/assets/images/litellm_virtual_key.png
  37. BIN docs/docs/assets/images/llama_webui.png
  38. BIN docs/docs/assets/images/petals_health.png
  39. BIN docs/docs/assets/images/public_seeds.png
  40. BIN docs/docs/assets/images/ui_all_devices.png
  41. BIN docs/docs/assets/images/ui_all_gpus.png
  42. BIN docs/docs/assets/images/ui_all_pools.png
  43. BIN docs/docs/assets/images/ui_create_cluster.png
  44. BIN docs/docs/assets/images/ui_dashboard_multiple.png
  45. BIN docs/docs/assets/images/ui_dashboard_single.png
  46. BIN docs/docs/assets/images/ui_deploy_job.png
  47. BIN docs/docs/assets/images/ui_deploy_litellm.png
  48. BIN docs/docs/assets/images/ui_devices_invite.png
  49. BIN docs/docs/assets/images/ui_join_part1.png
  50. BIN docs/docs/assets/images/ui_join_part2.png
  51. BIN docs/docs/assets/images/ui_join_public.png
  52. BIN docs/docs/assets/images/ui_leave_pool.png
  53. BIN docs/docs/assets/images/ui_litellm_status.png
  54. BIN docs/docs/assets/images/ui_monitor_jobs.png
  55. BIN docs/docs/assets/images/ui_qwen_deploy.png
  56. BIN docs/docs/assets/images/ui_qwen_submitted.png
  57. BIN docs/docs/assets/images/webui.png
  58. +122 −0 docs/docs/boinc.md
  59. +30 −0 docs/docs/choose_job_resources.md
  60. +159 −0 docs/docs/cli.md
  61. +52 −0 docs/docs/compatibility.md
  62. +12 −5 docs/docs/concepts.md
  63. +74 −40 docs/docs/getting_started.md
  64. +12 −45 docs/docs/index.md
  65. +0 −35 docs/docs/local_pool.md
  66. +210 −0 docs/docs/petals.md
  67. +291 −0 docs/docs/public_llm_pool.md
  68. +2 −0 docs/docs/public_pool.md
  69. +224 −0 docs/docs/self_hosted_llm_pool.md
  70. +35 −10 docs/docs/templates.md
  71. +13 −4 docs/mkdocs.yml
  72. +1 −0 examples/data/ray_cluster_spec.yaml
  73. +34 −0 examples/llms/inference.py
  74. +36 −0 examples/llms/llamacpp-llama-8b.yaml
  75. +34 −0 examples/llms/vllm-qwen-1.5b.yaml
  76. +2 −7 examples/multinode_gpu_vllm.md
  77. +2 −8 examples/quantized_gpu_llm.md
  78. +2 −3 examples/singlenode_gpu_vllm.md
  79. +20 −0 gui/.dockerignore
  80. +6 −0 gui/.gitignore
  81. +10 −0 gui/Dockerfile
  82. +67 −0 gui/README.md
  83. +6 −0 gui/app.py
  84. BIN gui/assets/favicon.ico
  85. BIN gui/assets/reflex_black.png
  86. BIN gui/assets/reflex_white.png
  87. +17 −0 gui/assets/styles.css
  88. +1 −0 gui/dashboard/__init__.py
  89. 0 gui/dashboard/backend/__init__.py
  90. +116 −0 gui/dashboard/backend/dashboard_state.py
  91. +137 −0 gui/dashboard/backend/devices_state.py
  92. +73 −0 gui/dashboard/backend/gpus_state.py
  93. +217 −0 gui/dashboard/backend/jobs_state.py
  94. +86 −0 gui/dashboard/backend/main_state.py
  95. +248 −0 gui/dashboard/backend/pools_state.py
  96. +108 −0 gui/dashboard/backend/table_state.py
  97. +15 −0 gui/dashboard/backend/utils.py
  98. 0 gui/dashboard/components/__init__.py
  99. +13 −0 gui/dashboard/components/card.py
  100. +219 −0 gui/dashboard/components/navbar.py
  101. +27 −0 gui/dashboard/components/notification.py
  102. +30 −0 gui/dashboard/components/profile_input.py
  103. +210 −0 gui/dashboard/components/sidebar.py
  104. +66 −0 gui/dashboard/components/status_badge.py
  105. +13 −0 gui/dashboard/dashboard.py
  106. +8 −0 gui/dashboard/pages/__init__.py
  107. +105 −0 gui/dashboard/pages/dashboard.py
  108. +25 −0 gui/dashboard/pages/devices.py
  109. +25 −0 gui/dashboard/pages/gpus.py
  110. +144 −0 gui/dashboard/pages/index.py
  111. +25 −0 gui/dashboard/pages/jobs.py
  112. +49 −0 gui/dashboard/pages/settings.py
  113. +23 −0 gui/dashboard/pages/table.py
  114. +100 −0 gui/dashboard/styles.py
  115. +3 −0 gui/dashboard/templates/__init__.py
  116. +143 −0 gui/dashboard/templates/template.py
  117. 0 gui/dashboard/views/__init__.py
  118. +68 −0 gui/dashboard/views/acquisition_view.py
  119. +292 −0 gui/dashboard/views/charts.py
  120. +93 −0 gui/dashboard/views/color_picker.py
  121. +238 −0 gui/dashboard/views/devices_table.py
  122. +157 −0 gui/dashboard/views/generic_table.py
  123. +48 −0 gui/dashboard/views/gpus_table.py
  124. +223 −0 gui/dashboard/views/jobs_table.py
  125. +158 −0 gui/dashboard/views/pools_table.py
  126. +28 −0 gui/dashboard/views/radius_picker.py
  127. +103 −0 gui/dashboard/views/resources_view.py
  128. +28 −0 gui/dashboard/views/scaling_picker.py
  129. +226 −0 gui/dashboard/views/stats_cards.py
  130. +193 −0 gui/dashboard/views/table.py
  131. +101 −0 gui/items.csv
  132. +3 −0 gui/requirements.txt
  133. +5 −0 gui/rxconfig.py
  134. +2 −0 kalavai_client/__init__.py
  135. +5 −0 kalavai_client/__main__.py
  136. 0 kalavai_client/assets/__init__.py
  137. +201 −0 kalavai_client/assets/apps.yaml
  138. +83 −0 kalavai_client/assets/apps_values.yaml
  139. +8 −0 kalavai_client/assets/docker-compose-gui.yaml
  140. +109 −0 kalavai_client/assets/docker-compose-template.yaml
  141. +12 −0 kalavai_client/assets/nginx.conf
  142. +19 −0 kalavai_client/assets/pool_config_template.yaml
  143. +12 −0 kalavai_client/assets/pool_config_values.yaml
  144. +19 −0 kalavai_client/assets/user_workspace.yaml
  145. +29 −0 kalavai_client/assets/user_workspace_values.yaml
  146. +0 −2 kalavai_client/auth.py
  147. +241 −0 kalavai_client/bridge_api.py
  148. +43 −0 kalavai_client/bridge_models.py
  149. +687 −850 kalavai_client/cli.py
  150. +143 −53 kalavai_client/cluster.py
  151. +1,034 −0 kalavai_client/core.py
  152. +58 −0 kalavai_client/env.py
  153. +154 −138 kalavai_client/utils.py
  154. +26 −0 publish.sh
  155. +55 −31 pyproject.toml
  156. +0 −1 templates/.gitignore
  157. +0 −51 templates/README.md
  158. +0 −31 templates/aphrodite/Dockerfile
  159. +0 −80 templates/aphrodite/README.md
  160. +0 −75 templates/aphrodite/examples/qwen2.5-0.5B.yaml
  161. +0 −60 templates/aphrodite/run_model.sh
  162. +0 −118 templates/aphrodite/template.yaml
  163. +0 −70 templates/aphrodite/values.yaml
  164. +0 −28 templates/dummy/README.md
  165. +0 −33 templates/dummy/template.yaml
  166. +0 −6 templates/dummy/values.yaml
  167. +0 −27 templates/vllm/Dockerfile
  168. +0 −73 templates/vllm/README.md
  169. +0 −70 templates/vllm/examples/qwen2.5-0.5B.yaml
  170. +0 −119 templates/vllm/ray_init.sh
  171. +0 −33 templates/vllm/run_model.sh
  172. +0 −116 templates/vllm/template.yaml
  173. +0 −70 templates/vllm/values.yaml
  174. +15 −0 test/server-compose.yaml
  175. +16 −0 test/worker-compose.yaml
119 changes: 119 additions & 0 deletions .github/workflows/release.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,119 @@
---
name: Publish Python 🐍 distribution 📦 to PyPI and TestPyPI

on: # yamllint disable-line rule:truthy
release:
types: [created]

jobs:
build:
name: Build distribution 📦
runs-on: ubuntu-24.04

steps:
- uses: actions/checkout@v4
with:
persist-credentials: false
- name: Set up Python
uses: actions/setup-python@v5
with:
python-version: "3.10"
- name: Install pypa/build
run: >-
pip3 install .[dev]
- name: Build a binary wheel and a source tarball
run: python3 -m build
- name: Store the distribution packages
uses: actions/upload-artifact@v4
with:
name: python-package-distributions
path: dist/

publish-to-pypi:
name: >-
Publish Python 🐍 distribution 📦 to PyPI
if: startsWith(github.ref, 'refs/tags/') # only publish to PyPI on tag pushes
needs:
- build
runs-on: ubuntu-24.04
environment:
name: pypi
url: https://pypi.org/p/kalavai-client
permissions:
id-token: write # IMPORTANT: mandatory for trusted publishing

steps:
- name: Download all the dists
uses: actions/download-artifact@v4
with:
name: python-package-distributions
path: dist/
- name: Publish distribution 📦 to PyPI
uses: pypa/gh-action-pypi-publish@release/v1

# github-release:
# name: >-
# Sign the Python 🐍 distribution 📦 with Sigstore
# and upload them to GitHub Release
# needs:
# - publish-to-pypi
# runs-on: ubuntu-24.04

# permissions:
# contents: write # IMPORTANT: mandatory for making GitHub Releases
# id-token: write # IMPORTANT: mandatory for sigstore

# steps:
# - name: Download all the dists
# uses: actions/download-artifact@v4
# with:
# name: python-package-distributions
# path: dist/
# - name: Sign the dists with Sigstore
# uses: sigstore/gh-action-sigstore-python@v3.0.0
# with:
# inputs: >-
# ./dist/*.tar.gz
# ./dist/*.whl
# - name: Create GitHub Release
# env:
# GITHUB_TOKEN: ${{ github.token }}
# run: >-
# gh release create
# "$GITHUB_REF_NAME"
# --repo "$GITHUB_REPOSITORY"
# --notes ""
# - name: Upload artifact signatures to GitHub Release
# env:
# GITHUB_TOKEN: ${{ github.token }}
# # Upload to GitHub Release using the `gh` CLI.
# # `dist/` contains the built packages, and the
# # sigstore-produced signatures and certificates.
# run: >-
# gh release upload
# "$GITHUB_REF_NAME" dist/**
# --repo "$GITHUB_REPOSITORY"

publish-to-testpypi:
name: Publish Python 🐍 distribution 📦 to TestPyPI
needs:
- build
runs-on: ubuntu-24.04

environment:
name: testpypi
url: https://test.pypi.org/p/kalavai-client

permissions:
id-token: write # IMPORTANT: mandatory for trusted publishing

steps:
- name: Download all the dists
uses: actions/download-artifact@v4
with:
name: python-package-distributions
path: dist/
- name: Publish distribution 📦 to TestPyPI
uses: pypa/gh-action-pypi-publish@release/v1
with:
repository-url: https://test.pypi.org/legacy/
3 changes: 3 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
@@ -1,3 +1,6 @@
# local tests
local_deployments/*

# Byte-compiled / optimized / DLL files
__pycache__/
*.py[cod]
3 changes: 3 additions & 0 deletions MANIFEST.in
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
# MANIFEST.in

recursive-include ../assets *
Loading