Skip to content
@llmariner

LLMariner

LLMariner transforms your GPU clusters into a powerhouse for generative AI workloads.
README.md

LLMariner (= LLM + Mariner)

LLMariner transforms your GPU clusters into a powerhouse for generative AI workloads.

alt text

GitHub Organization Structure

LLMariner consists of multiple components, each of which has its own GitHub repository.

https://github.com/llmariner/llmariner is the main repository that contains the Helm chart, CLI, provisioning scripts, etc.

Links

Pinned Loading

  1. llmariner llmariner Public

    Extensible generative AI platform on Kubernetes with OpenAI-compatible APIs.

    Go 65 7

Repositories

Showing 10 of 19 repositories
  • inference-manager Public

    Inference Manager

    llmariner/inference-manager’s past year of commit activity
    Go 4 Apache-2.0 2 0 1 Updated Apr 15, 2025
  • model-manager Public

    Model Manager

    llmariner/model-manager’s past year of commit activity
    Python 1 Apache-2.0 0 0 0 Updated Apr 14, 2025
  • api-usage Public

    Sub-component of LLMariner. It aggregates API usage data from other API servers.

    llmariner/api-usage’s past year of commit activity
    Go 0 Apache-2.0 0 0 0 Updated Apr 14, 2025
  • llmariner Public

    Extensible generative AI platform on Kubernetes with OpenAI-compatible APIs.

    llmariner/llmariner’s past year of commit activity
    Go 65 Apache-2.0 7 7 0 Updated Apr 14, 2025
  • user-manager Public

    User Manager

    llmariner/user-manager’s past year of commit activity
    Go 0 Apache-2.0 1 0 0 Updated Apr 14, 2025
  • llmariner.github.io Public

    GitHub Pages site

    llmariner/llmariner.github.io’s past year of commit activity
    HTML 0 Apache-2.0 1 0 1 Updated Apr 14, 2025
  • homebrew-tap Public

    Homebrew Tap Repository

    llmariner/homebrew-tap’s past year of commit activity
    Ruby 0 0 0 0 Updated Apr 14, 2025
  • slackbot Public

    A Slackbot that talks to LLMariner

    llmariner/slackbot’s past year of commit activity
    Go 0 Apache-2.0 0 0 0 Updated Apr 10, 2025
  • job-manager Public

    Job Manager

    llmariner/job-manager’s past year of commit activity
    Go 0 Apache-2.0 1 0 1 Updated Apr 9, 2025
  • session-manager Public

    Session Manager

    llmariner/session-manager’s past year of commit activity
    Go 0 Apache-2.0 1 0 0 Updated Apr 1, 2025
View all repositories

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Top languages

Loading…

Most used topics

Loading…