Standardized Serverless ML Inference Platform on Kubernetes

Module to Automatically maximize the utilization of GPU resources in a Kubernetes cluster through real-time dynamic partitioning and elastic quotas - Effortless optimization at its finest!

Autoscale LLM (vLLM, SGLang, LMDeploy) inferences on Kubernetes (and others)

An awesome & curated list of best LLMOps tools for developers

AGiXT is a dynamic AI Agent Automation Platform that seamlessly orchestrates instruction management and complex task execution across diverse AI providers. Combining adaptive memory, smart features…

OpenAI compatible API for serving LLAMA-2 model

🪶 Lightweight OpenAI drop-in replacement for Kubernetes

ChatGPT web interface using the OpenAI API

Streamlit Web UI for AGiXT

🤖 The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transf…

go-skynet helm chart repository

AI chat for any model.

✨ Light and Fast AI Assistant. Support: Web | iOS | MacOS | Android | Linux | Windows

⏩ Create, share, and use custom AI code assistants with our open-source IDE extensions and hub of models, rules, prompts, docs, and other building blocks

Python bindings for llama.cpp

👨‍💻 An awesome and curated list of best code-LLM for research.

🚀 PR-Agent (Qodo Merge open-source): An AI-Powered 🤖 Tool for Automated Pull Request Analysis, Feedback, Suggestions and More! 💻🔍

User-friendly AI Interface (Supports Ollama, OpenAI API, ...)