Postgres with GPUs for ML/AI apps.

[Unmaintained, see README] An ecosystem of Rust libraries for working with large language models

TensorZero creates a feedback loop for optimizing LLM applications — turning production data into smarter, faster, and cheaper models.

A blazing fast inference solution for text embeddings models

Korvus is a search SDK that unifies the entire RAG pipeline in a single database query. Built on top of Postgres with bindings for Python, JavaScript, Rust and C.

🧠 Motorhead is a memory and information retrieval server for LLMs.

Fast, streaming indexing, query, and agentic LLM applications in Rust

An Open-Source Machine Learning Framework in Rust Δ

⚡ Edgen: Local, private GenAI server alternative to OpenAI. No GPU required. Run AI models locally: LLMs (Llama2, Mistral, Mixtral...), Speech-to-text (whisper) and many others.

Powerful Powerful Machine Learning library with GPU, CPU and WASM backends

AI no jimaku gumi (AIの字幕組), a subtitle maker for video using AI.

A Deep Learning and preprocessing framework in Rust with support for CPU and GPU.

OpenAI's Gym written in pure Rust for blazingly fast performance

The fastest CLI tool for prompting LLMs. Including support for prompting several LLMs at once!

A Package Manager for Machine Learning Datasets and Models.

"Just hoof it!" - A spotlight like interface to Ollama

High-scale LLM gateway, written in Rust. OpenTelemetry-based observability included

open source tooling for AI search and understanding

iOS Swift app example - AI avatars generator like Lensa: Stable Diffusion In Action

Automated Machine Learning in Rust 🦀