The Natural Language Shell integrates OpenAI's GPTs, Anthropic's Claude, or local GGUF-formatted LLMs directly into the terminal experience, allowing operators to describe their tasks in either POSIX commands or fluent human language

Friendly interface to chat with an Ollama instance.

Modular Rust transformer/LLM library using Candle

A fullstack Rust + React chat app using open-source Llama language models

Actor based multi-llm registry + runner.

LLaMA2 + Rust

Generic persona (Ollama discord bot) but in Rust.

Attempt to summarize text from `stdin`, using a large language model (locally and offline), to `stdout`

Portable LLM - A rust library for LLM inference

Yet another `llama.cpp` Rust wrapper

ChatFlameBackend is an innovative backend solution for chat applications, leveraging the power of the Candle AI framework with a focus on the Mistral model

Simple LLM Rest API using Rust, Warp and Candle. Dedicated for quantized version of either phi-2 ( default) , Mistral, or Llama. Work using CPU or CUDA

llama2-wasm using rust

AI chatbot using Llama 2

AIonic: A unified, user-friendly Rust library for seamless integration with various public Large Language Model APIs, such as openAI or Bard