Skip to content

Latest commit

 

History

History
55 lines (41 loc) · 2.01 KB

README.md

File metadata and controls

55 lines (41 loc) · 2.01 KB

Oxide

Oxide is a lightweight containerized model inferencing server built without unnecessary frameworks! 🦀

Oxide Home Page

Features

  • Inferences custom models on any hardware you want.
  • Choose between custom tokenizers, full control over your model.
  • incredibly lightweight

Installation

Installing Oxide can be done from source.

From Source

Clone this repository,

git clone https://github.com/dawi369/Oxide.git

To render run server, navigate to the root of the repo directory, and run

cargo run --release

Usage

Oxide: Inference your custom models on the cloud!

Usage:
    curl -X POST http://<your_FQDS_or_localhost>>/inference \
    -H "Content-Type: text/plain" \
    -d "Please generate a warm welcome."

Author

(c) David Erwin