Terminal based AI chatbot with infinite personalities, using local LLMs with Ollama.
Also available for IRC and Matrix chat protocols.
Install and familiarize yourself with Ollama, make sure you can run local LLMs, etc.
You can install it with this command:
curl https://ollama.ai/install.sh | sh
Once it's all set up, you'll need to download the models you want to use. You can play with the available ones and see what works best for you. Add those to the config.json file. If you want to use the ones I've included, just run ollama pull modelname for each.
You'll also need to install rich and prompt_toolkit
pip3 install rich prompt_toolkit
python3 ollamarama.py
/help shows the help menu
/reset resets to default personality
/clear resets and clears the screen
/stock sets bot to stock model settings
/persona activates personality changer
/custom use a custom system prompt
/model list models and change the current model
/model reset reset to default model
/temperature changes temperature
/top_p changes top_p
/repeat_penalty changes repeat_penalty
/quit or /exit exits the program