#

on-device-llms

Here are 2 public repositories matching this topic...

Lizonghang / prima.cpp

prima.cpp: Speeding up 70B-scale LLM inference on low-resource everyday home clusters

llama-cpp llm-inference on-device-llms distributed-ai

Updated Mar 30, 2025
C++

Mehdi-Letafati / multi-agent-workflows-from-scratch

Multi-agent workflows with Llama3: A private on-device multi-agent framework

python large-language-models generative-ai open-source-llm llama3 agentic-framework agentic-workflow multi-agent-llms private-ai-agents on-device-llms

Updated Jun 5, 2024
Python

Improve this page

Add a description, image, and links to the on-device-llms topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the on-device-llms topic, visit your repo's landing page and select "manage topics."