Topic

Trending local-llm repos

Repos whose maintainers tagged them local-llm on GitHub (topics are labels that describe what a project is about), ranked by stars gained.

10 repos gained about 1.7k stars in the last 7 days. Leading this week: mw00/project-maya, MakazhanAlpamys/Soup and Nongfsq/ftop.

10 repos tracked · ranked by stars gained · updated hourly

Related topics:llm python self-hosted swift

* / est. Estimated: until we have enough daily snapshots for a repo, its gain is total stars ÷ days since creation. Measured numbers replace estimates automatically.

1
mw00/project-maya
Project Maya - run GLM-5.3-Flash (321B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or Windows. Why it matters: useful plumbing for shipping LLM-powered features.
LLM toolingC++★ 766
+105*
stars today
2
MakazhanAlpamys/Soup
Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU. Why it matters: useful plumbing for shipping LLM-powered features.
LLM toolingPython★ 8.9k
+45
stars today
3
Nongfsq/ftop
A small, quiet system monitor for Apple Silicon Macs: one floating glass panel that works at any size. Why it matters: helps you run models on your own hardware without an API bill.
Local LLMsSwift★ 239
+33*
stars today
4
1nikitas/NIKA_desktop
Native AI assistant for macOS, built with SwiftUI and llama.cpp. Run local LLMs offline, work with PDFs, and create custom AI assistants. Why it matters: helps you run models on your own hardware without an API bill.
Local LLMsSwift★ 30
+30*
stars today
5
prabanta-dev/janas
37 tok/s from Qwen3-Next-80B (48 GB) on a 32 GB laptop, 24 without drafts vs 2.8 for llama.cpp; reading 62 vs 16 tok/s. Why it matters: helps you run models on your own hardware without an API bill.
Local LLMsC★ 341
+20
stars today
6
PurpleDoubleD/locally-uncensored
The all-in-one local AI studio for your desktop: chat, image and video generation and a coding agent in one free, open source app. Why it matters: relevant if AI is part of your coding workflow.
Coding agentsTypeScript★ 2.3k
+11
stars today
7
HKUDS/nanobot
Ultra-lightweight, open-source, self-hosted personal AI agent framework in Python with WebUI, tools, memory, MCP, multi-agent workflows… Why it matters: worth a look if you build or run autonomous agents.
AI agentsPython★ 49k
+10
stars today
8
syv-ai/HyperQwen
Serve large Qwen models fast on the GPUs you actually own. Qwen3.8-27B on a single 24 GB card with vLLM: 127 tok/s single-user (381 when the… Why it matters: useful plumbing for shipping LLM-powered features.
LLM toolingPython★ 2k
+9
stars today
9
sgaofen/humanizer-local-model
Rewrites AI drafts so they read like a person wrote them — runs locally, keeps the facts. Why it matters: helps you run models on your own hardware without an API bill.
Local LLMsPython★ 239
+8
stars today
10
maziyarpanahi/openmed
Local-first healthcare AI: clinical NER and HIPAA PII de-identification on hardware you control. Why it matters: helps you run models on your own hardware without an API bill.
Local LLMsPython★ 5.7k
+4
stars today