AbliteratedOutTheBox alternatives

heterodoxin/AbliteratedOutTheBox (131 stars, +131 this week): llama.cpp fork that abliterates at inference.

Below are 12 other LLM tooling repos tracked by OSS Radar that share at least two GitHub topics with AbliteratedOutTheBox, ordered by how many topics overlap, then by stars gained in the last 7 days. Topic overlap means a similar problem space, not a drop-in replacement, so check each project's README.

1. 1. open-webui/open-webui

   +559/wk

   User-friendly AI Interface (Supports Ollama, OpenAI API, ...).

   157k stars · Python · shared topics: AI, LLM · open-webui alternatives

2. 2. unslothai/unsloth

   +292/wk

   Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.

   79k stars · Python · shared topics: AI, LLM · unsloth alternatives

3. 3. rohitg00/ai-engineering-from-scratch

   +2.4k/wk

   Learn AI Engineering! Learn it. Build it. Ship it for others.

   74k stars · Python · shared topics: AI, LLM · ai-engineering-from-scratch alternatives

4. 4. NousResearch/hermes-agent

   +1.8k/wk

   The agent that grows with you.

   257k stars · Python · shared topics: AI, LLM · hermes-agent alternatives

5. 5. Folkbench/folkbench

   +1.7k/wk

   Desktop app that switches Claude Code, Codex and other tools between AI API relays, showing their uptime and latency.

   3.7k stars · Rust · shared topics: AI, LLM · folkbench alternatives

6. 6. headroomlabs-ai/headroom

   +1.6k/wk

   Compress tool outputs, logs, files, and RAG chunks before they reach the LLM.

   78k stars · Python · shared topics: AI, LLM · headroom alternatives

7. 7. JuliusBrussee/caveman

   +1.4k/wk

   why use many token when few token do trick. Viral skill + proxy for coding agents that cuts 65% of tokens by talking like a caveman.

   115k stars · Go · shared topics: AI, LLM · caveman alternatives

8. 8. vllm-project/vllm

   +1.4k/wk

   A high-throughput and memory-efficient inference and serving engine for LLMs.

   96k stars · Python · shared topics: inference, LLM · vllm alternatives

9. 9. AstrBotDevs/AstrBot

   +1.2k/wk

   AI Agent Assistant & development framework that integrates lots of IM platforms, LLMs, plugins and AI feature, and can be your openclaw…

   43k stars · Python · shared topics: AI, LLM · AstrBot alternatives

10. 10. f/prompts.chat

    +984/wk

    f.k.a. Awesome ChatGPT Prompts. Share, discover, and collect prompts from the community.

    175k stars · HTML · shared topics: AI, LLM · prompts.chat alternatives

11. 11. ollama/ollama

    +902/wk

    Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

    185k stars · Go · shared topics: LLM · ollama alternatives

12. 12. sgl-project/sglang

    +715/wk

    SGLang is a high-performance serving framework for large language models and multimodal models.

    38k stars · Python · shared topics: inference, LLM · sglang alternatives

More: all trending LLM tooling repos · trending AI repos · trending LLM repos · compare AbliteratedOutTheBox with the top 2 · alternatives to other trending repos