OSS Radar
SponsorYour product here, sponsor OSS Radar →
jundot avatar

jundot/omlx

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar. Why it matters: useful plumbing for shipping LLM-powered features.

GitHub description: LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

View on GitHubWebsite

Stars

23k

Last 24h

+94est.

Last 7 days

+658est.

Forks

2k

Star history (last 1 snapshot)

Star history for jundot/omlx

Only one snapshot so far. The chart fills in as OSS Radar collects daily snapshots.

* / est. Estimated: until we have enough daily snapshots for a repo, its gain is total stars ÷ days since creation. Measured numbers replace estimates automatically.

Maintainer? Add the badge to your README

Shows your live OSS Radar rank and links back here. Updates hourly.

OSS Radar badge preview
[![Trending on OSS Radar](https://ossradar.net/badge/jundot/omlx)](https://ossradar.net/repo/jundot/omlx)
<a href="https://ossradar.net/repo/jundot/omlx"><img src="https://ossradar.net/badge/jundot/omlx" alt="Trending on OSS Radar"></a>

About omlx

jundot/omlx is a Python project in the LLM tooling category, created 8 months ago. It has 23k GitHub stars and 2k forks, and gained +658 stars over the last 7 days (early estimate), ranking #65 of 166 LLM tooling repos tracked by OSS Radar this week.

See more trending LLM tooling repos or the top AI repos this week.

Language
Python
Category
LLM tooling
Created
Feb 13, 2026
Last push
Oct 13, 2026
  • apple-silicon
  • inference-server
  • llm
  • macos
  • mlx
  • openai-api

Similar rising repos

  • drumih/turbo-fieldfare+551est.

    Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook. Why it matters: useful plumbing for shipping LLM-powered features.

  • StayLameBro/backburner+591est.

    Your iPhone helps your Mac run a 27B model: faster prompt reading and more context over a USB-C cable. Why it matters: useful plumbing for shipping LLM-powered features.

  • AlexsJones/llmfit+1.1kest.

    Hundreds of models & providers. One command to find what runs on your hardware. Why it matters: useful plumbing for shipping LLM-powered features.

  • Folkbench/folkbench+515est.

    AI API 中转站评测排行与切换工具：实测可用率、延迟与价格 · Open-source AI API relay benchmark, rankings & switcher for Claude Code / Codex. Why it matters: useful plumbing for shipping LLM-powered features.

  • Graphify-Labs/graphify+4.6kest.

    Turn any codebase, with its docs, SQL schemas, configs, and PDFs, into a queryable knowledge graph. A /graphify skill for Claude Code, Cursor, Codex… Why it matters: useful plumbing for shipping LLM-powered features.

  • NousResearch/hermes-agent+4kest.

    The agent that grows with you. Why it matters: useful plumbing for shipping LLM-powered features.