LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
☆10,652Apr 17, 2026Updated this week
Alternatives and similar repositories for omlx
Users that are interested in omlx are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Tree-based speculative decoding for Apple Silicon (MLX). ~10-15% faster than DFlash on code, ~1.5x over autoregressive. First MLX port wi…☆94Updated this week
- OpenAI and Anthropic compatible server for Apple Silicon. Run LLMs and vision-language models (Llama, Qwen-VL, LLaVA) with continuous bat…☆849Updated this week
- Run frontier AI locally.☆43,799Updated this week
- MLX: An array framework for Apple silicon☆25,423Updated this week
- Run LLMs with MLX☆4,805Updated this week
- Serverless GPU API endpoints on Runpod - Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Production-ready platform for agentic workflow development.☆138,217Updated this week
- JANG — GGUF for MLX. YOU MUST USE JANG_Q RUNTIME. Adaptive Mixed-Precision Quantization + Runtime for Apple Silicon☆99Apr 6, 2026Updated last week
- User-friendly AI Interface (Supports Ollama, OpenAI API, ...)☆131,509Apr 13, 2026Updated last week
- Own your AI. The native macOS harness for AI agents -- any model, persistent memory, autonomous execution, cryptographic identity. Built …☆4,952Updated this week
- The agent that grows with you☆87,104Updated this week
- Get up and running with Kimi-K2.5, GLM-5, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.☆169,151Updated this week
- Your own personal AI assistant. Any OS. Any Platform. The lobster way. 🦞☆359,787Updated this week
- A generative speech model for daily dialogue.☆39,077Apr 10, 2026Updated last week
- Transforms complex documents like PDFs and Office docs into LLM-ready markdown/JSON for your Agentic workflows.☆60,483Updated this week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Mobile and Web client for Codex and Claude Code, with realtime voice, encryption and fully featured☆17,859Updated this week
- A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX framework, providing efficient speec…☆6,730Updated this week
- The open source coding agent.☆144,718Updated this week
- AI productivity studio with smart chat, autonomous agents, and 300+ assistants. Unified access to frontier LLMs☆43,409Updated this week
- 🐹 Deep clean and optimize your Mac.☆47,987Updated this week
- The all-in-one AI productivity accelerator. On device and privacy first with no annoying setup or configuration.☆58,564Updated this week
- ⚡ Python-free Rust inference server — OpenAI-API compatible. GGUF + SafeTensors, hot model swap, auto-discovery, single binary. FREE now,…☆3,977Mar 26, 2026Updated 3 weeks ago
- LLM inference in C/C++☆104,862Updated this week
- MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically designed for Apple Silicon (M-series) chips. I…☆703Mar 10, 2026Updated last month
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to creat…☆78,395Updated this week
- Autonomous coding agent right in your IDE, capable of creating/editing files, executing commands, using the browser, and more with your p…☆60,433Updated this week
- The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface.☆108,818Updated this week
- MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.☆4,333Apr 9, 2026Updated last week
- Fair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host or cloud, 400+ in…☆184,285Updated this week
- The ultimate space for work and life — to find, build, and collaborate with agent teammates that grow with you. We are taking agent harne…☆75,345Updated this week
- "CLI-Anything: Making ALL Software Agent-Native" -- CLI-Hub: https://clianything.cc/☆30,368Apr 11, 2026Updated last week
- Unsloth Studio is a web UI for training and running open models like Gemma 4, Qwen3.5, DeepSeek, gpt-oss locally.☆61,312Updated this week
- The awesome collection of OpenClaw skills. 5,400+ skills filtered and categorized from the official OpenClaw Skills Registry.🦞☆46,535Apr 4, 2026Updated 2 weeks ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Give your AI agent eyes to see the entire internet. Read & search Twitter, Reddit, YouTube, GitHub, Bilibili, XiaoHongShu — one CLI, zero…☆17,329Updated this week
- An agentic skills framework & software development methodology that works.☆159,241Updated this week
- omo; the best agent harness - previously oh-my-opencode☆52,667Updated this week
- No fortress, purely open ground. OpenManus is Coming.☆55,791Feb 11, 2026Updated 2 months ago
- ✨ Light and Fast AI Assistant. Support: Web | iOS | MacOS | Android | Linux | Windows☆87,713Dec 2, 2025Updated 4 months ago
- Python tool for converting files and office documents to Markdown.☆111,516Updated this week
- OpenClaw skill: 自动收集社交媒体内容并整理成结构化笔记存入飞书文档☆224Mar 31, 2026Updated 2 weeks ago