π₯ The fastest local AI engine for Apple Silicon. Optimised for agentic use.
β88May 24, 2026Updated 2 months ago
Alternatives and similar repositories for lightning-mlx
Users that are interested in lightning-mlx are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 3x decode TPS increase On Qwen 3.6 27B @ temp 0.6 | Native MTP Speculative Decoding On Apple Silicon With No External Drafter.β1,125Updated this week
- vLLM Metal plugin powered by mlx-swift β high-performance LLM inference on Apple Siliconβ274Jun 3, 2026Updated 2 months ago
- Free, open-source fan control for Apple Silicon Macs (M1, M2, M3, M4, M5). Menu bar app + CLI. Alternative to Macs Fan Control, TG Pro, Aβ¦β64Apr 19, 2026Updated 3 months ago
- A native Mac App for LLM fine-tuning on Apple Silicon β fully on-device, fully open source.β252Jul 16, 2026Updated 2 weeks ago
- MLX Studio - Home of JANG_Q - Image Gen/Edit + Chat/Code All in one - + OpenClaw (Anthropic API)β924Updated this week
- GPU virtual machines on DigitalOcean Gradient AI β’ AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 60-95% fewer tokens, same answersβ30May 19, 2026Updated 2 months ago
- JANG β GGUF for MLX. YOU MUST USE JANG_Q RUNTIME. Adaptive Mixed-Precision Quantization + Runtime for Apple Siliconβ218Updated this week
- REAP expert pruning for MoE LLMs on Apple Silicon via MLXβ58Mar 16, 2026Updated 4 months ago
- Moshi-Finetune-MLX lets you fine-tune Moshi (Native, Real-Time, Speech-to-Speech) models all on Apple Silicon.β26Apr 21, 2026Updated 3 months ago
- Explore your Tailwind config visually directly in your browser while developing.β15Mar 2, 2026Updated 5 months ago
- LLM inference server with continuous batching & SSD caching for Apple Silicon β managed from the macOS menu barβ18,407Updated this week
- Implements harmful/harmless refusal removal using pure HF Transformersβ23May 8, 2025Updated last year
- Native Excel (.xlsx) generator tool for Open WebUI β multi-sheet, Tables, live formulas, charts. MIT.β19Jul 19, 2026Updated 2 weeks ago
- Enterprise-grade distributed AI agent framework | Develop β Deploy β Observe | K8s-native | Dynamic DI | Auto-failover | Multi-LLM | Pythβ¦β37Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer β’ AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- NuxtJS module for Nhostβ10Jan 26, 2022Updated 4 years ago
- A macOS app for running parallel AI agents in sandboxed local VMsβ20May 18, 2026Updated 2 months ago
- Exact speculative decoding on Apple Silicon, powered by MLX.β382Apr 20, 2026Updated 3 months ago
- Copy My Writing is a command-line tool for generating content based on your personal writing style.β11Oct 12, 2025Updated 9 months ago
- vMLX - JANGTQ Uber Compressed MLX Models - L2 Disk Cache (survives restart) + L1 Paged (super fast ttft) + Hybrid SSM Scheduler + Cont Bβ¦β785Updated this week
- Pricing and calibration modelsβ13Mar 28, 2025Updated last year
- The harness engineering framework for coding agentsβ29Updated this week
- Use PartyKit π with Nuxt πβ12Dec 30, 2024Updated last year
- π Web search for pi β 12 providers, one tool. Pick what you need.β46Jun 10, 2026Updated last month
- Deploy to Railway using AI coding agents - Free Credits Offer β’ AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A tmux plugin that copies words from your pane buffer using flash.nvim style labels.β45Updated this week
- Lightweight Docker image for launching multiple MCP servers via MCPO with unified OpenAPI accessβ40May 26, 2025Updated last year
- A better way to handle errors. Both data and errors are declared with const, available at the top level, and non-nullable (once the otherβ¦β11Sep 5, 2024Updated last year
- β21Updated this week
- Python SDK for Modaicβ27Jul 23, 2026Updated last week
- Voice to brain interface π¦π€π§ for OpenClaw, Hermes, PI, etcβ20Updated this week
- Behind the scene, project based mark management πͺβ15Dec 1, 2025Updated 8 months ago
- proof-of-concept to bring COSMIC + Niri + Bluefin goodies together into a scroller desktop OSβ15Jan 5, 2026Updated 6 months ago
- Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Includes MLX Core macOS app with chat, agentβ¦β418Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer β’ AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- my nuclei templates #newβ10Jun 24, 2024Updated 2 years ago
- Hand-made Improved Nuclei Templates!πͺ΄β13Jun 12, 2023Updated 3 years ago
- Is a high-performance Augmented Recovery-Generation (RAG) solution based on Redis, Qdrant or PostgreSQL. It offers a high-level interfaceβ¦β30Jan 6, 2026Updated 6 months ago
- β15Dec 14, 2025Updated 7 months ago
- β47Jul 14, 2024Updated 2 years ago
- Review Pi agent work, run visible tmux workers, and save evidence outside model contextβ17Jul 25, 2026Updated last week
- Links to all the source code and solutions I reference in my O'Reilly Introduction to Docker video tutorialβ11Dec 10, 2014Updated 11 years ago