Running a big model on a small laptop
☆4,087Mar 19, 2026Updated 5 months ago
Alternatives and similar repositories for flash-moe
Users that are interested in flash-moe are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Flash weight streaming for MLX: run massive models larger than your RAM on Apple Silicon.☆131Jun 13, 2026Updated 2 months ago
- ☆222Mar 24, 2026Updated 5 months ago
- LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar☆21,503Updated this week
- ☆7,021Jul 20, 2026Updated last month
- Hundreds of models & providers. One command to find what runs on your hardware.☆35,009Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- AI agents running research on single-GPU nanochat training automatically☆95,351Mar 26, 2026Updated 5 months ago
- Training neural networks on Apple Neural Engine via reverse-engineered private APIs☆7,253Mar 10, 2026Updated 5 months ago
- Running a big model on a small laptop☆57Mar 28, 2026Updated 5 months ago
- DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm☆22,135Updated this week
- Run models too big for your Mac's memory☆666Aug 27, 2026Updated last week
- an open source, extensible AI agent that goes beyond code suggestions - install, execute, edit, and test with any LLM☆53,999Updated this week
- Lossless DFlash speculative decoding for MLX on Apple Silicon☆778Aug 20, 2026Updated 2 weeks ago
- MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.☆5,477Updated this week
- DFlash: Block Diffusion for Flash Speculative Decoding☆6,056Aug 18, 2026Updated 2 weeks ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- AirLLM 70B inference with single 4GB GPU☆33,815Updated this week
- Official inference framework for 1-bit LLMs☆40,228Jul 27, 2026Updated last month
- Open-source AI coworker, with memory☆17,490Updated this week
- Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.☆75,758Updated this week
- mac code — Claude Code, but it runs on your Mac for free. 35B AI agent at 30 tok/s via Apple Silicon flash-paging. $0/month.☆1,032Apr 9, 2026Updated 4 months ago
- Autonomous experiment loop extension for pi☆8,010Sep 1, 2026Updated last week
- ⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache…☆760Updated this week
- Run frontier AI locally.☆47,299Aug 25, 2026Updated last week
- LLM speculative inference server for heterogeneous hardware & consumer GPUs☆2,839Updated this week
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦☆27,002Updated this week
- Adaptive Test-time Learning and Autonomous Specialization☆2,081Updated this week
- Open-source Agent Operating System☆18,165Jul 2, 2026Updated 2 months ago
- Fine-tune LLMs on your Mac with Apple Silicon. SFT, DPO, GRPO, Vision, TTS, STT, Embedding, and OCR fine-tuning — natively on MLX. Unslot…☆1,401Jun 23, 2026Updated 2 months ago
- Fully automatic censorship removal for language models☆30,811Updated this week
- The best-benchmarked open-source AI memory system. And it's free.☆58,897Updated this week
- The open-source app everyone uses to manage agents at work☆80,165Updated this week
- 14MB foundation model for tiny devices; phones, wearables, smart home, and robots.☆10,499Updated this week
- GLM-OCR: Accurate × Fast × Comprehensive☆7,406Apr 21, 2026Updated 4 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Scale computer-use 2.0 with open-source drivers, cross-OS fleets, and benchmarks for training, evaluation, and data generation.☆22,302Updated this week
- An open-source long-horizon SuperAgent harness that researches, codes, and creates. With the help of sandboxes, memories, tools, skill, s…☆81,854Updated this week
- A lightweight alternative to OpenClaw that runs in containers for security. Connects to WhatsApp, Telegram, Slack, Discord, Gmail and oth…☆30,714Updated this week
- Open-Source Frontier Voice AI☆53,885Updated this week
- Run LLMs with MLX☆6,917Updated this week
- TimesFM (Time Series Foundation Model) is a pretrained time-series foundation model developed by Google Research for time-series forecast…☆31,841Updated this week
- A vector index built on TurboQuant, written in Rust with Python bindings☆16,681Aug 21, 2026Updated 2 weeks ago