Running a big model on a small laptop
☆4,259Mar 19, 2026Updated 6 months ago
Alternatives and similar repositories for flash-moe
Users that are interested in flash-moe are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Flash weight streaming for MLX: run massive models larger than your RAM on Apple Silicon.☆138Jun 13, 2026Updated 4 months ago
- ☆226Mar 24, 2026Updated 6 months ago
- LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar☆22,905Updated this week
- Hundreds of models & providers. One command to find what runs on your hardware.☆38,066Updated this week
- ☆7,021Jul 20, 2026Updated 2 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- AI agents running research on single-GPU nanochat training automatically☆98,097Mar 26, 2026Updated 6 months ago
- DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm☆23,928Oct 8, 2026Updated last week
- Training neural networks on Apple Neural Engine via reverse-engineered private APIs☆7,272Mar 10, 2026Updated 7 months ago
- Running a big model on a small laptop☆58Mar 28, 2026Updated 6 months ago
- Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦☆42,703Updated this week
- an open source, extensible AI agent that goes beyond code suggestions - install, execute, edit, and test with any LLM☆55,412Updated this week
- Automation foundation model for tiny devices: 2-bit, 8-29 MB, tool calls, ASR, structured extraction and embeddings on phones, wearables,…☆14,080Updated this week
- AirLLM 2.8T LLM inference with single 4GB GPU☆39,300Updated this week
- MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.☆5,636Updated this week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Run models too big for your Mac's memory☆666Oct 3, 2026Updated 2 weeks ago
- Lossless DFlash speculative decoding for MLX on Apple Silicon☆789Aug 20, 2026Updated last month
- Official inference framework for 1-bit LLMs☆41,188Jul 27, 2026Updated 2 months ago
- DFlash: Block Diffusion for Flash Speculative Decoding☆6,178Aug 18, 2026Updated 2 months ago
- Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.☆78,217Updated this week
- AI coworker with memory and collaboration☆18,032Updated this week
- Scale computer-use 2.0 with open-source drivers, cross-OS sandboxes, and benchmarks for training, evaluation, and data generation.☆30,139Updated this week
- ⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache…☆784Updated this week
- Run frontier AI locally.☆47,949Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Autonomous experiment loop extension for pi☆8,194Oct 7, 2026Updated last week
- OpenShell is the safe, private runtime for autonomous AI agents.☆16,621Updated this week
- Fully automatic censorship removal for language models☆35,722Updated this week
- mac code — Claude Code, but it runs on your Mac for free. 35B AI agent at 30 tok/s via Apple Silicon flash-paging. $0/month.☆1,036Apr 9, 2026Updated 6 months ago
- The fastest way to run Qwen 3.8 Flash Next, Qwen 3.8 27B and Ternary Bonsai 2 27B on a Mac: 125 tok/s in OpenCode on an M5 Max, and a 27B…☆2,597Oct 10, 2026Updated last week
- LLM speculative inference server for heterogeneous hardware & consumer GPUs☆2,928Updated this week
- The open-source app everyone uses to manage agents at work☆104,125Updated this week
- Adaptive Test-time Learning and Autonomous Specialization☆2,108Updated this week
- A vector index built on TurboQuant, written in Rust with Python bindings☆17,400Oct 7, 2026Updated last week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Open-source Agent Operating System☆18,211Jul 2, 2026Updated 3 months ago
- Fine-tune LLMs on your Mac with Apple Silicon. SFT, DPO, GRPO, Vision, TTS, STT, Embedding, and OCR fine-tuning — natively on MLX. Unslot…☆1,444Jun 23, 2026Updated 3 months ago
- The best-benchmarked open-source AI memory system. And it's free.☆59,626Updated this week
- GLM-OCR: Accurate × Fast × Comprehensive☆7,520Updated this week
- An open-source long-horizon SuperAgent harness that researches, codes, and creates. With the help of sandboxes, memories, tools, skill, s…☆84,069Updated this week
- TimesFM (Time Series Foundation Model) is a pretrained time-series foundation model developed by Google Research for time-series forecast…☆34,592Sep 29, 2026Updated 2 weeks ago
- Open-Source Frontier Voice AI☆54,865Oct 8, 2026Updated last week