Running a big model on a small laptop
☆4,495Mar 19, 2026Updated 7 months ago
Alternatives and similar repositories for flash-moe
Users that are interested in flash-moe are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Flash weight streaming for MLX: run massive models larger than your RAM on Apple Silicon.☆142Jun 13, 2026Updated 4 months ago
- ☆228Mar 24, 2026Updated 7 months ago
- LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar☆23,438Updated this week
- ☆7,021Jul 20, 2026Updated 3 months ago
- DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm☆24,259Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Running a big model on a small laptop☆60Mar 28, 2026Updated 7 months ago
- Hundreds of models & providers. One command to find what runs on your hardware.☆38,735Updated this week
- AI agents running research on single-GPU nanochat training automatically☆99,453Mar 26, 2026Updated 7 months ago
- Training neural networks on Apple Neural Engine via reverse-engineered private APIs☆7,296Mar 10, 2026Updated 7 months ago
- A hierarchical inference engine for frontier MoE models: hot experts on the GPU (CUDA, Vulkan), warm ones in RAM, cold ones streamed from…☆48,644Updated this week
- AirLLM 2.8T LLM inference with single 4GB GPU☆41,908Updated this week
- an open source, extensible AI agent that goes beyond code suggestions - install, execute, edit, and test with any LLM☆56,327Updated this week
- MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.☆5,817Updated this week
- Run models too big for your Mac's memory☆669Oct 3, 2026Updated last month
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.☆79,150Updated this week
- Official inference framework for 1-bit LLMs☆41,493Jul 27, 2026Updated 3 months ago
- Scale computer-use 2.0 with open-source drivers, cross-OS sandboxes, and benchmarks for training, evaluation, and data generation.☆31,934Updated this week
- AI coworker with memory and collaboration☆18,147Updated this week
- Lossless DFlash speculative decoding for MLX on Apple Silicon☆793Aug 20, 2026Updated 2 months ago
- Run frontier AI locally.☆48,233Updated this week
- Training-free language model modification: Remove censorship, suppress slop, reduce sycophancy, and more☆39,857Updated this week
- DFlash: Block Diffusion for Flash Speculative Decoding☆6,218Aug 18, 2026Updated 2 months ago
- ⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache…☆797Updated this week
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- A vector index built on TurboQuant, written in Rust with Python bindings☆17,473Oct 7, 2026Updated last month
- OpenShell is the safe, private runtime for autonomous AI agents.☆21,241Updated this week
- mac code — Claude Code, but it runs on your Mac for free. 35B AI agent at 30 tok/s via Apple Silicon flash-paging. $0/month.☆1,035Apr 9, 2026Updated 6 months ago
- The open-source app everyone uses to manage agents at work☆111,926Updated this week
- The best-benchmarked open-source AI memory system. And it's free.☆60,450Updated this week
- Open-source Agent Operating System☆18,242Jul 2, 2026Updated 4 months ago
- Adaptive Test-time Learning and Autonomous Specialization☆2,111Updated this week
- Autonomous experiment loop extension for pi☆8,218Oct 7, 2026Updated last month
- LLM speculative inference server for heterogeneous hardware & consumer GPUs☆2,977Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- TimesFM (Time Series Foundation Model) is a pretrained time-series foundation model developed by Google Research for time-series forecast…☆35,294Sep 29, 2026Updated last month
- Fine-tune LLMs on your Mac with Apple Silicon. SFT, DPO, GRPO, Vision, TTS, STT, Embedding, and OCR fine-tuning — natively on MLX. Unslot…☆1,456Jun 23, 2026Updated 4 months ago
- The fastest way to run Qwen 3.8 Flash Next, Qwen 3.8 27B and Ternary Bonsai 2 27B on a Mac: 125 tok/s in OpenCode on an M5 Max, and a 27B…☆2,683Updated this week
- Sub-50mb agentic, voice and vision intelligence for consumer devices.☆14,540Updated this week
- An open-source long-horizon SuperAgent harness that researches, codes, and creates. With the help of sandboxes, memories, tools, skill, s…☆85,108Updated this week
- π RuView turns commodity WiFi signals into real-time spatial intelligence, vital sign monitoring, and presence detection — all without a …☆102,819Updated this week
- Run LLMs with MLX☆7,583Updated this week