Running a big model on a small laptop
☆4,151Mar 19, 2026Updated 6 months ago
Alternatives and similar repositories for flash-moe
Users that are interested in flash-moe are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Flash weight streaming for MLX: run massive models larger than your RAM on Apple Silicon.☆134Jun 13, 2026Updated 3 months ago
- ☆224Mar 24, 2026Updated 6 months ago
- LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar☆22,301Updated this week
- ☆7,035Jul 20, 2026Updated 2 months ago
- AI agents running research on single-GPU nanochat training automatically☆96,869Mar 26, 2026Updated 6 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Hundreds of models & providers. One command to find what runs on your hardware.☆37,208Updated this week
- Training neural networks on Apple Neural Engine via reverse-engineered private APIs☆7,262Mar 10, 2026Updated 6 months ago
- Running a big model on a small laptop☆57Mar 28, 2026Updated 6 months ago
- DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm☆22,736Sep 20, 2026Updated last week
- Run models too big for your Mac's memory☆668Aug 27, 2026Updated last month
- an open source, extensible AI agent that goes beyond code suggestions - install, execute, edit, and test with any LLM☆54,706Updated this week
- Lossless DFlash speculative decoding for MLX on Apple Silicon☆786Aug 20, 2026Updated last month
- MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.☆5,540Updated this week
- DFlash: Block Diffusion for Flash Speculative Decoding☆6,123Aug 18, 2026Updated last month
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- AirLLM 70B inference with single 4GB GPU☆35,077Updated this week
- Official inference framework for 1-bit LLMs☆40,347Jul 27, 2026Updated 2 months ago
- AI coworker with memory and collaboration☆17,979Updated this week
- Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.☆76,860Updated this week
- mac code — Claude Code, but it runs on your Mac for free. 35B AI agent at 30 tok/s via Apple Silicon flash-paging. $0/month.☆1,034Apr 9, 2026Updated 5 months ago
- Autonomous experiment loop extension for pi☆8,128Sep 10, 2026Updated 2 weeks ago
- ⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache…☆774Updated this week
- Run frontier AI locally.☆47,658Aug 25, 2026Updated last month
- LLM speculative inference server for heterogeneous hardware & consumer GPUs☆2,883Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Adaptive Test-time Learning and Autonomous Specialization☆2,096Updated this week
- Run frontier MoE models on hardware you already own — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦☆37,896Updated this week
- Open-source Agent Operating System☆18,209Jul 2, 2026Updated 2 months ago
- Fine-tune LLMs on your Mac with Apple Silicon. SFT, DPO, GRPO, Vision, TTS, STT, Embedding, and OCR fine-tuning — natively on MLX. Unslot…☆1,413Jun 23, 2026Updated 3 months ago
- Fully automatic censorship removal for language models☆32,429Updated this week
- The best-benchmarked open-source AI memory system. And it's free.☆59,308Updated this week
- The open-source app everyone uses to manage agents at work☆89,852Updated this week
- Scale computer-use 2.0 with open-source drivers, cross-OS fleets, and benchmarks for training, evaluation, and data generation.☆26,631Updated this week
- GLM-OCR: Accurate × Fast × Comprehensive☆7,473Apr 21, 2026Updated 5 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- An open-source long-horizon SuperAgent harness that researches, codes, and creates. With the help of sandboxes, memories, tools, skill, s…☆83,046Updated this week
- A lightweight alternative to OpenClaw that runs in containers for security. Connects to WhatsApp, Telegram, Slack, Discord, Gmail and oth…☆30,851Updated this week
- Open-Source Frontier Voice AI☆54,512Sep 3, 2026Updated 3 weeks ago
- Automation foundation model for tiny devices: 2-bit, 8-29 MB, tool calls, structured extraction and embeddings on phones, wearables, smar…☆12,743Updated this week
- Run LLMs with MLX☆7,157Updated this week
- A vector index built on TurboQuant, written in Rust with Python bindings☆17,250Sep 13, 2026Updated 2 weeks ago
- TimesFM (Time Series Foundation Model) is a pretrained time-series foundation model developed by Google Research for time-series forecast…☆33,859Sep 15, 2026Updated last week