Run a 35B MoE model at 10+ tok/s on a $600 Mac mini. Pure C/Metal inference engine streaming experts from SSD on Apple Silicon
☆19Apr 20, 2026Updated 4 months ago
Alternatives and similar repositories for flash-moe
Users that are interested in flash-moe are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Compressed KV cache as cross-backend wire format for Metal + CUDA split inference over Thunderbolt 5☆16Apr 14, 2026Updated 4 months ago
- ☆17Mar 30, 2026Updated 5 months ago
- An infinite canvas with AI-powered code terminals☆16Feb 15, 2026Updated 6 months ago
- Rust library implementing the Toorani-Beheshti signcryption scheme☆13Aug 15, 2023Updated 3 years ago
- Fork side tangents into new windows and keep your main thread clean!☆16Mar 27, 2026Updated 5 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- https://pypi.org/project/deepagents-sandbox/☆30Apr 22, 2026Updated 4 months ago
- Instant Perfect Native MacOS Transcription☆54Jul 26, 2025Updated last year
- Inference Llama 2 in one file of pure go☆15Jul 25, 2023Updated 3 years ago
- Falcon Evaluate is an open-source Python library aims to revolutionise the LLM - RAG evaluation process by offering a low-code solution. …☆16Jan 31, 2024Updated 2 years ago
- Claude Server is an MCP implementation that enhances Claude's capabilities by providing sophisticated context management across sessions,…☆15Mar 19, 2026Updated 5 months ago
- Universal REPL Bridge for LLMs - Tab completion, interactive prompts, TUI support☆20Nov 24, 2025Updated 9 months ago
- Inspector for Blaze templates☆20Aug 7, 2017Updated 9 years ago
- Access MS SQL from Node.js using Edge.js☆27Jan 28, 2025Updated last year
- The Source code of the demos, projects demonstrated as part of the London Agentic AI Meetup https://www.meetup.com/london-agentic-ai/☆18Apr 26, 2026Updated 4 months ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- llms can learn their own context compression via RL☆50Nov 26, 2025Updated 9 months ago
- Parses and Plots Illumina SAV files☆13Jan 30, 2019Updated 7 years ago
- Your AI remembers now. Geniuz stores everything in a local database locally on Mac, Windows, Linux, Raspberry Pi. No cloud. No account. N…☆36Aug 30, 2026Updated 2 weeks ago
- Define reactive CSS rules in Javascript or (preferably) Coffeescript.☆19Feb 17, 2015Updated 11 years ago
- Security scanning for AI Agents☆33Mar 28, 2026Updated 5 months ago
- Introspection dashboard for the pi coding agent — tools, prompts, skills, and the system prompt injected on init.☆40May 20, 2026Updated 3 months ago
- node-csv npm wrapped for meteor☆17Jul 29, 2015Updated 11 years ago
- npm's top HTTP client, request, packaged for Meteor☆21Jul 30, 2016Updated 10 years ago
- backlinks graph for Craft Docs spaces☆30Aug 3, 2026Updated last month
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Goal mode extension for pi: persistent long-running objectives, /goal-set drafting, sisyphus step gating, autoContinue, and an above-edit…☆21May 13, 2026Updated 4 months ago
- A brutally honest "high‑orbit" startup advisor you can text or run from the CLI. Built with DSPy, it provides opinionated, YC-style advic…☆29Updated this week
- Enhance your Google account security with this comprehensive guide. It covers strong passwords, two-factor authentication, phishing preve…☆11Nov 21, 2024Updated last year
- Vendor-agnostic orchestration OS for autonomous AI agents. Coordinate Claude, GPT, Gemini, and Grok using Markdown files as shared memory…☆23Sep 6, 2026Updated last week
- Cucumber for Mocha -- two great tastes that taste great together!☆23Nov 17, 2014Updated 11 years ago
- ☆11Feb 4, 2021Updated 5 years ago
- Self-personalizing LM☆77Mar 6, 2026Updated 6 months ago
- FHIR data exploration with neo4j☆11Jan 15, 2022Updated 4 years ago
- Bug Bounty Monitor☆15Nov 23, 2020Updated 5 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- VT Chat - A modern, privacy-first AI chat application with security☆60Aug 18, 2026Updated 3 weeks ago
- A Claude Code Notification hook for MacOS that displays a toast message when Claude Code is waiting for the user to respond.☆18Jul 22, 2025Updated last year
- A CLI tool that measures how well AI coding agents (Claude Code, Codex, Gemini CLI, etc.) can use your SDK.☆21Jun 11, 2026Updated 3 months ago
- cli tool to create WireGuard configurations for Mullvad☆15Apr 10, 2025Updated last year
- ☆16May 23, 2026Updated 3 months ago
- A Codex-based coding-agent TUI with explicit context control, auditable Smart Prune, and local session continuity.☆42Updated this week
- MilimoChat: Privacy-first, self-hosted AI chat with customizable personas, context-aware memory, and local analytics. Built on Python/Str…☆14Mar 12, 2025Updated last year