The GPU-free LLM inference engine. Combines lazy expert loading + TurboQuant KV compression to run models that shouldn't fit on your hardware. Built from scratch, fully local, zero cloud.
☆23Apr 13, 2026Updated 4 months ago
Alternatives and similar repositories for lazy-moe
Users that are interested in lazy-moe are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Lightweight reverse proxy + admin UI that turns your backend endpoints into multi-tenant Model Context Protocol tools for OpenServ—or any…☆16May 28, 2025Updated last year
- The mono repo of tools needed to convert MCP servers into Claude Code Skills☆15Nov 25, 2025Updated 9 months ago
- Exception Details - Capture, and Inspect and all variables from Exception-time.☆22Aug 11, 2013Updated 13 years ago
- Physics simulation of a self-gravitating discrete medium with an elastic lattice core.☆16May 3, 2026Updated 3 months ago
- Production-grade API to give your AI agents long-term memory without the boilerplate.☆73Dec 17, 2025Updated 8 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆27Jun 11, 2025Updated last year
- Training-free KV cache compression via E8 lattice VQ. 2-bit KV that preserves retrieval (30/30 NIAH vs TurboQuant 0/30). Calibration-free…☆25Aug 4, 2026Updated 3 weeks ago
- A flexible, easy to use document merge tool that enables conditional creation of PDF, Shared Doc and email file attachment from spreadshe…☆15Nov 15, 2013Updated 12 years ago
- Stateless LLM runtime that dynamically routes, loads, executes, and unloads models per request with bounded VRAM caching and intelligent …☆42Apr 12, 2026Updated 4 months ago
- ☆10Jan 23, 2025Updated last year
- ☆14Sep 24, 2024Updated last year
- A generalist AI agent☆26Aug 18, 2026Updated last week
- A simple script that parses Path of Exile's official Trade website☆10Apr 19, 2019Updated 7 years ago
- AI Reddit Profiler is a Python tool that uses AI to analyze Reddit user profiles. It extracts information like karma, subreddit activity,…☆13Oct 23, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Modular, agentic framework and MCP platform you self-host. Build and run your own AI agents, connect Claude Code, Claude Desktop, or Curs…☆22Updated this week
- Theme Switcher for Alacritty☆18May 24, 2026Updated 3 months ago
- some stuff about generative ai☆15Feb 20, 2025Updated last year
- win32 native frontend for llama-cli☆14Nov 2, 2024Updated last year
- finetune method to create think/model/requires tags to allow LLMs to write programs for things they can calculate instead of hallucinatin…☆15Apr 8, 2026Updated 4 months ago
- WebLLM Chrome Extension Starter Pack.☆12Aug 10, 2023Updated 3 years ago
- Exploring the minimal architecture required for coherent English language generation.☆22Jun 11, 2026Updated 2 months ago
- The highest-scoring AI memory system ever benchmarked that isn't reliant on LLM reranking. And it's free & burns less tokens.☆36Jun 1, 2026Updated 2 months ago
- A powerful MCP testing tool with multi-provider LLM support (Ollama, OpenAI, Claude, Gemini). Test, debug, and develop MCP servers with a…☆18Apr 28, 2026Updated 3 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Interact privately with your documents using the power of GPT, 100% privately, no data leaks☆10May 22, 2023Updated 3 years ago
- Tiny evaluation of leading LLMs on competitive programming problems☆14Apr 10, 2026Updated 4 months ago
- Contains examples for the Spectre.Console library.☆91Jun 11, 2026Updated 2 months ago
- Control your AI agents remotely. Respond from anywhere.☆16Updated this week
- ☆12Oct 20, 2020Updated 5 years ago
- Fetch only relevant tools for the current conversation and save cost while increasing the precision of your LLM Response☆17Sep 9, 2025Updated 11 months ago
- A package to interact with poe.com☆12Mar 16, 2023Updated 3 years ago
- Simple UI cli LLaMA Model Finetuning☆10Mar 23, 2023Updated 3 years ago
- Compaas is a Company-as-a-Service platform that assembles AI agents into a fully functional virtual organization. It can ideate, build, m…☆15Apr 23, 2026Updated 4 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Gen AI Hardening x Attack Suite☆17Jul 9, 2025Updated last year
- ☆16Dec 4, 2025Updated 8 months ago
- A FastAPI application that integrates with Telegram using webhooks and OpenAI Agents SDK for AI-powered stock trading assistance, utilizi…☆17May 11, 2025Updated last year
- Hill Space is All You Need☆17Jul 11, 2025Updated last year
- Geohunt -:)☆15Feb 18, 2026Updated 6 months ago
- Rank any list by any criteria at any scale using LLMs as judges.☆28Updated this week
- This is a PCL library that let you connect JavaScript on the browser side to the C# side by proxying C# code.☆15Jun 22, 2022Updated 4 years ago