The GPU-free LLM inference engine. Combines lazy expert loading + TurboQuant KV compression to run models that shouldn't fit on your hardware. Built from scratch, fully local, zero cloud.
☆23Apr 13, 2026Updated 3 months ago
Alternatives and similar repositories for lazy-moe
Users that are interested in lazy-moe are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Cohere Toolkit is a collection of prebuilt components enabling users to quickly build and deploy RAG applications.☆30Jan 19, 2025Updated last year
- Lightweight reverse proxy + admin UI that turns your backend endpoints into multi-tenant Model Context Protocol tools for OpenServ—or any…☆16May 28, 2025Updated last year
- ARK (Automated Resource Knowledge-base) revolutionizes personal computing by creating an open-source, decentralized assistant. Harnessing…☆17Jul 25, 2026Updated last week
- The mono repo of tools needed to convert MCP servers into Claude Code Skills☆15Nov 25, 2025Updated 8 months ago
- Backup docker container filesystem, metadata and volume data☆11Mar 28, 2018Updated 8 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A Free and Open Source version of Scale Space, a powerful, feature-rich cockpit to explore the expanse of phase space.☆20May 28, 2026Updated 2 months ago
- Production-grade API to give your AI agents long-term memory without the boilerplate.☆72Dec 17, 2025Updated 7 months ago
- Agent Orcha is a declarative framework designed to build, manage, and scale multi-agent AI systems with ease. Use YAML to orchestrate co…☆17Jul 19, 2026Updated 2 weeks ago
- Spank your MacBook twice to take a screenshot. Uses Apple Silicon accelerometer via IOKit HID. A custom fork of the original SPANK.☆15May 22, 2026Updated 2 months ago
- Stateless LLM runtime that dynamically routes, loads, executes, and unloads models per request with bounded VRAM caching and intelligent …☆41Apr 12, 2026Updated 3 months ago
- ☆10Jan 23, 2025Updated last year
- ☆14Sep 24, 2024Updated last year
- Evaluation of STT-models on medical dialogues☆48Apr 29, 2026Updated 3 months ago
- A Next.js chatbot app demonstrating seamless integration with window.ai.☆15Jun 25, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Self-hostable AI code review for your Forgejo☆48Oct 14, 2025Updated 9 months ago
- MCP server that gives Claude real-time web search using Gemini 2.5 Flash — free via Google AI Studio☆17Feb 20, 2026Updated 5 months ago
- Modular, agentic framework and MCP platform you self-host. Build and run your own AI agents, connect Claude Code, Claude Desktop, or Curs…☆20Updated this week
- some stuff about generative ai☆15Feb 20, 2025Updated last year
- finetune method to create think/model/requires tags to allow LLMs to write programs for things they can calculate instead of hallucinatin…☆15Apr 8, 2026Updated 3 months ago
- Exploring the minimal architecture required for coherent English language generation.☆20Jun 11, 2026Updated last month
- The highest-scoring AI memory system ever benchmarked that isn't reliant on LLM reranking. And it's free & burns less tokens.☆35Jun 1, 2026Updated 2 months ago
- A powerful MCP testing tool with multi-provider LLM support (Ollama, OpenAI, Claude, Gemini). Test, debug, and develop MCP servers with a…☆18Apr 28, 2026Updated 3 months ago
- Interact privately with your documents using the power of GPT, 100% privately, no data leaks☆10May 22, 2023Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Neural-enhanced conversational memory for AI agents — 10 micro-networks, tri-hybrid storage, bio-inspired retrieval☆15Mar 27, 2026Updated 4 months ago
- Control your AI agents remotely. Respond from anywhere.☆16Jun 8, 2026Updated last month
- ☆12Oct 20, 2020Updated 5 years ago
- A package to interact with poe.com☆12Mar 16, 2023Updated 3 years ago
- MichiAI: A Low Latency, Full Duplex Speech LLM with zero coherence loss☆111Apr 24, 2026Updated 3 months ago
- Simple UI cli LLaMA Model Finetuning☆10Mar 23, 2023Updated 3 years ago
- Gen AI Hardening x Attack Suite☆17Jul 9, 2025Updated last year
- A FastAPI application that integrates with Telegram using webhooks and OpenAI Agents SDK for AI-powered stock trading assistance, utilizi…☆17May 11, 2025Updated last year
- Hill Space is All You Need☆17Jul 11, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Rank any list by any criteria at any scale using LLMs as judges.☆28Jul 28, 2026Updated last week
- This is a PCL library that let you connect JavaScript on the browser side to the C# side by proxying C# code.☆15Jun 22, 2022Updated 4 years ago
- C# localizable zero-allocation format string generator☆16Oct 27, 2025Updated 9 months ago
- Governed memory runtime for AI assistants: policy-before-storage, context admission, memory usage trace, deletion proof, leakage evals, a…☆17Updated this week
- ☆16Feb 21, 2026Updated 5 months ago
- AI Context Takt: A pipeline tool for structural control over LLM context. Escape the black box of chat history, maximize token efficiency…☆21Jan 12, 2026Updated 6 months ago
- Drone-first photorealistic simulation and cross-benchmark trajectory tooling for VLA research☆17Apr 15, 2026Updated 3 months ago