Krasis is a Hybrid LLM runtime which focuses on efficient running of larger models on consumer grade VRAM limited hardware
☆525Oct 25, 2026Updated last week
Alternatives and similar repositories for krasis
Users that are interested in krasis are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Specialized fork for (relatively) fast single-GPU inference (in CUDA) using large MoE models that don't fit fully into VRAM☆17May 6, 2026Updated 5 months ago
- Terminal system resource monitor for hybrid LLM workloads☆93May 6, 2026Updated 5 months ago
- ROCm/AMD GPU benchmark suite for llama.cpp, whisper.cpp, PyTorch☆21Feb 4, 2026Updated 8 months ago
- llama.cpp/ik_llama.cpp launcher: loads big MoE models across mismatched multi-GPU rigs by exact VRAM math.☆283Updated this week
- A workbench for language model research☆105Aug 9, 2026Updated 2 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Autonomous multi-agent coding system on local LLMs. No frameworks, no API costs. Plan → Build → Test → Fix with Qwen 80B + 7B on your own…☆22Sep 23, 2026Updated last month
- ☆74Jul 26, 2026Updated 3 months ago
- llama.cpp fork with additional SOTA quants and improved performance☆3,364Updated this week
- Reliable model swapping for any local AI server. Chosen by thousands of users. Batteries included. If we don't have it, you probably don…☆6,162Updated this week
- Multi-dataset evaluation of Anthropic's J-Space on Qwen3-4B. Demonstrates that internal 'workspace noise' can reliably route high-confide…☆12Jul 13, 2026Updated 3 months ago
- CPU-optimized LLM inference engine (C)☆54Updated this week
- [H] HyperspaceDB is a high-performance, vector database. It features 1-bit quantization, async replication, and native support for hierar…☆163Oct 16, 2026Updated 2 weeks ago
- Coding agent with cool features.☆19Aug 23, 2026Updated 2 months ago
- Run any large transformer model on consumer GPUs. No quantization. No compromise.☆10Sep 23, 2026Updated last month
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- LLM speculative inference server for heterogeneous hardware & consumer GPUs☆2,970Updated this week
- FusionQuant Model Merge & GGUF Conversion Pipeline - Your Free Toolkit for Custom LLMs!☆14Jun 24, 2025Updated last year
- Community recipes for serving LLMs on RTX 3090/4090/5090 CUDA gpus. Multi-engine (vLLM, sglang, llama.cpp and other custom engines) and m…☆2,468Updated this week
- KVarN, KV cache precision tail, low-bit quants in llama.cpp for longer context of better precision in the same VRAM☆1,179Updated this week
- High-performance single-GPU inference for selected model checkpoints and GPUs.☆3,228Updated this week
- Using LLMs for iteratively exploring the solution search space at scale.☆805Oct 25, 2026Updated last week
- ☆29Oct 11, 2026Updated 3 weeks ago
- hummingbird is a lightweight, zero dependency runtime for massive open source Mixture of Experts (MoE) language models. It unifies SSD, R…☆61Jul 31, 2026Updated 3 months ago
- Live structural code graph for AI agents — one-curl install wires MCP + an agent skill into Claude Code, OpenCode, Codex and Cursor. Inde…☆13Oct 24, 2026Updated last week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Human-AI Document Standard — lightweight convention for AI-optimized technical documentation☆28Jul 9, 2026Updated 3 months ago
- Local LLM Server Manager + LlaMA.cpp + Chat☆140Updated this week
- ☆27Jun 11, 2025Updated last year
- A harness optimized to smaller LLMs☆2,710Sep 18, 2026Updated last month
- RDNA-native LLM inference engine in Rust.☆786Updated this week
- A tiny model that teaches itself to code better. On your laptop. No cloud. No teacher model. No human feedback.☆71Mar 10, 2026Updated 7 months ago
- Semantic Skill Space (SSS): Injecting skill embeddings into KV cache for small-model agents to recover skill behavior with lower prompt-c…☆15Mar 2, 2026Updated 8 months ago
- Zero-shot forecasting, tabular classification, and regression via MCP — exposes Google TimesFM 2.5 and TabFM v1.0.0 to AI assistants. Jus…☆32Sep 4, 2026Updated last month
- [NeurIPS 2026 Spotlight] Fast, lossless LLM inference via dual-view diffusion decoding.☆483Aug 12, 2026Updated 2 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Profile-guided GPU kernel optimizer for AMD/RDNA3. Auto-tunes llama.cpp MMVQ kernels per model shape. 2x decode speedup on 7900 XTX.☆70Sep 5, 2026Updated last month
- Local Micro-Agents that monitor your screen, so you don't have to.☆1,665Updated this week
- ☆19Jul 4, 2025Updated last year
- Me☆30Feb 11, 2023Updated 3 years ago
- Gives agents a real browser. URL in, pruned snapshot out. Replaces Playwright, Selenium, Puppeteer. Zero deps, zero wasted tokens.☆46Updated this week
- Fully local: chat, a coding agent, and a design studio in one private desktop app.☆31Updated this week
- Verified multi-source distribution for local LLM weights☆16Oct 20, 2026Updated 2 weeks ago