TurboQuant for GGML: 4.57x KV Cache Compression with 72K+ Context for Llama-3.3-70B on Consumer GPUs.
☆45May 5, 2026Updated 6 months ago
Alternatives and similar repositories for llama-turboquant
Users that are interested in llama-turboquant are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- PolarEngine: vLLM plugin for PolarQuant quantized LLM inference — 75% FP16 speed at 2.3x less VRAM☆36Apr 13, 2026Updated 6 months ago
- Automated image captioning for ComfyUI using Joy Caption Alpha Two☆13Nov 6, 2025Updated last year
- ☆11May 6, 2026Updated 6 months ago
- ☆21Oct 31, 2026Updated last week
- Nim reimplementation of gron tool☆10Oct 9, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A script that can create long videos on Comfy using MiniMax H3☆17Oct 5, 2026Updated last month
- 中文汉化☆16Dec 25, 2023Updated 2 years ago
- Automatic trait implementation for nim types☆12Aug 29, 2021Updated 5 years ago
- MiniMax Music 3 的中文曲风预设与作词工具节点包 · 选曲风即出歌，无需手写英文 Caption☆18Aug 22, 2026Updated 2 months ago
- An arctic, north-bluish clean and elegant tmux color theme. + battery + pomodoro.☆12Jun 8, 2023Updated 3 years ago
- BonziBuddy Leaked Source Code by NixButterPlay☆13Nov 15, 2022Updated 3 years ago
- A powerful OCR node for ComfyUI that integrates the DeepSeek-OCR model from Hugging Face.☆17Oct 21, 2025Updated last year
- a multipurpose productivity library for nim☆10Mar 13, 2023Updated 3 years ago
- https://codex-infinity.com AI agent toolkit: coding agent CLI, unified LLM API, TUI & web UI libraries, Slack bot, vLLM pods☆26Aug 24, 2026Updated 2 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆18Sep 15, 2021Updated 5 years ago
- ☆12Apr 17, 2025Updated last year
- A High Performance DIY G-Seat for Simulators. BOM and design files required to fabricate it.☆15Jul 5, 2020Updated 6 years ago
- Flash Attention v2 for Pascal (P100, GTX 1080) and Volta (V100) GPUs — bringing O(N) memory attention to hardware the official flash-attn…☆30Updated this week
- Qwen3.8-Flash-Next (176B MoE) on a single RTX PRO 6000 Blackwell 96GB — NVMe-streamed PLE table, CUDA graphs with NEXTN speculation, meas…☆10Aug 28, 2026Updated 2 months ago
- Easy to use Nim sum type library☆16Feb 26, 2022Updated 4 years ago
- ☆13Jun 23, 2026Updated 4 months ago
- Experimental runtime reclamation of GB10 display-reserved memory into ordinary Linux RAM, with guarded driver, local signing, and reboot …☆13Oct 23, 2026Updated 2 weeks ago
- A stylized lightning strike VFX built with Three.js (Procedural bolt generation, ground cracks, sparks, and camera shake).☆15Mar 27, 2026Updated 7 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆11Nov 2, 2024Updated 2 years ago
- Lightweight async PubSub framework☆13Aug 24, 2023Updated 3 years ago
- Karras et al. (2022) diffusion models for PyTorch☆11Aug 23, 2022Updated 4 years ago
- A Pi extension command that executes raw user intent to completion with strict, verifiable termination. `/until-done` runs until a truthf…☆34Jul 22, 2026Updated 3 months ago
- Frame-budget compiler and diagnostics for three.js games: batches naive scenes, measures every frame cost, explains what to fix. CLI and …☆19Oct 23, 2026Updated 2 weeks ago
- An app that issues signed Verifiable Credentials and allows them to be revoked☆11Nov 6, 2024Updated 2 years ago
- A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative…☆11Oct 13, 2026Updated 3 weeks ago
- A common API for interfacing with secure services☆17Updated this week
- SGLang 0.5.21 for Qwen3.8-Flash-Next on one RTX PRO 6000: 264.5 tok/s decode, W4A16 routed experts (KLD 0.0111 vs BF16), 262K context, ex…☆18Oct 26, 2026Updated last week
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ☆15Sep 2, 2026Updated 2 months ago
- Reinforcement Learning Agents & Algorithms exploration☆19Dec 21, 2018Updated 7 years ago
- Adapter for Tailscale Webhooks for Microsoft Teams and Discord.☆10Jul 6, 2024Updated 2 years ago
- Agent-first knowledge base — wiki over RAG. Plain markdown with wikilinks, background quality agents, and an MCP server for agent navigat…☆27Apr 15, 2026Updated 6 months ago
- A spyware free reimagination of Bonzi Buddy using WinForms and Double Agent.☆10Feb 23, 2023Updated 3 years ago
- Claude Code skill: let your agent drive fleets of local omp (oh-my-pi) model instances toward one goal — provider config, bounded turns, …☆15Aug 28, 2026Updated 2 months ago
- Karras et al. (2022) diffusion models for PyTorch☆18Oct 5, 2023Updated 3 years ago