PolarEngine: vLLM plugin for PolarQuant quantized LLM inference — 75% FP16 speed at 2.3x less VRAM
☆36Apr 13, 2026Updated 6 months ago
Alternatives and similar repositories for polarengine-vllm
Users that are interested in polarengine-vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆15Oct 16, 2026Updated last week
- ☆16Jul 21, 2026Updated 3 months ago
- High-Quality Voice Cloning TTS for 600+ Languages☆19May 20, 2026Updated 5 months ago
- ☆15Apr 26, 2025Updated last year
- Structured Chain-of-Thought☆221May 16, 2026Updated 5 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆25Updated this week
- Abliterator (llm behavior/concept removal) with baukit, not transformerlens☆11Feb 21, 2026Updated 8 months ago
- Project code for training LLMs to write better unit tests + code☆22May 19, 2025Updated last year
- 30 tok/s for 20B MoE on 8 GB VRAM. Flat throughput to 32K context. Native MXFP4 + GGUF Q4_K/Q5_K/Q6_K via ggml CUDA kernels — zero dequan…☆23Apr 7, 2026Updated 6 months ago
- pr triage ui☆15Oct 3, 2026Updated 2 weeks ago
- ☆21Apr 27, 2025Updated last year
- A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative…☆12Oct 13, 2026Updated last week
- ☆11Oct 13, 2026Updated last week
- Video2Video Framework for ComfyUI☆63Aug 12, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆19Sep 4, 2024Updated 2 years ago
- ComfyUI nodes for editing background of images/videos with CUDA acceleration support.☆22Dec 31, 2024Updated last year
- A small Node.js script that polls a website and sends a notification when there's a change. Inspired by my attempts to get a close hotel …☆13Nov 10, 2022Updated 3 years ago
- Your git repos as books on a 3D bookshelf. Browse, search, move, rename, open.☆18Sep 9, 2026Updated last month
- Run your Claude Code and Codex agents from one Telegram chat.☆14Oct 14, 2026Updated last week
- llama.cpp fork with TQ3_1S/4S CUDA kernels — 3.5-bit WHT quantization achieving Q4s quality at 10% smaller size. Based on RaBitQ-inspired…☆233Oct 13, 2026Updated last week
- ☆13Aug 5, 2026Updated 2 months ago
- An experimental and feature-rich inference engine built on top of llama.cpp☆81Updated this week
- Raw speed benchmark traces: Qwen3.8-27B on 4x RTX 3090. llama.cpp GGUF sweeps + 288-point vLLM vs SGLang, NVFP4 vs FP8 matrix.☆13Sep 28, 2026Updated 3 weeks ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Nodes to level up your workflows performance and streamline specific functions.☆11Aug 19, 2025Updated last year
- Local Codex log swear/frustration timeline audit☆34May 5, 2026Updated 5 months ago
- Get file information based on file signature☆16Sep 11, 2015Updated 11 years ago
- ☆12Nov 26, 2024Updated last year
- Run oversized sparse MoE GGUF models with bounded NVMe-to-RAM-to-VRAM caching, native multi-GPU planning, and a Linux desktop Studio.☆20Oct 12, 2026Updated last week
- React AWS S3 upload using Amplify and Material UI☆10Jan 5, 2023Updated 3 years ago
- ☆21Aug 11, 2026Updated 2 months ago
- 🎙️ AI Dubbing Tool - Professional Voice Cloning & Synchronization: Transform your subtitles into high-quality dubbed audio using cutti…☆20Oct 7, 2026Updated 2 weeks ago
- ☆41Aug 16, 2026Updated 2 months ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Timeline-based video editor for ComfyUI with scenes, project assets, gallery, images as keyframes, render staging, and takes for iterativ…☆24Oct 14, 2026Updated last week
- ☆397Apr 16, 2026Updated 6 months ago
- Receive webhook from Stripe using a lambda setting up with Amplify☆10Nov 7, 2019Updated 6 years ago
- Ibis is a Hands-Free Interactive Web Page. Using the latest generative AI, it can be Any Page.☆21Oct 30, 2024Updated last year
- ☆10Oct 24, 2024Updated last year
- ☆82Aug 26, 2026Updated last month
- ☆13Jun 29, 2024Updated 2 years ago