INT8-native vLLM fork
☆28Nov 10, 2026Updated this week
Alternatives and similar repositories for int8-vllm
Users that are interested in int8-vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Run AMD AITER's hand-written ASM kernels on CDNA2 / gfx90a (MI210, MI250). 242 of 1,422 kernels translated, with the tests and benchmarks…☆11Sep 9, 2026Updated 2 months ago
- llama.cpp with Mirai S (2.4-bit Qwen3.8-27B) support: 128K context on a 12 GB GPU☆11Oct 7, 2026Updated last month
- A (nicer) tokenizer you want to use for model inference and training: with all known peventable gotchas normalized or auto-fixed.☆12Oct 16, 2026Updated 3 weeks ago
- ☆86Sep 10, 2026Updated 2 months ago
- vllm for pascal☆12Nov 22, 2025Updated 11 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- vllm混合推理扩展插件，支持多NUMA混合推理，单卡推理Qwen3-Next模型可达1000+ prefill☆34Nov 7, 2025Updated last year
- Tuning and qualification harness for the NVIDIA CMP 170HX (GA100). Measures, gates and recovers clock/voltage settings, and treats a comp…☆97Sep 28, 2026Updated last month
- ☆41Nov 1, 2026Updated last week
- vLLM fork for pascal gpu☆18Mar 13, 2026Updated 7 months ago
- A Simple library for communicating with USB and Bluetooth HID devices on Linux, Mac, and Windows.☆13Jun 9, 2025Updated last year
- A fork of https://github.com/Niko1221/Strata optimized for my 3090+5070 Ti setup, see docs/COMPARISON.md. Renamed to Lamina.☆61Updated this week
- Proxy for OpenAI☆16Sep 2, 2025Updated last year
- Recipe for running vLLM productively on Radeon PRO V620 (Navi 21 / gfx1030) on Linux. Multiple Qwen models supported.☆22Sep 6, 2026Updated 2 months ago
- LLM inference in C/C++☆22Sep 7, 2026Updated 2 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A database of knowledge around inference & training on GFX906 GPUs https://skyne98.github.io/wiki-gfx906/☆19Feb 21, 2026Updated 8 months ago
- A persistent AI character that reads world news, builds memories with retrieval, and evolves an emotional state over time.☆13Mar 22, 2026Updated 7 months ago
- LLM inference in C/C++☆76Updated this week
- ☆10Jul 19, 2021Updated 5 years ago
- Self-hosted game stream host for Moonlight.☆18Jul 4, 2026Updated 4 months ago
- Android chroot guide + other useful scripts☆13Jul 28, 2025Updated last year
- Fully arbitrary r/w and code execution on the BC-250 SMU☆13Sep 18, 2026Updated last month
- This project is specifically developed for V100, based on lmdeploy 0.12.1, and supports mainstream open-source models from Q4 2025 to Q1 …☆22Mar 18, 2026Updated 7 months ago
- This is a repository for documenting the setup and performance of MI100s in popular inference engines.☆21Oct 8, 2026Updated last month
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- marlin_v100 是一个从 vLLM 主树中提取出来的最小 Marlin 独立开发工作区，聚焦于 Marlin dense 与 Marlin MoE 的源码开发、最小构建和轻量验证。它保留了核心 CUDA/C++ 实现、最小 Python 薄封装、生成器测试与主树回写…☆26Jul 2, 2026Updated 4 months ago
- Accelerated Predictive Coding (PC) model library in C++ and CUDA☆25Updated this week
- Guidances for Test setup of 8 AMD MI50 32GB (LLM)☆14Oct 22, 2025Updated last year
- Example finite element codes for coupled theories in solid mechanics.☆12Oct 9, 2025Updated last year
- Linear-scaling compute & memory spline manifold for regression and interpolation☆20Oct 24, 2026Updated 2 weeks ago
- Qwen3.8-Flash-Next on 2× RTX 3090: with 128 GB RAM up to 4,191 tok/s prefill · 111.5 tok/s decode (131K prompt), full 256K window at 2,86…☆141Oct 15, 2026Updated 3 weeks ago
- Rebecca base16☆10Dec 27, 2016Updated 9 years ago
- The J-Core Jx Platform board hardware.☆17Jun 21, 2020Updated 6 years ago
- A learning-focussed, simplified implementation of ContainerSSH☆11Dec 16, 2020Updated 5 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Qwen3.8-27B INT8 + DFlash2 on a rented CMP 170HX — failure analysis (private GHCR image prevented benchmark)☆17Aug 30, 2026Updated 2 months ago
- Agentic browser automation built from small, reusable pieces.☆14Oct 29, 2026Updated 2 weeks ago
- A python framework to develop games with real world object tracking (using cameras) combined with projection mapping☆13Apr 28, 2021Updated 5 years ago
- Bash script presents crontab in human readable form.☆11Apr 21, 2018Updated 8 years ago
- The real OrcaSlicer on Android: the same slicing engine and the same interface, ported to phones and tablets (unofficial)☆21Nov 5, 2026Updated last week
- A translator based on text generation webui allow you use local language model to translate epub book☆17Jun 11, 2023Updated 3 years ago
- ☆30May 12, 2026Updated 6 months ago
Are these results useful?