The definitive vLLM runtime for dual RTX 2080 Ti 22GB + NVLink, delivering Qwen 27B local inference with maximum 200+ tok/s single-request decode with support of FP8 weight ( Join Discord //discord.gg/VFqVVySdMS )
☆1,003Sep 27, 2026Updated this week
Alternatives and similar repositories for vLLM-2080Ti-Definitive
Users that are interested in vLLM-2080Ti-Definitive are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Local LLM Inference Speed Test Tool☆230Sep 2, 2026Updated 3 weeks ago
- LvLLM is a special NUMA extension of vllm that makes full use of CPU and memory resources, reduces GPU memory requirements, and features …☆461Updated this week
- Implementation of FlashAttention-2 for Nvidia Tesla V100 / Titan V☆209Updated this week
- A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations☆19,539Updated this week
- 本地运行的设计稿转网页工具。在画布上绘制或导入设计，然后使用语音高效修改, 调用视觉大模型生成 HTML，并实时预览与编辑。☆41May 25, 2026Updated 4 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- vLLM for AMD gfx906 GPUs, e.g. Radeon VII / MI50 / MI60☆434Feb 20, 2026Updated 7 months ago
- forked from vllm-project/flash-attention☆66May 9, 2026Updated 4 months ago
- Build NCCL-Tests and configure SSHD in PyTorch container to help you test NCCL faster!☆13Aug 30, 2026Updated 3 weeks ago
- One-KVM，结合廉价硬件和PiKVM，实现低成本远控方案。☆10Sep 6, 2024Updated 2 years ago
- vllm混合推理扩展插件，支持多NUMA混合推理，单卡推理Qwen3-Next模型可达1000+ prefill☆34Nov 7, 2025Updated 10 months ago
- 生成中文文字识别（OCR）的训练数据☆12Mar 2, 2020Updated 6 years ago
- MT5 factor mining, backtest, and web training UI☆606Sep 3, 2026Updated 3 weeks ago
- Fork of turbo quant tom-tom and TurboQuant KV cache from domwox☆31Jul 7, 2026Updated 2 months ago
- llama 2 Inference☆42Nov 4, 2023Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 零依赖体感：用户安装一个桌面包即可，不需要先手动装一堆 CLI 和环境。 离线友好：安装包内置 OpenClaw 离线载荷，弱网/无外网场景也能完成初始化。 跨平台交付：统一产出 macOS / Windows / Linux 安装包。☆86May 6, 2026Updated 4 months ago
- yolov7-pose end2end TRT实现☆27Sep 8, 2022Updated 4 years ago
- llm deploy project based onnx.☆49Oct 9, 2024Updated last year
- MLCD 线性马达手表☆24Jul 25, 2025Updated last year
- FUSE-based file system backed by QingStor.☆21May 26, 2020Updated 6 years ago
- Proxmox Backup Server in Docker☆12Jan 17, 2026Updated 8 months ago
- Patched NVIDIA GRID Drivers☆37May 1, 2026Updated 4 months ago
- 基于 PyQt5 的网络信息抓取工具，支持 Google/Bing/Baidu 多引擎搜索，自动抓取关键词相关内容并保存至本地 | A PyQt5-based web scraping tool that fetches keyword-related content fr…☆23May 22, 2026Updated 4 months ago
- ☆13Feb 4, 2022Updated 4 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- An emerging asset class, the recent surge of popularity in crypto markets has made cryptocurrencies an essential part of investment portf…☆12Jan 22, 2023Updated 3 years ago
- LLM inference in C/C++☆2,406Updated this week
- Super fast accurate face detector ! SCRFD(CVPR 2021) with MNN/TNN/NCNN/ONNXRuntime C++.☆21Jan 12, 2022Updated 4 years ago
- 使用 Three.js 加载 GeoJSON 的智慧城市可视化效果 | A smart-city visualization that loads GeoJSON with Three.js☆11Aug 5, 2026Updated last month
- 0-MMS: Zero-Shot Multi-Motion Segmentation With A Monocular Event Camera☆13Apr 28, 2022Updated 4 years ago
- A tool for remote computer manager, support windows remote desktop and ssh.☆16Aug 12, 2026Updated last month
- Pytorch implementation of an Hourglass network for corner detection of a wrinkled towel.☆15Nov 30, 2020Updated 5 years ago
- DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm☆22,736Sep 20, 2026Updated last week
- Library to provide NV3030B display driver support in Adafruit_GFX☆12May 17, 2024Updated 2 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Remote Shadow Using Windows built in software☆13Dec 10, 2025Updated 9 months ago
- 一个轻量级的 MCP节点聚合管理工具。它允许你管理多个 MCP 服务节点（支持 SSE 在线服务和本地 stdio 命令），并将它们聚合为一个统一的接入到小智AI。☆17Feb 8, 2026Updated 7 months ago
- LLM API 管理 & 分发系统，支持 OpenAI、Azure、Anthropic Claude、Google Gemini、DeepSeek、字节豆包、ChatGLM、文心一言、讯飞星火、通义千问、360 智脑、腾讯混元等主流模型，统一 API 适配，可用于 key …☆37,026Jan 9, 2026Updated 8 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆92,771Updated this week
- Simple Encrypt For Bash Script/Shell☆14Oct 26, 2020Updated 5 years ago
- 盲盒电商是一个基于Laravel&Uniapp语言编写的项目, 功能包含盲盒开源，积分，优惠券，商品分类， 多规格等功能，整个系统架构非常简单，适合小型团队或者个人开发者二次开发，界面注重界面美感与用户体验，打造独特电商系统生态圈☆16Jul 13, 2022Updated 4 years ago
- 洋葱学院视频下载(无视VIP)☆19Feb 15, 2021Updated 5 years ago