The definitive vLLM runtime for dual RTX 2080 Ti 22GB + NVLink, delivering Qwen 27B local inference with maximum 100+ tok/s single-request decode with support of FP8 weight
☆545Aug 17, 2026Updated this week
Alternatives and similar repositories for vLLM-2080Ti-Definitive
Users that are interested in vLLM-2080Ti-Definitive are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆154Jun 13, 2026Updated 2 months ago
- Lightweight multi-agent orchestration engine☆15Jul 1, 2026Updated last month
- ☆16Apr 6, 2023Updated 3 years ago
- ☆23Oct 12, 2022Updated 3 years ago
- An extension utility for llama.cpp, used with 3090*2 + Strix Halo. llama.cpp的拓展小工具，自用于3090*2 + Strix Halo。☆321Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- NVIDIA Linux open GPU with P2P support☆418Updated this week
- fastllm是后端无依赖的高性能大模型推理库。同时支持张量并行推理稠密模型和混合模式推理MOE模型，任意10G以上显卡即可推理满血DeepSeek。双路9004/9005服务器+单显卡部署DeepSeek满血满精度原版模型，单并发20tps；INT4量化模型单并发30tp…☆4,926Updated this week
- 加载使用TileStache（谷歌瓦片规则）切割出的矢量瓦片实例☆12Sep 18, 2019Updated 6 years ago
- forked from vllm-project/flash-attention☆61May 9, 2026Updated 3 months ago
- One-KVM，结合廉价硬件和PiKVM，实现低成本远控方案。☆10Sep 6, 2024Updated last year
- onecloud's u-boot, build by yourself.☆19Jan 8, 2025Updated last year
- GraphRAG4OpenWebUI integrates Microsoft's GraphRAG technology into Open WebUI, providing a versatile information retrieval API. It combin…☆604Jan 10, 2025Updated last year
- one OpenSourceWeatherStation Base Arduino,Code,schematic☆23Jun 8, 2018Updated 8 years ago
- 生成中文文字识别（OCR）的训练数据☆12Mar 2, 2020Updated 6 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Fork of turbo quant tom-tom and TurboQuant KV cache from domwox☆30Jul 7, 2026Updated last month
- llama 2 Inference☆42Nov 4, 2023Updated 2 years ago
- 钉钉通知机器人与SpringBoot的集成。☆18Jun 14, 2018Updated 8 years ago
- Outdoor_navigation based on RTK-LIDAR-IMU-Wheel_odom.lidar used velodyne,imu don't have mag.☆11Apr 22, 2022Updated 4 years ago
- M5Stack Cardputer（自带屏幕、键盘、麦克风、扬声器）上实现 MimiClaw☆50Mar 28, 2026Updated 4 months ago
- 自动化控制、可视化操作、自动连点器、流程自动化、RPA☆70Aug 10, 2026Updated last week
- Android Java and native hook Demo☆13Jun 20, 2017Updated 9 years ago
- 基于 PyQt5 的网络信息抓取工具，支持 Google/Bing/Baidu 多引擎搜索，自动抓取关键词相关内容并保存至本地 | A PyQt5-based web scraping tool that fetches keyword-related content fr…☆23May 22, 2026Updated 2 months ago
- 将 Cursor API 转换为 OpenAI/Anthropic 兼容格式的代理服务。提供 Claude Code工具及图片支持。☆54Mar 17, 2026Updated 5 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- An emerging asset class, the recent surge of popularity in crypto markets has made cryptocurrencies an essential part of investment portf…☆12Jan 22, 2023Updated 3 years ago
- A lightweight llama.cpp launcher with GUI☆23Updated this week
- rtmp/rtsp Qt Media☆21Jul 14, 2026Updated last month
- LLM inference in C/C++☆2,291Updated this week
- On cloud or premise, the AutoML controller for DeepCamera☆13Sep 1, 2022Updated 3 years ago
- One-click Qwen3.6-27B inference on Windows. 158 tok/s on RTX 5090, 72 tok/s on RTX 3090. Native, no WSL, no Docker, no telemetry.☆227May 14, 2026Updated 3 months ago
- People and asset tracking system. Hardware support : 1. Happy Bubble Presence Detectors 2.Raspberryp Pi 3. ESP32 kit with Wifi and Blueto…☆10Jun 6, 2018Updated 8 years ago
- Privacy-first voice dictation for Mac. Tap or hold a key, speak naturally, and your words appear. Apple Speech, Sherpa-ONNX, or clou…☆16Updated this week
- 基于janus-gateway实现的流媒体服务器。☆11May 15, 2024Updated 2 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ☆14Mar 7, 2023Updated 3 years ago
- 使用小爱音箱播放音乐，音乐使用MusicFree插件在线搜索☆35May 31, 2026Updated 2 months ago
- Books management system based on python flask library.基于flask的图书管理系统支持电子书下载及纸质书的管理（借阅流转）☆12May 31, 2017Updated 9 years ago
- web在线答题☆11Aug 14, 2018Updated 8 years ago
- Library to provide NV3030B display driver support in Adafruit_GFX☆12May 17, 2024Updated 2 years ago
- Velocity-Obstacle using Sampling☆13May 30, 2021Updated 5 years ago
- 谷歌浏览器插件，使用大语言模型实时同声传译，完全免费☆11Jan 5, 2025Updated last year