Single-request LLM serving recipes, patches, and benchmarks for modified RTX 2080 Ti 22GB / SM75 systems
☆97Jun 10, 2026Updated 4 months ago
Alternatives and similar repositories for 2080Ti-LLM-Toolbox
Users that are interested in 2080Ti-LLM-Toolbox are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The definitive vLLM runtime for dual RTX 2080 Ti 22GB + NVLink, delivering Qwen 27B local inference with maximum 200+ tok/s single-reques…☆1,205Oct 1, 2026Updated last month
- Reproducible vLLM deployment for Qwen3.8-27B on dual RTX 2080 Ti 22GB with NVLink☆22Sep 7, 2026Updated last month
- ☆86Updated this week
- 一个Turing专用vLLM分支，通过整合FlashInfer 0.6.18（PR #3526）与SM75后端门槛补丁（PR #47949），持续同步vLLM主线最新版本☆38Oct 11, 2026Updated 3 weeks ago
- Serve EXL3 (ExLlamaV3 trellis) quantized models on vLLM fork runtimes — any architecture, mixed per-layer bitrates, composable with sourc…☆27Updated this week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- DeepSeek-V4-Flash on Ampere SM 8.6 via vLLM (pyref kernel replacements)☆35Jul 2, 2026Updated 4 months ago
- DeepSeek-V4.1-Flash EXL3 on 2x DGX Spark (GB10) with the TensorFold engine, TP=2☆13Oct 10, 2026Updated 3 weeks ago
- DeepSeek-V4-Flash W4A16-FP8 quantization on 8x H200 — patches, recipe, mission report☆14Sep 26, 2026Updated last month
- Flash Attention 2 implementation for Turing GPUs☆133Sep 14, 2026Updated last month
- Inference engine for large language models on consumer GPUs, with deep optimization for older hardware☆55Oct 20, 2026Updated 2 weeks ago
- An RGFW/miniaudio example for PureDoom.h☆11Oct 18, 2025Updated last year
- Async PLE SSD offload for Qwen3.8 Flash Next on a 64 GiB SM80 GPU: vLLM patch, setup guide, and measured PP/TG results.☆23Sep 24, 2026Updated last month
- Simultaneous Localization And Mapping using lidar and CUDA☆12May 13, 2019Updated 7 years ago
- Easy install Autodesk products on Fedora☆12Aug 18, 2020Updated 6 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- The set-and-forget LLM engine for Pascal and Volta: PXQ codec + kernels, auto-tuned per card. Ready-to-run PXQ models in MODELS.md; bench…☆114Updated this week
- Unofficial collection of profile configurations, guides, settings, FAQ´s, advices, best practices - for owners of the Flashforge Adventur…☆11Mar 3, 2022Updated 4 years ago
- 2080ti TU102 doing the unlock trick☆143Oct 22, 2026Updated 2 weeks ago
- Unlocking NVIDIA CMP 90HX (GA102): kernel 6.12☆46Aug 22, 2026Updated 2 months ago
- Super Mario Land 2: 6 Golden Coins (Game Boy) static recompilation with adaptive widescreen and DX mods☆19Oct 19, 2026Updated 2 weeks ago
- An official code repository for SEMamba++ (Interspeech 2026, Long track).☆18Oct 26, 2026Updated last week
- Извлечение закрытого ключа из контейнера КриптоПро☆13Apr 28, 2019Updated 7 years ago
- Sage attention for turning.☆84Dec 29, 2025Updated 10 months ago
- ☆14Mar 14, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 自动归档 Claude Code 官方二进制文件☆16Updated this week
- A professional role-based-authorization(also supports resource and group) service with restful and graphql api for enterprise application…☆13Feb 5, 2020Updated 6 years ago
- Patch nvngx_dlssnr.dll to enable NVIDIA DLSS Neural Rendering on GeForce RTX 20, 30, and 40 Series GPUs—Turing, Ampere, and Ada.☆15Updated this week
- GLM-5.2 on 4x DGX Spark with adaptive MTP K2/K4/K5, FULL CUDA graphs, DCP2, 520K context, and a downloadable ARM64 runtime image.☆13Aug 8, 2026Updated 2 months ago
- Enclosed chamber-type Delta 3d printer design☆11Aug 28, 2023Updated 3 years ago
- Guidances for Test setup of 8 AMD MI50 32GB (LLM)☆14Oct 22, 2025Updated last year
- Native Vulkan inference for giant MoE models on consumer AMD GPUs☆18Sep 22, 2026Updated last month
- 解锁自有 NVIDIA CMP 170HX / 90HX 的算力限制。Linux x86-64，需要 root。☆59Aug 6, 2026Updated 3 months ago
- FORK of VLLM for AMD MI25/50/60. A high-throughput and memory-efficient inference and serving engine for LLMs☆71May 4, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Generates kid-friendly weather forecasts suitable for display on a large monitor. Uses OpenWeatherMap and a local or hosted LLM.☆17Feb 28, 2026Updated 8 months ago
- AI short-video automation pipeline — from script to publish, Agent-driven with HITL checkpoints and FinOps cost optimization☆12Apr 12, 2026Updated 6 months ago
- ☆15Mar 30, 2018Updated 8 years ago
- Qwen3.8-Flash-Next on 2× RTX 3090: with 128 GB RAM up to 4,191 tok/s prefill · 111.5 tok/s decode (131K prompt), full 256K window at 2,86…☆134Oct 15, 2026Updated 3 weeks ago
- MiniMax H3 video generation on 2080Ti 22G (Turing sm_75) - field-tested handbook, workflows & FAQ☆22Oct 30, 2026Updated last week
- ☆10Jan 22, 2026Updated 9 months ago
- ☆12Jan 22, 2026Updated 9 months ago