Single-request LLM serving recipes, patches, and benchmarks for modified RTX 2080 Ti 22GB / SM75 systems
☆92Jun 10, 2026Updated 4 months ago
Alternatives and similar repositories for 2080Ti-LLM-Toolbox
Users that are interested in 2080Ti-LLM-Toolbox are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆80Updated this week
- LLM inference in C/C++☆56Aug 8, 2026Updated 2 months ago
- Sega Genesis / Mega Drive game static recompiler ecosystem · Part of the R.A.I.D. community☆44Oct 8, 2026Updated last week
- Run MoE models beyond VRAM on AMD, NVIDIA & Intel GPUs. Vulkan-powered, portable Windows app with automatic setup. | 让游戏显卡跑起超显存大模型，支持 AMD…☆302Updated this week
- Hand-written NVFP4 W4A16 CUDA kernels for Volta☆174Aug 19, 2026Updated last month
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Custom inference recipes for NVIDIA DGX Spark — Qwen 122B DFlash hybrid☆81Updated this week
- Run Qwen3.8-Flash-Next (180B) on a single DGX Spark by keeping its 51B n-gram embedding table on NVMe☆125Aug 30, 2026Updated last month
- 这是一个插件用来调用即梦生图API的插件，顺便能够通过OSC协议沟通等TouchDesigner可视化程序☆13Dec 8, 2025Updated 10 months ago
- Heterogeneous prefill/decode for DeepSeek-V4-Flash: CUDA prefill (DGX Spark, vLLM) -> Metal decode (Mac Studio, oMLX) over plain 10GbE☆151Updated this week
- Project Maya - run GLM-5.3-Flash (321B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or Windows. Engine, s…☆999Updated this week
- Add a type for paths in Go.☆14Aug 12, 2021Updated 5 years ago
- A Sketch-like text editor.☆14Aug 11, 2021Updated 5 years ago
- Official repo for MAI-Code models, where we publish MAI-Code model releases and updates and engage with developer community on issues and…☆74Aug 11, 2026Updated 2 months ago
- Write and run custom C kernels for Intel Core Ultra NPUs☆69Updated this week
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Mermade Swagger 2.0 to OpenAPI 3.0.0 converter front-end☆15Apr 4, 2023Updated 3 years ago
- Strata fork: Qwen3.8-Flash-Next 125B MoE in NVFP4 on one RTX 20-50 card (12 GB+) and 64 GB of RAM or more. Setup installs our GPTQ quants…☆160Updated this week
- Lossless storage and search for AI agent sessions, across every agentic client.☆82Updated this week
- The definitive vLLM runtime for dual RTX 2080 Ti 22GB + NVLink, delivering Qwen 27B local inference with maximum 200+ tok/s single-reques…☆1,155Oct 1, 2026Updated 2 weeks ago
- A plugin for AI agent evaluation. Plan evals, generate test cases, interpret results for Copilot Studio agents. Grounded in Microsoft's E…☆138Jun 24, 2026Updated 3 months ago
- 孙宇晨 × 邵艾伦 4 小时对谈：全文 + 精华 + 一键丢给 AI 的规划 prompt☆152Oct 9, 2026Updated last week
- Autonomous Agents Orchestrator Experiment☆18Updated this week
- ☆64Jul 8, 2026Updated 3 months ago
- Noncommercial Agent Skills for SillyTavern rolecard engineering.☆167Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Dogfooding vLLM backport for older GPUs.☆315Updated this week
- deepseek harness中文详细学习教程☆267Aug 13, 2026Updated 2 months ago
- Pyfilesystem2 for various archive filesystems☆18Oct 25, 2022Updated 3 years ago
- Vue 生成证书海报组件☆18Mar 4, 2023Updated 3 years ago
- C++/CUDA single-GPU inference engine for Qwen3.8 (incl. Qwen3.8-Flash-Next with offloaded experts) on the RTX 5090; grew from NInfer☆121Updated this week
- Use your ChatGPT Plus / Pro (Codex) subscription in DeepSeek Harness (DSH): GPT-6 & Codex models, images, web search and quota via ChatGP…☆191Updated this week
- ECMAScript AST query library.☆12Jul 7, 2020Updated 6 years ago
- 解锁自有 NVIDIA CMP 170HX / 90HX 的算力限制。Linux x86-64，需要 root。☆57Aug 6, 2026Updated 2 months ago
- ☆12May 6, 2022Updated 4 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Fully deterministic cross-device LLMs inference☆52Oct 2, 2026Updated 2 weeks ago
- qwen38-flash-next recipe for tp=2 GB10☆127Oct 6, 2026Updated last week
- AlphaQuant: 股票实盘交易SDK，支持华泰，广发等70多个券商☆20Sep 22, 2019Updated 7 years ago
- Autonomous code optimization that works while you sleep (Autoresearch with Claude Code). Define a metric, point it at your code, go to be…☆28Aug 2, 2026Updated 2 months ago
- Bring MIDI capabilities to AutoHotKey v2☆15Sep 6, 2026Updated last month
- Codes for the ICLR 2022 paper: Trigger Hunting with a Topological Prior for Trojan Detection☆11Sep 19, 2023Updated 3 years ago
- Reusable skills for ChatGPT work and Codex.☆274Jul 26, 2026Updated 2 months ago