llama.cpp optimized for NVIDIA Tesla V100 (SM70): large MoE Qwen3.8-Flash-Next with MTP (prefill 3464 tok/s at 200K context, 6x V100-16GB) and Qwen3.8-27B with DFlash2 (decode up to 225 tok/s); 2-6 GPUs, 262K-512K context, multimodal, concurrent serving.
☆44Oct 17, 2026Updated this week
Alternatives and similar repositories for llama.cpp-v100
Users that are interested in llama.cpp-v100 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Benchmarks and notes for running modern LLMs with vLLM on 8x Tesla V100-32GB in 2026.☆23Jul 10, 2026Updated 3 months ago
- Agentic-coding oriented inference engine for N x V100-SXM2, based on SGLang: GLM-5.3-Flash, Qwen3.8-Flash-Next, DeepSeek-V4.1-Flash, Mini…☆31Oct 7, 2026Updated last week
- Hand-written NVFP4 W4A16 CUDA kernels for Volta☆175Aug 19, 2026Updated 2 months ago
- Mixture of Lora Experts☆11Apr 7, 2024Updated 2 years ago
- Fast & lightweight interface for running Nano Banana LLM and compact local models on your PC. Optimized for high-speed AI interactions.☆43Mar 17, 2026Updated 7 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Reproducible Qwen3.8-27B GPTQ INT4 + MTP4 inference on Intel Arc Pro B70 using vLLM XPU — 84.65 tok/s median.☆45Sep 9, 2026Updated last month
- ☆20Nov 5, 2024Updated last year
- Implementation of FlashAttention-2 for Nvidia Tesla V100 / Titan V☆212Sep 22, 2026Updated 3 weeks ago
- xllama.cpp — Optimized LLM Inference for NVidia Tesla V100-SXM2-32GB☆17Apr 29, 2026Updated 5 months ago
- ControlLM is a method to control the personality traits and behaviors of language models in real-time at inference without costly trainin…☆21Nov 6, 2024Updated last year
- Run MiniMax H3 at native fp16 on pre-bf16 GPUs (V100/Volta) — exact-math fix for the black-frame overflows, ~11× faster than the fp32 fal…☆55Aug 8, 2026Updated 2 months ago
- AMD Generic Encapsulated Software Architecture Platform Security Processor Configuration Block manipulation library☆20Dec 18, 2025Updated 10 months ago
- ☆10Nov 6, 2019Updated 6 years ago
- Rust library for parsing a number of firmware images☆16Feb 22, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Lightweight menu-bar & tray monitor for your 3D-printer fleet — Bambu Lab, Klipper/Creality, Prusa, Snapmaker. Live status, AMS, camera, …☆61Updated this week
- correlate an SPI capture of an AMD boot procedure to the PSP firmware components☆17Jan 13, 2026Updated 9 months ago
- 通过交互式澄清问卷，将需求材料整理为可实现、可验收的 PRD。☆32Sep 4, 2026Updated last month
- 1CatV2 with TileLANG written FA-v100 and many goodies☆20Jul 15, 2026Updated 3 months ago
- Full-fabric VHDL Qwen3.5 9B/ Qwen3.8 27B LLM inference engine on XCVU33P/XCVU35P☆42Oct 7, 2026Updated last week
- Code and data for the paper: On the Reliability of Psychological Scales on Large Language Models☆31Dec 15, 2025Updated 10 months ago
- Wrapper module for Dell Command Update.☆11Jul 1, 2025Updated last year
- ☆18Nov 25, 2024Updated last year
- marlin_v100 是一个从 vLLM 主树中提取出来的最小 Marlin 独立开发工作区，聚焦于 Marlin dense 与 Marlin MoE 的源码开发、最小构建和轻量验证。它保留了核心 CUDA/C++ 实现、最小 Python 薄封装、生成器测试与主树回写…☆26Jul 2, 2026Updated 3 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Open-source Android client with direct door access and responsive home-screen widgets☆68Aug 8, 2026Updated 2 months ago
- ☆14Oct 7, 2026Updated last week
- ☆14Mar 11, 2014Updated 12 years ago
- ☆15Aug 25, 2026Updated last month
- Qwen3.8-Flash-Next (125B MoE) on a 8GB+ Multi Vendor GPU 🥳No CUDA！☆220Updated this week
- V100 / SM70-focused vLLM engineering fork for modern LLM inference.☆1,350Updated this week
- Use your Claude Code, Codex, Cursor and Copilot subscriptions in one conversation: switch agents mid-chat and the context comes along. Na…☆22Updated this week
- Fast large-file log & JSONL viewer for Windows — 1 GiB indexed in 92 ms, regex search in 115 ms. 丹青日志 · Windows 大文件日志/JSONL 查看分析器 (Rust)☆19Oct 8, 2026Updated last week
- Evidence-backed index of real-world Jev (TypeSafe AI System One) use cases: repos, patterns, benchmarks, and measured results☆19Oct 3, 2026Updated 2 weeks ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Ethiopian Literature edited in TEI☆10Updated this week
- Library that helps you to decode sms packet when using osomcom☆10Aug 22, 2015Updated 11 years ago
- This repo is for the paper: On the Safety of Conversational Models: Taxonomy, Dataset, and Benchmark☆25Aug 13, 2022Updated 4 years ago
- Simple loader plugin for IDA to load AMD-SP or PSP firmware binaries.☆23Mar 6, 2024Updated 2 years ago
- Shows variations of the Beamer LaTeX package's themes and color themes☆32May 13, 2024Updated 2 years ago
- A simple, lightweight desktop client that preserves the native Pi experience.☆36Updated this week
- Printable ATX I/O shields☆20Dec 17, 2025Updated 10 months ago