Fork of llama.cpp Nvida Volta V100 (tensor parallelism 4 x v100 GPU)
☆12Nov 19, 2026Updated this week
Alternatives and similar repositories for llama.cpp-4xV100
Users that are interested in llama.cpp-4xV100 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- SGLang for cool dudes using V100☆86Nov 11, 2026Updated last week
- Flash Attention v2 for Pascal (P100, GTX 1080) and Volta (V100) GPUs — bringing O(N) memory attention to hardware the official flash-attn…☆32Nov 3, 2026Updated 2 weeks ago
- Stable, high-throughput inference server for multi-GPU NVIDIA V100 (SM70): Qwen3.8 Flash-Next with AWQ / NVFP4, multimodal input, CPU/dis…☆66Updated this week
- Auto-built Docker image of 1Cat-vLLM for NVIDIA Tesla V100 (sm_70/Volta) with CUDA 12.8 — rebuilt daily when upstream releases☆13Jul 22, 2026Updated 3 months ago
- Third party commentaries for UniqueBible☆13Apr 8, 2021Updated 5 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ☆13Dec 29, 2020Updated 5 years ago
- Configuration files for porting a Sunlu S9 Plus to Klipper☆12Aug 28, 2025Updated last year
- Curated V100 SXM2 pin maps, two- and four-GPU NVLink connection plans, and connector-only KiCad resources toward an open-source carrier b…☆61Nov 4, 2026Updated 2 weeks ago
- Claude control for KiisuV4b☆13Aug 5, 2026Updated 3 months ago
- A JavaScript 6502 assembler and simulator☆13Jan 26, 2026Updated 9 months ago
- Hand-written NVFP4 W4A16 CUDA kernels for Volta☆188Aug 19, 2026Updated 3 months ago
- Benchmarks and notes for running modern LLMs with vLLM on 8x Tesla V100-32GB in 2026.☆25Jul 10, 2026Updated 4 months ago
- A set of benchmarks selected to compare different GPU server builds. Uses docker to force parallelization of normally single GPU tests.☆13Oct 25, 2026Updated 3 weeks ago
- The set-and-forget LLM engine for Pascal and Volta: PXQ codec + kernels, auto-tuned per card. Ready-to-run PXQ models in MODELS.md; bench…☆126Updated this week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆17Jun 10, 2026Updated 5 months ago
- Agentic-coding focused inference engine for n x V100 (e.g. SXM2), based on SGLang: GLM-5.3-Flash, Qwen3.8-Flash-Next, DeepSeek-V4.1-Flash…☆44Updated this week
- GUI-based password/hash cracking tool. Supports both CPU / GPU cracking, built on top of hashcat as a backend, Supports 20+ hash algorith…☆20Sep 9, 2026Updated 2 months ago
- Low-cost (approx. 1000R) biaxial equatorial mount using dual S14-100/S17-100 harmonic reducers, 1:5.18 planetary reducers, 42H48 stepper …☆15Aug 26, 2024Updated 2 years ago
- A LD_PRELOAD library to share CUDA VRAM weights across multiple processes using IPC.☆12Jun 30, 2026Updated 4 months ago
- ☆11Feb 11, 2015Updated 11 years ago
- WebNN Developer Documentation☆16Nov 9, 2026Updated last week
- CUDA engine that splits every layer of a production quality MoE LLM across three PCIe V100 cards delivering 382 tok/s on a used $1,800 bo…☆86Nov 7, 2026Updated last week
- DeepSeek V4 Flash 284B on AMD Strix Halo (gfx1151) — up to 32 tok/s decode & ~250 tok/s prefill via ROCmFPX, DSpark & ROCm 7.2☆21Aug 28, 2026Updated 2 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Firmware that drives the 2nd generation Afridev Sensor☆15May 7, 2021Updated 5 years ago
- Run MiniMax H3 at native fp16 on pre-bf16 GPUs (V100/Volta) — exact-math fix for the black-frame overflows, ~11× faster than the fp32 fal…☆62Aug 8, 2026Updated 3 months ago
- 📅 react custom calendar☆10Sep 9, 2022Updated 4 years ago
- The wireless split keyboard firmware using ZMK has been optimized for E-ink screens and the Cirque trackpad.☆19Updated this week
- Local-first long-term memory and safer context compression for Hermes Agent — SQLite, no required services.☆12Oct 24, 2026Updated 3 weeks ago
- ☆16Oct 29, 2026Updated 3 weeks ago
- vLLM recipe: GLM-5.3-Flash EXL3 K2 on one DGX Spark GB10. Native MTP k=2. Measured tok/s.☆26Sep 10, 2026Updated 2 months ago
- A Deepseek V4 Flash 0731 / Vision Exp VLLM stack☆27Sep 24, 2026Updated last month
- free ai chat bridge to your pc☆13Aug 18, 2026Updated 3 months ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Latest firmware for antsdr E310 based on PlutoSDR☆18Aug 7, 2022Updated 4 years ago
- A web interface for pass☆28Dec 10, 2022Updated 3 years ago
- Open Source multiaxis CAM software☆15Jul 25, 2026Updated 3 months ago
- ☆13Jun 27, 2025Updated last year
- network & web assessment framework with attack-surface mapping and sensitive-exposure detection☆22Jun 22, 2026Updated 4 months ago
- ☆10Jun 23, 2019Updated 7 years ago
- Example using Rust futures with async/await as of May 2019☆11May 18, 2019Updated 7 years ago
Are these results useful?