Fork of llama.cpp Nvida Volta V100 (tensor parallelism 4 x v100 GPU)
☆12Oct 29, 2026Updated this week
Alternatives and similar repositories for llama.cpp-4xV100
Users that are interested in llama.cpp-4xV100 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- SGLang for cool dudes using V100☆82Oct 5, 2026Updated 3 weeks ago
- Flash Attention v2 for Pascal (P100, GTX 1080) and Volta (V100) GPUs — bringing O(N) memory attention to hardware the official flash-attn…☆29Updated this week
- Auto-built Docker image of 1Cat-vLLM for NVIDIA Tesla V100 (sm_70/Volta) with CUDA 12.8 — rebuilt daily when upstream releases☆12Jul 22, 2026Updated 3 months ago
- Third party commentaries for UniqueBible☆13Apr 8, 2021Updated 5 years ago
- The set-and-forget LLM engine for Pascal and Volta: PXQ codec + kernels, auto-tuned per card. Ready-to-run PXQ models in MODELS.md; bench…☆95Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆13Dec 29, 2020Updated 5 years ago
- Claude control for KiisuV4b☆13Aug 5, 2026Updated 2 months ago
- Configuration files for porting a Sunlu S9 Plus to Klipper☆12Aug 28, 2025Updated last year
- Hand-written NVFP4 W4A16 CUDA kernels for Volta☆178Aug 19, 2026Updated 2 months ago
- A JavaScript 6502 assembler and simulator☆13Jan 26, 2026Updated 9 months ago
- Agentic-coding oriented inference engine for N x V100-SXM2, based on SGLang: GLM-5.3-Flash, Qwen3.8-Flash-Next, DeepSeek-V4.1-Flash, Mini…☆34Oct 7, 2026Updated 3 weeks ago
- Stable, high-throughput inference server for multi-GPU NVIDIA V100 (SM70): Qwen3.8 Flash-Next with AWQ / NVFP4, multimodal input, CPU/dis…☆17Updated this week
- Benchmarks and notes for running modern LLMs with vLLM on 8x Tesla V100-32GB in 2026.☆23Jul 10, 2026Updated 3 months ago
- DeepSeek V4 Flash 284B on AMD Strix Halo (gfx1151) — up to 32 tok/s decode & ~250 tok/s prefill via ROCmFPX, DSpark & ROCm 7.2☆19Aug 28, 2026Updated 2 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- GUI-based password/hash cracking tool. Supports both CPU / GPU cracking, built on top of hashcat as a backend, Supports 20+ hash algorith…☆19Sep 9, 2026Updated last month
- An open source multi-function instrument for everyone☆17Oct 16, 2026Updated 2 weeks ago
- Run MiniMax H3 at native fp16 on pre-bf16 GPUs (V100/Volta) — exact-math fix for the black-frame overflows, ~11× faster than the fp32 fal…☆56Aug 8, 2026Updated 2 months ago
- Serve your models fast on your own infra in 3 steps.☆42Updated this week
- network & web assessment framework with attack-surface mapping and sensitive-exposure detection☆21Jun 22, 2026Updated 4 months ago
- WebNN Developer Documentation☆16Updated this week
- Low-cost (approx. 1000R) biaxial equatorial mount using dual S14-100/S17-100 harmonic reducers, 1:5.18 planetary reducers, 42H48 stepper …☆15Aug 26, 2024Updated 2 years ago
- Reproducible vLLM recipe: nvidia/Qwen3.8-Flash-Next-NVFP4 on one NVIDIA DGX Spark (GB10) — pinned nightly, patches with provenance, build…☆26Updated this week
- ☆11Feb 11, 2015Updated 11 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Your personal AI team that gets things done. Shared memory. Any model. Local or cloud. Run. Rest. Dream. 🐨☆34Updated this week
- The wireless split keyboard firmware using ZMK has been optimized for E-ink screens and the Cirque trackpad.☆18Sep 17, 2026Updated last month
- A Deepseek V4 Flash 0731 / Vision Exp VLLM stack☆26Sep 24, 2026Updated last month
- llama.cpp optimized for NVIDIA Tesla V100 (SM70): Qwen3.8-Flash-Next with MTP (prefill 3402 tok/s at 200K context on 6x V100-16GB; also r…☆62Oct 23, 2026Updated last week
- ☆16Oct 21, 2026Updated last week
- Firmware that drives the 2nd generation Afridev Sensor☆15May 7, 2021Updated 5 years ago
- Recover usable memory on DGX Spark with a 64 KiB kernel: an opt-in NVIDIA UVM page-table packing patch, build tools, and measured validat…☆34Oct 16, 2026Updated 2 weeks ago
- A browsable, searchable memory layer for Hermes AI agent conversations — automatically captured, summarized, and injected as context into…☆14May 29, 2026Updated 5 months ago
- free ai chat bridge to your pc☆13Aug 18, 2026Updated 2 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- 📅 react custom calendar☆10Sep 9, 2022Updated 4 years ago
- vLLM recipe: GLM-5.3-Flash EXL3 K2 on one DGX Spark GB10. Native MTP k=2. Measured tok/s.☆26Sep 10, 2026Updated last month
- A CAT-Q-style ternary quantization trainer for Qwen3, with MLX export for Apple silicon.☆10Sep 8, 2026Updated last month
- A web interface for pass☆28Dec 10, 2022Updated 3 years ago
- Latest firmware for antsdr E310 based on PlutoSDR☆18Aug 7, 2022Updated 4 years ago
- GuardianBridge keeps messaging and coordination working when cellular or internet is unavailable. By combining a Meshtastic mesh network …☆25Feb 16, 2026Updated 8 months ago
- ☆13Jun 27, 2025Updated last year