A 198t/s and 353t/s qwen 3.8 27b inferencing engine for 2*v100 and 4*v100
☆118Nov 12, 2026Updated this week
Alternatives and similar repositories for ninfer-v100xN
Users that are interested in ninfer-v100xN are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- High-performance single-GPU inference for selected model checkpoints and GPUs.☆273Sep 14, 2026Updated 2 months ago
- V100 / SM70-focused vLLM engineering fork for modern LLM inference.☆1,533Updated this week
- Strata port for Tesla V100 (sm_70): Qwen3.8-Flash-Next with 262K context and MTP☆156Updated this week
- llama.cpp optimized for NVIDIA Tesla V100 (SM70). Qwen3.8-Flash-Next (MoE) with MTP on 1/2/3/6x V100-16GB at 262K context (6 GPUs: prefil…☆83Updated this week
- SGLang for cool dudes using V100☆86Updated this week
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- marlin_v100 是一个从 vLLM 主树中提取出来的最小 Marlin 独立开发工作区,聚焦于 Marlin dense 与 Marlin MoE 的源码开发、最小构建和轻量验证。它保留了核心 CUDA/C++ 实现、最小 Python 薄封装、生成器测试与主树回写…☆27Jul 2, 2026Updated 4 months ago
- llama.cpp performance patches developed and measured on Tesla P100 (GP100, sm_60). Most are not Pascal-specific.☆64Oct 27, 2026Updated 3 weeks ago
- Agentic-coding focused inference engine for n x V100 (e.g. SXM2), based on SGLang: GLM-5.3-Flash, Qwen3.8-Flash-Next, DeepSeek-V4.1-Flash…☆42Updated this week
- Stable, high-throughput inference server for multi-GPU NVIDIA V100 (SM70): Qwen3.8 Flash-Next with AWQ / NVFP4, multimodal input, CPU/dis…☆62Updated this week
- Ollama 0.12.3 + ROCm 7.1 for AMD MI50 (gfx906) Docker image☆11Apr 9, 2026Updated 7 months ago
- ComfyuiNode☆18Aug 20, 2026Updated 2 months ago
- forked from vllm-project/flash-attention☆75May 9, 2026Updated 6 months ago
- Patches for running llama.cpp fast on Tesla P100 (GP100/sm_60)☆36Oct 16, 2026Updated last month
- Personal headless AI server — docs, ADRs, and operational scripts☆22Nov 10, 2026Updated last week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ZCode 账号池反代网关☆34Oct 31, 2026Updated 2 weeks ago
- Unsloth Core Fine-Tuning Fixes for Intel Arc dGPUs on Windows 11 & WSL2☆18Jul 19, 2026Updated 3 months ago
- 1Cat Studio: unified vLLM workbench, Codex Agent and creative canvas☆15Nov 6, 2026Updated last week
- Fork of llama.cpp Nvida Volta V100 (tensor parallelism 4 x v100 GPU)☆12Updated this week
- vLLM fork for Tesla V100☆15May 31, 2026Updated 5 months ago
- Автор Зорков Игорь.☆18May 6, 2019Updated 7 years ago
- ☆20Oct 29, 2026Updated 2 weeks ago
- Simple, but flexible expression parser for Delphi. Forked from JvExprParser.☆16Feb 19, 2026Updated 8 months ago
- Production-grade convergence & anti-overthinking steering extension for Pi Coding Agent (tuned for Bonsai 2 / Qwen)☆18Sep 21, 2026Updated last month
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- One line of NInfer for the Blackwell, Ada Lovelace, Ampere, Turing and Volta NVIDIA GPUs, consolidated from the forks that carry it: GGUF…☆230Updated this week
- Local LLM Inference Speed Test Tool☆254Oct 21, 2026Updated 3 weeks ago
- WavvieW: Analyzes the noise-wave-generator, synthesizer, audio files, input-mic_line-in with Oscilloscope and Spectrum FFT.☆20Jul 2, 2026Updated 4 months ago
- KVMem virtualizes KV memory across inference backends to make ultra-long-context local AI accessible on limited hardware.☆1,348Updated this week
- Implementation of FlashAttention-2 for Nvidia Tesla V100 / Titan V☆221Updated this week
- LLM inference in C/C++☆23Oct 25, 2026Updated 3 weeks ago
- A professional Next.js blogging platform with advanced AI-driven content generation. Auto-Blog leverages RSS feed analysis and Retrieval-…☆22Oct 8, 2025Updated last year
- LLM inference in C/C++☆77Nov 6, 2026Updated last week
- 1CatV2 with TileLANG written FA-v100 and many goodies☆20Jul 15, 2026Updated 4 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- This project will accompany Part 3 of Writing an Interpreter in Object Pascal.☆18Jun 28, 2025Updated last year
- High-performance single-GPU inference for selected model checkpoints and GPUs (rtx 5060ti 16gb).☆34Sep 18, 2026Updated last month
- Simple 2-channel virtual oscilloscope (soundcard signal) - SDL, RtAudio, FFTW3☆12Mar 25, 2017Updated 9 years ago
- A tool for adding function calling to llm api, available as a service by following the link☆22Aug 11, 2025Updated last year
- Yet another Delphi scripting system☆28Oct 24, 2018Updated 8 years ago
- WorkBuddy2API-Hub 社区接管分支(自用):合并社区 PR #813-#819,v2.0.1☆77Updated this week
- Create text chunks which end at natural stopping points without using a tokenizer☆26Nov 26, 2025Updated 11 months ago
Are these results useful?