Single-GPU Tesla V100-32GB (sm_70) inference line: native nvfp4/fp8 and GGUF-derived artifacts, v2 and v3 containers, 27K-token prefill 1.00k tok/s, decode 78+ tok/s.
☆16Nov 19, 2026Updated this week
Alternatives and similar repositories for ninfer-v100
Users that are interested in ninfer-v100 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- llama.cpp optimized for NVIDIA Tesla V100 (SM70). Qwen3.8-Flash-Next (MoE) with MTP on 1/2/3/6x V100-16GB at 262K context (6 GPUs: prefil…☆84Nov 12, 2026Updated last week
- 两张 V100 跑 Qwen3.8-27B 到 100 tok/s(186K 上下文):重写 sm70 注意力内核 + 多卡张量并行。Fork of geoffwatts/ninfer-v100.☆21Sep 28, 2026Updated last month
- As the name suggest, this is a version of llamacpp optimized for nvidia tesla v100 gpus, with some additional perks.☆19Oct 2, 2026Updated last month
- Fork of llama.cpp Nvida Volta V100 (tensor parallelism 4 x v100 GPU)☆12Updated this week
- NVIDIA Tesla V100 显卡驱动自动化管理套件☆34Oct 9, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A 198t/s and 353t/s qwen 3.8 27b inferencing engine for 2*v100 and 4*v100☆120Updated this week
- High-performance single-GPU inference for selected model checkpoints and GPUs.☆16Sep 26, 2026Updated last month
- ☆13Oct 30, 2021Updated 5 years ago
- Add radar LD2450☆11Aug 7, 2025Updated last year
- Strata port for Tesla V100 (sm_70): Qwen3.8-Flash-Next with 262K context and MTP☆167Updated this week
- WavvieW: Analyzes the noise-wave-generator, synthesizer, audio files, input-mic_line-in with Oscilloscope and Spectrum FFT.☆20Jul 2, 2026Updated 4 months ago
- A powerful unique id generator written in rust. Support multiple kinds of usage of worker id in one instance☆23Oct 26, 2026Updated 3 weeks ago
- High-performance single-GPU inference for selected model checkpoints and GPUs.☆274Sep 14, 2026Updated 2 months ago
- Benchmarks and notes for running modern LLMs with vLLM on 8x Tesla V100-32GB in 2026.☆25Jul 10, 2026Updated 4 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Simple 2-channel virtual oscilloscope (soundcard signal) - SDL, RtAudio, FFTW3☆12Mar 25, 2017Updated 9 years ago
- Benchmark your local LLMs with real evaluation suites. Not vibes - actual scores.☆41Updated this week
- Repository with all the sources of the CM3D Prusa Mini Bear compilation☆10Oct 24, 2022Updated 4 years ago
- Spen's Official OpenOCD Mirror☆12Jun 11, 2016Updated 10 years ago
- ISO 3166-1 (alpha-2/alpha-3/numeric) country code enum in Java.☆30Nov 21, 2020Updated 6 years ago
- Experimental Strata gfx906/wave64 port with MI50 layer-split and IQ2_XS validation☆16Updated this week
- NInfer on Tesla V100 (sm_70): Qwen3.8-27B deployment, build/convert scripts, systemd service, and cross-engine benchmark (vs llama.cpp). …☆56Sep 15, 2026Updated 2 months ago
- High-performance Duo-V100-GPU inference for selected model checkpoints and GPUs.☆42Nov 2, 2026Updated 2 weeks ago
- 线上预约医生App(Android):在校第一个万行代码项目,纪念一下☆10Oct 20, 2020Updated 6 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Optimized firmware for the AnyCubic Predator delta 3D printer. Based off Marlin 2.0.0. This specific config is customized for my machine …☆12Feb 5, 2022Updated 4 years ago
- Java Native Interface for PKCS#11☆40Updated this week
- android版钉钉打卡工具,基于Justson/DingDingHelper的项目修改而来☆11Feb 5, 2018Updated 8 years ago
- Ollama 0.12.3 + ROCm 7.1 for AMD MI50 (gfx906) Docker image☆11Apr 9, 2026Updated 7 months ago
- 录音转写与会议纪要 · 自部署 Web 版 · GPU 加速 · 隐私优先 · Recording transcription & meeting notes self-hosted web app☆13Jul 21, 2026Updated 4 months ago
- llama.cpp tuned for 2x Tesla P100 (sm_60). Decode 1.86x, 3-4x with MTP (up to ~70 t/s on code). Prefill 2x, full 262k context with vision…☆81Nov 7, 2026Updated 2 weeks ago
- Local-first long-term memory and safer context compression for Hermes Agent — SQLite, no required services.☆12Oct 24, 2026Updated 3 weeks ago
- ☆16Updated this week
- Make LM Studio load Ternary Bonsai 2 GGUF (PQ2_0 / PTQ1_0) via Prism's llama.cpp fork, with reasoning-effort selector. Linux + Windows, d…☆34Sep 21, 2026Updated 2 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- 帮助微信Hook开发☆11Oct 30, 2019Updated 7 years ago
- ☆15Jul 9, 2026Updated 4 months ago
- Patches for running llama.cpp fast on Tesla P100 (GP100/sm_60)☆37Oct 16, 2026Updated last month
- Header information parser for PE, ELF, DEX, MachO, ZIP (JAR, DocX).☆17Aug 3, 2026Updated 3 months ago
- ☆13Sep 21, 2018Updated 8 years ago
- free ai chat bridge to your pc☆13Aug 18, 2026Updated 3 months ago
- New Kobra Max UI based on Cobra Kai and M117 Support☆15Mar 7, 2024Updated 2 years ago
Are these results useful?