A 198t/s and 353t/s qwen 3.8 27b inferencing engine for 2*v100 and 4*v100
☆80Oct 24, 2026Updated this week
Alternatives and similar repositories for ninfer-v100xN
Users that are interested in ninfer-v100xN are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- High-performance Duo-V100-GPU inference for selected model checkpoints and GPUs.☆34Oct 14, 2026Updated last week
- High-performance single-GPU inference for selected model checkpoints and GPUs.☆254Sep 14, 2026Updated last month
- NInfer on Tesla V100 (sm_70): Qwen3.8-27B deployment, build/convert scripts, systemd service, and cross-engine benchmark (vs llama.cpp). …☆52Sep 15, 2026Updated last month
- llama.cpp optimized for NVIDIA Tesla V100 (SM70): Qwen3.8-Flash-Next with MTP (prefill 3402 tok/s at 200K context on 6x V100-16GB; also r…☆59Updated this week
- Superseded by github.com/poisonxa16/pxa — PXA, the set-and-forget engine for Pascal and Volta☆24Sep 8, 2026Updated last month
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- V100 / SM70-focused vLLM engineering fork for modern LLM inference.☆1,397Updated this week
- SGLang for cool dudes using V100☆80Oct 5, 2026Updated 3 weeks ago
- Spring Boot Demo☆10Jul 17, 2024Updated 2 years ago
- ComfyUI MiniMax H3 inference optimizations for NVIDIA Tesla V100 (SM70)☆30Sep 29, 2026Updated 3 weeks ago
- Hand-written NVFP4 W4A16 CUDA kernels for Volta☆175Aug 19, 2026Updated 2 months ago
- Strata port for Tesla V100 (sm_70): Qwen3.8-Flash-Next with 262K context and MTP☆95Updated this week
- CMP90HX persistent compute unlock for NVIDIA Open 580.159.03☆19Jul 31, 2026Updated 2 months ago
- The set-and-forget LLM engine for Pascal and Volta: PXQ codec + kernels, auto-tuned per card. Ready-to-run PXQ models in MODELS.md; bench…☆90Updated this week
- banana 提示词在线体验☆24Jan 14, 2026Updated 9 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- One step to enable best-practices for AI agents — drop into any project and enjoy the magic.☆23Sep 8, 2026Updated last month
- Self-hosted kanban for humans and agents. One 4 MB binary, starts in 2 ms, zero setup.☆39Updated this week
- Try get the physical address(hardware MAC address) of the hosts network interfaces.☆13Dec 25, 2023Updated 2 years ago
- marlin_v100 是一个从 vLLM 主树中提取出来的最小 Marlin 独立开发工作区，聚焦于 Marlin dense 与 Marlin MoE 的源码开发、最小构建和轻量验证。它保留了核心 CUDA/C++ 实现、最小 Python 薄封装、生成器测试与主树回写…☆26Jul 2, 2026Updated 3 months ago
- forked from vllm-project/flash-attention☆69May 9, 2026Updated 5 months ago
- Collection of different programming language examples☆10Jan 9, 2019Updated 7 years ago
- These documents are for the purpose of adjusting the V_CPUCORE for the OG Xbox with an Pentium III CPU Installed.☆13Nov 4, 2024Updated last year
- Real-time CPU / GPU / RAM / Voltage tuner for R36S running dArkOSRE (RK3326)☆18Jun 17, 2026Updated 4 months ago
- Local LLM Inference Speed Test Tool☆246Oct 21, 2026Updated last week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- AI media harness for planning, generating, and editing locally☆45Updated this week
- ☆25Jun 6, 2026Updated 4 months ago
- ☆14Apr 28, 2023Updated 3 years ago
- Pong in Haskell / Clash, running as software using SDL and as hardware targeting FPGAs☆10Apr 20, 2024Updated 2 years ago
- ☆13Mar 17, 2023Updated 3 years ago
- Galahad by Corbenic☆51Oct 4, 2026Updated 3 weeks ago
- Example using Rust futures with async/await as of May 2019☆11May 18, 2019Updated 7 years ago
- Chrome Extention to Recover streamed PDFs from web tabs☆14Jul 24, 2026Updated 3 months ago
- Simple half duplex tunnel☆16Apr 29, 2021Updated 5 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- 适用于微信客户端4.0版本的wxauto☆16Sep 19, 2025Updated last year
- A Playwright-based Python tool that bypasses Google's anti-bot mechanisms to execute searches, serving as both a command-line tool and MC…☆16Apr 2, 2026Updated 6 months ago
- 提示词管理器，管理你的创意☆13Jan 2, 2026Updated 9 months ago
- A backend service for creating photo mosaics☆18Feb 16, 2012Updated 14 years ago
- STUN Cloud WebHooks for Port Mapping☆15Oct 17, 2025Updated last year
- Commodore VIC20 core for the Tang Nano 9K FPGA with LCD Output☆12Feb 16, 2025Updated last year
- 可能是让你受益匪浅的英语进阶指南☆12Sep 12, 2018Updated 8 years ago