SGLang for cool dudes using V100
☆79Oct 5, 2026Updated 2 weeks ago
Alternatives and similar repositories for sglang-V100
Users that are interested in sglang-V100 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Local-first AI manga drama production studio powered by Agnes-compatible APIs.☆48Sep 24, 2026Updated 3 weeks ago
- Fast & lightweight interface for running Nano Banana LLM and compact local models on your PC. Optimized for high-speed AI interactions.☆43Mar 17, 2026Updated 7 months ago
- Strata fork: Qwen3.8-Flash-Next 125B MoE in NVFP4 on one RTX 20-50 card (12 GB+) and 64 GB of RAM or more. Setup installs our GPTQ quants…☆165Updated this week
- vLLM fork for Tesla V100 (SM70) — extends 1CatAI's AWQ support and adds GGUF support☆25Jun 20, 2026Updated 3 months ago
- Benchmarks and notes for running modern LLMs with vLLM on 8x Tesla V100-32GB in 2026.☆23Jul 10, 2026Updated 3 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- llama-cpp support turboquant and gemma 4☆20May 19, 2026Updated 4 months ago
- 用于YOLO11模型转化为RKNN模型在RK系列开发板上面部署☆16Sep 21, 2025Updated last year
- Hand-written NVFP4 W4A16 CUDA kernels for Volta☆175Aug 19, 2026Updated last month
- VENDORIZED in lucebox-hub. Fork of llama.cpp, ggml graph for lucebox inference engine☆30Jul 8, 2026Updated 3 months ago
- marlin_v100 是一个从 vLLM 主树中提取出来的最小 Marlin 独立开发工作区，聚焦于 Marlin dense 与 Marlin MoE 的源码开发、最小构建和轻量验证。它保留了核心 CUDA/C++ 实现、最小 Python 薄封装、生成器测试与主树回写…☆26Jul 2, 2026Updated 3 months ago
- ☆22Oct 6, 2026Updated last week
- 1CatV2 with TileLANG written FA-v100 and many goodies☆20Jul 15, 2026Updated 3 months ago
- MiniMax H3 300% speed本地部署指南（消费级 16GB 显存版）：全栈加速链 cu130+SageAttention+TE-Speed 实测、模型组合、避坑清单☆84Aug 12, 2026Updated 2 months ago
- The pruned version of lightweight OpenPose.☆19Apr 15, 2019Updated 7 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Save time. Eat bananas.☆31Dec 29, 2018Updated 7 years ago
- DJI大疆C620电调的Arduino版本的控制器☆18Oct 6, 2019Updated 7 years ago
- High-performance single-GPU inference for selected model checkpoints and GPUs.☆240Sep 14, 2026Updated last month
- CPU-GPU hybrid inference for DeepSeek-V4 on NVIDIA SM80+ (A100/RTX 4090 etc.), forked from yhfgyyf/vllm-deepseek-v4-sm89.☆60Sep 16, 2026Updated last month
- MantisZip is a free, open-source compression/decompression tool for Windows, featuring in-archive preview and password manager for enhanc…☆54Updated this week
- Proof of concept to test POODLE over TLS☆11Mar 13, 2015Updated 11 years ago
- Obsidian 零成本同步：iPhone ↔ Mac，GitHub 自动备份。本地优先 + 长期积累。｜Local First. Zero-cost Obsidian sync across iPhone, Mac & GitHub. Let knowledge grow…☆34Aug 24, 2026Updated last month
- 家国梦游戏py脚本，实现 🔥自动升级政策🔥自动划金币，自动升级，自动收取火车。☆12Oct 16, 2019Updated 7 years ago
- A solid-state, high-performance Catppuccin Macchiato theme for Omarchy Linux.☆33Sep 4, 2026Updated last month
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Remove metadata from photos, PDFs, Office documents, audio and video. Strips EXIF, GPS location, camera serial numbers, author names and …☆33Oct 10, 2026Updated last week
- Real-time 3D multi-person pose estimation demo on Jetson TX2 with TensorRT.☆24Jun 16, 2020Updated 6 years ago
- Best ready-to-run DeepSeek Harness distribution: DSH desktop GUI, DSH terminal TUI, and harness integration.☆165Sep 3, 2026Updated last month
- Metric scrapers, InfluxDB queries, and Grafana dashboards for crypto miners. (XMRig, XMRig-proxy, GMiner, MoneroOcean, Belkin WeMo, Teleg…☆24Dec 26, 2021Updated 4 years ago
- ☆15Jun 29, 2025Updated last year
- DeepSeek-V4.1-Flash EXL3 on one 24 GB RTX 3090 + DDR4 + NVMe: staged-DMA prefill, AVX2 CPU expert tier, elastic VRAM expert cache, Engram…☆145Updated this week
- Dogfooding vLLM backport for older GPUs.☆315Updated this week
- The set-and-forget LLM engine for Pascal and Volta: PXQ codec + kernels, auto-tuned per card. Ready-to-run PXQ models in MODELS.md; bench…☆85Updated this week
- Small example demonstrating overlay windows with accessibility service on Android.☆11Apr 22, 2021Updated 5 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆19Jun 26, 2017Updated 9 years ago
- YunChat是一款有趣且开源的聊天应用，基于 Springboot、Vite、TypeScript、Redis、Socket.IO、Kotlin等技术开发☆16Apr 9, 2026Updated 6 months ago
- 《家国梦》建筑摆放加成计算器（在线版免安装）。浏览器中直接使用，并能记住参数。☆27Oct 6, 2019Updated 7 years ago
- MiniMax-H3 multi-GPU inference acceleration: ~12x on 8x RTX 6000D (step distillation + SageAttention2 + Cache-DiT + torch.compile, TP2+Ul…☆120Sep 26, 2026Updated 3 weeks ago
- ☆13Aug 28, 2014Updated 12 years ago
- 引流外链【开心版引流宝】致力于为个人、团队提供基于微信私域流量的推广、引流的效率工具。可减轻人力，有效降低资源损失、流量流失的几率。引流宝完全开源，免费，可商用、可任意二次开发。引流宝可以辅助你更好地开展营销活动推广！降低运营成本，提高工作效率，获取更多资源。☆13Feb 12, 2024Updated 2 years ago
- Xolotl (formerly Strata-DSV4.1): DeepSeek-V4.1-Flash, all 552B, on one gaming PC (RTX 4090 + 90 GB RAM) at ~27 tok/s, plus GLM-5.3-Flash,…☆92Updated this week