Agentic-coding oriented inference engine for N x V100-SXM2, based on SGLang: GLM-5.3-Flash, Qwen3.8-Flash-Next, DeepSeek-V4.1-Flash, MiniMax-H3.
☆31Oct 7, 2026Updated last week
Alternatives and similar repositories for sglang-sxm2
Users that are interested in sglang-sxm2 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- llama.cpp optimized for NVIDIA Tesla V100 (SM70): large MoE Qwen3.8-Flash-Next with MTP (prefill 3464 tok/s at 200K context, 6x V100-16GB…☆44Updated this week
- NInfer on Tesla V100 (sm_70): Qwen3.8-27B deployment, build/convert scripts, systemd service, and cross-engine benchmark (vs llama.cpp). …☆48Sep 15, 2026Updated last month
- Benchmarks and notes for running modern LLMs with vLLM on 8x Tesla V100-32GB in 2026.☆23Jul 10, 2026Updated 3 months ago
- 为 AI 打造的《魔兽争霸 III》1.27 开放接口：用任何语言写 AI · An open API for Warcraft III 1.27, built for AI agents — write bots in any language☆73Sep 28, 2026Updated 3 weeks ago
- SGLang for cool dudes using V100☆79Oct 5, 2026Updated 2 weeks ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Fast & lightweight interface for running Nano Banana LLM and compact local models on your PC. Optimized for high-speed AI interactions.☆43Mar 17, 2026Updated 7 months ago
- You won't believe this is a PI theme.☆31Updated this week
- xllama.cpp — Optimized LLM Inference for NVidia Tesla V100-SXM2-32GB☆17Apr 29, 2026Updated 5 months ago
- Run MiniMax H3 at native fp16 on pre-bf16 GPUs (V100/Volta) — exact-math fix for the black-frame overflows, ~11× faster than the fp32 fal…☆55Aug 8, 2026Updated 2 months ago
- 最新Max API | 中转API 分发系统 (One API | New API 最新二开美化版)☆13Aug 8, 2024Updated 2 years ago
- Graph database optimized for fast analysis and real-time data processing. It is provided as an extension to PostgreSQL.☆15Jan 24, 2025Updated last year
- Hotta (Tower of Fantasy) PC Assistant, only CN version for now☆32Apr 19, 2025Updated last year
- 1CatV2 with TileLANG written FA-v100 and many goodies☆20Jul 15, 2026Updated 3 months ago
- A Laravel package for interacting with OpenAI's GPT-3 API with full type annotations.☆12Oct 9, 2023Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Gemini API proxy on Vercel Edge & Nginx Alternative☆14Jun 18, 2024Updated 2 years ago
- Python bot to automate Quillbot without Buying Premium☆10Oct 22, 2020Updated 5 years ago
- https://github.com/bramses/chatgpt-md 原项目半年没更新，并且不支持识图，根据个人使用中觉得不便之处，对这个老哥的项目进行修改。The original project has not been updated for six month…☆10Jan 11, 2025Updated last year
- This is the skill that allows your AI agent to clone any website, pixel by pixel, 100% the same, including ux and ui☆55Aug 3, 2026Updated 2 months ago
- An MCP Server for aaPanel.☆17Mar 28, 2025Updated last year
- Kosal Chess Piece Set☆12Oct 23, 2018Updated 7 years ago
- marlin_v100 是一个从 vLLM 主树中提取出来的最小 Marlin 独立开发工作区，聚焦于 Marlin dense 与 Marlin MoE 的源码开发、最小构建和轻量验证。它保留了核心 CUDA/C++ 实现、最小 Python 薄封装、生成器测试与主树回写…☆26Jul 2, 2026Updated 3 months ago
- llama.cpp server in a Python wheel.☆15Jun 1, 2026Updated 4 months ago
- 哪吒监控 一站式轻监控轻运维系统。支持系统状态、HTTP、TCP、Ping 监控报警，命令批量执行和计划任务。☆12Mar 17, 2021Updated 5 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A simple set of configuration files and scripts that greatly enhances the default MPV experience. Installation is dead simple with a Powe…☆16Mar 1, 2026Updated 7 months ago
- Run agents in isolated cells that borrow verified tools instead of rebuilding Linux environments.☆62Updated this week
- An extension to use Kokoro TTS in text generation webui☆22May 5, 2025Updated last year
- Nibbler with Chess.com Icons and Review☆20Dec 10, 2024Updated last year
- Ethiopian Literature edited in TEI☆10Updated this week
- Core Python library for MaterialSearch project.☆19Sep 21, 2026Updated 3 weeks ago
- 本项目是最易部署的ChatGPT环境，想做点事情的创业者欢迎加群参与讨论！PHP版调用OpenAI最新接口和模型gpt-3.5-turbo进行问答的Demo，采用Stream流模式通信，一边生成一边输出，响应速度超过官网。前端采用JS的EventSource，支持Markd…☆11Apr 17, 2023Updated 3 years ago
- Aggregate, Filter and Monitor events inside the personal cloud.☆13Aug 7, 2023Updated 3 years ago
- Hand-written NVFP4 W4A16 CUDA kernels for Volta☆175Aug 19, 2026Updated 2 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Giant MoE models on a single consumer GPU by streaming experts from SSD. CUDA fork of antirez/ds4: runs GLM-5.2 (743B), Tencent Hy3 (295B…☆40Jul 12, 2026Updated 3 months ago
- A script to download OUI data from the IEEE and parse it into the nmap-mac-prefixes file so Nmap has the latest OUI data.☆12Jun 8, 2022Updated 4 years ago
- Post-Cortex provides durable memory infrastructure with automatic knowledge graph construction, intelligent entity extraction, and semant…☆20Updated this week
- A Skript Addon with miscellaneous syntax to make skripting easier.☆13Apr 7, 2024Updated 2 years ago
- H264, VP9, AV1 bitstream parser☆11Oct 28, 2023Updated 2 years ago
- Implementation of the AAAI 2026 paper "StoryBox: Collaborative Multi-Agent Simulation for Hybrid Bottom-Up Long-Form Story Generation Usi…☆19Mar 27, 2026Updated 6 months ago
- A self-hosted web interface for the pi coding agent.☆23Updated this week