Lsglang is a special extension of sglang that fully utilizes CPU and GPU computing resources with an efficient GPU parallel + NUMA parallel architecture, suitable for MOE model hybrid inference.
☆134Sep 12, 2026Updated this week
Alternatives and similar repositories for Lsglang
Users that are interested in Lsglang are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- LvLLM is a special NUMA extension of vllm that makes full use of CPU and memory resources, reduces GPU memory requirements, and features …☆452Updated this week
- 大语言模型工具集☆28Aug 1, 2025Updated last year
- vllm混合推理扩展插件，支持多NUMA混合推理，单卡推理Qwen3-Next模型可达1000+ prefill☆34Nov 7, 2025Updated 10 months ago
- Qwen4-Exp (Qwen3.8-Flash-Next) SWA + MTP + PLE-on-iswa — bounded deep-context decode w/ long-range recall, TBQ4 4.25 bpv KV, DSpark + Rot…☆96Sep 2, 2026Updated last week
- forked from vllm-project/flash-attention☆64May 9, 2026Updated 4 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆17Mar 20, 2026Updated 5 months ago
- A source repo of Postgres Chinese full-test search docker image, based on zhparser.☆10Mar 25, 2021Updated 5 years ago
- Implementation of FlashAttention-2 for Nvidia Tesla V100 / Titan V☆202Jun 30, 2026Updated 2 months ago
- RIFT 见缝插帧☆17May 15, 2022Updated 4 years ago
- Precision Knowledge Editing (PKE): A novel method to reduce toxicity in LLMs while preserving performance, with robust evaluations and ha…☆12Nov 26, 2024Updated last year
- a demo of Animeganv2 infer by ncnn☆23Nov 26, 2021Updated 4 years ago
- ComfyUI custom node for Qwen3.5-9B unified multimodal model☆40Mar 13, 2026Updated 6 months ago
- 检测透视图像中的矩形文档并对其进行矫正☆32Sep 16, 2022Updated 3 years ago
- enable Clawdbot to support tool calling functionality for local inference models (sglang/vLLM). Duckduckgo api-free web-search tool is av…☆19Feb 6, 2026Updated 7 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A conda-smithy repository for cling.☆12Apr 23, 2026Updated 4 months ago
- Gluetun-Sync is an open-source utility designed to automatically update your services when the NAT port changes in Gluetun VPN☆12Sep 25, 2024Updated last year
- ☆14Sep 4, 2024Updated 2 years ago
- Probably one of the lightest native RAG + Agent apps out there，experience the power of Agent-powered models and Agent-driven knowledge ba…☆33May 30, 2025Updated last year
- Framework for testing the reachability of native functions in Android applications.☆11Aug 30, 2023Updated 3 years ago
- ☆974Sep 14, 2025Updated 11 months ago
- A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations☆19,503Updated this week
- GPU Power and Performance Manager☆73Oct 13, 2024Updated last year
- Challenging SAT benchmarks for matrix multiplication☆13Oct 28, 2021Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- KTransformers 一键部署脚本☆60Apr 18, 2025Updated last year
- CAV'22 paper to speed up Neural Network Verification.☆13Dec 19, 2022Updated 3 years ago
- FORK of VLLM for AMD MI25/50/60. A high-throughput and memory-efficient inference and serving engine for LLMs☆70May 4, 2025Updated last year
- FlashInfer: Kernel Library for LLM Serving (Windows build & kernels)☆18Jul 1, 2026Updated 2 months ago
- Triton for AMD MI25/50/60. Development repository for the Triton language and compiler☆35Dec 15, 2025Updated 8 months ago
- PiDiNet running in Android by ncnn☆15Sep 26, 2021Updated 4 years ago
- memo☆13Dec 22, 2022Updated 3 years ago
- 一款ComfyUI扩展节点，能够为您的图像添加各种精美的艺术文字效果，支持丰富的文 字样式和特效。☆30Aug 19, 2026Updated 3 weeks ago
- Analysis of 44 AI agent frameworks through a context engineering lens. Feb 2026.☆19Feb 18, 2026Updated 6 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Port of Qless' web interface to the Openresty environment.☆13Apr 19, 2017Updated 9 years ago
- Decompose source code into templates and fragments for any language.☆23Aug 29, 2022Updated 4 years ago
- for calculating euler angle test in ncnn☆11Aug 7, 2026Updated last month
- LLM speculative inference server for heterogeneous hardware & consumer GPUs☆2,851Updated this week
- ☆52Mar 17, 2025Updated last year
- ☆10Feb 18, 2024Updated 2 years ago
- Lua XPath resurrection☆14Jul 12, 2024Updated 2 years ago