SGLang-native serving for the Moet sign-symmetric W2 expert format with SM120 W2/W4 kernels, GLM-5.2 NVFP4 TP4 on 4x RTX PRO 6000
☆20Jul 10, 2026Updated 3 months ago
Alternatives and similar repositories for sglang-moet
Users that are interested in sglang-moet are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [PACT'24] GraNNDis. A fast and unified distributed graph neural network (GNN) training framework for both full-batch (full-graph) and min…☆10Aug 13, 2024Updated 2 years ago
- [DATE 2023] Pipe-BD: Pipelined Parallel Blockwise Distillation☆12Jul 13, 2023Updated 3 years ago
- Official repository of paper [FALQON: Accelerating LoRA Fine-tuning with Low-Bit Floating-Point Arithmetic, NeurIPS 2025]☆22Dec 2, 2025Updated 10 months ago
- PPoPP24 AGAThA: Fast and Efficient GPU Acceleration of Guided Sequence Alignment for Long Read Mapping☆22May 8, 2024Updated 2 years ago
- A High-Throughput Multi-GPU System for Graph-Based Approximate Nearest Neighbor Search☆21Jul 22, 2025Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- It's All In the Teacher: Zero-Shot Quantization Brought Closer to the Teacher [CVPR 2022 Oral]☆29Sep 15, 2022Updated 4 years ago
- A general suffix automaton implementation in Rust with Python bindings☆10Jul 21, 2026Updated 3 months ago
- ☆21Jun 6, 2024Updated 2 years ago
- ☆27Nov 29, 2024Updated last year
- Rethinking Data-Free Quantization as a Zero-Sum Game☆10Oct 27, 2024Updated 2 years ago
- ☆13Oct 18, 2026Updated last week
- SJTU CS2951 Computer Architecture Course Project, A Verilog HDL implemented RISC-V CPU.☆11Jan 15, 2022Updated 4 years ago
- A Compiler from "Mx* language" (A C++ & Java like language) to RV32I Assembly, with optimizations on LLVM IR. SJTU CS2966 Project.☆13Feb 12, 2023Updated 3 years ago
- Intel Gaudi's Megatron DeepSpeed Large Language Models for training☆17Dec 19, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Quantization in the Jagged Loss Landscape of Vision Transformers☆14Oct 22, 2023Updated 3 years ago
- Fighting!☆11Jul 21, 2017Updated 9 years ago
- Prompt format and padding guide for Llama 2☆12Sep 18, 2023Updated 3 years ago
- A flat container abstraction for Rust☆17Nov 24, 2025Updated 11 months ago
- [ISCA'25] LIA: A Single-GPU LLM Inference Acceleration with Cooperative AMX-Enabled CPU-GPU Computation and CXL Offloading☆12Jun 28, 2025Updated last year
- C++17 implementation of einops for libtorch - clear and reliable tensor manipulations with einstein-like notation☆12Oct 16, 2023Updated 3 years ago
- Code for EMNLP24-findings. “SRAP-Agent: Simulating and Optimizing Scarce Resource Allocation Policy with LLM-based Agent”☆11May 24, 2024Updated 2 years ago
- ☆15May 8, 2025Updated last year
- [HPCA'24] Smart-Infinity: Fast Large Language Model Training using Near-Storage Processing on a Real System☆53Jul 21, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A similarity measurer on two programming assignments on Online Judge.☆10Jan 6, 2023Updated 3 years ago
- Low level access to RISCV processors☆21Oct 3, 2022Updated 4 years ago
- PolyBench/Python is the reimplementation of PolyBench in the Python programming language. It is a benchmark suite of 30 numerical computa…☆10Feb 23, 2021Updated 5 years ago
- A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative…☆12Oct 13, 2026Updated 2 weeks ago
- ☆41Aug 16, 2026Updated 2 months ago
- Fugusashi — Federated Learning of LLM Routing with Human-Interpretable Decisions. Open-source alternative to Sakana AI Fugu.☆23Aug 6, 2026Updated 2 months ago
- This is the implementation repository of our OSDI '26 paper: Disentangling Graph Dependencies for Efficient Billion-Scale GPU Vector Sear…☆15Jul 11, 2026Updated 3 months ago
- Yx: a language only for demo use☆17Sep 24, 2021Updated 5 years ago
- This is a clone of an SVN repository at http://pagecache-mangagement.googlecode.com/svn/trunk. It had been cloned by http://svn2github.co…☆10May 23, 2013Updated 13 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- 🔎 Search for CVEs against a local cached copy of NIST National Vulnerability Database (NVD)☆10Jun 13, 2026Updated 4 months ago
- We taught Claude how to drive Fusion 360. Sketches, extrusions, assemblies, exports—all through natural language. The hard part wasn't th…☆13Dec 17, 2025Updated 10 months ago
- ☆14Jan 12, 2022Updated 4 years ago
- Breakable CUDA graph capture for PyTorch - capture compatible regions as CUDA graphs while running incompatible operations eagerly betwee…☆29Oct 8, 2026Updated 3 weeks ago
- RPCNIC: A High-Performance and Reconfigurable PCIe-attached RPC Accelerator [HPCA2025]☆16Dec 9, 2024Updated last year
- JAX backend for SGL☆367Oct 22, 2026Updated last week
- Fermion Research fork of llama.cpp: FV5/FV5B five-value ternary types for Neutrino GGUF packs (CPU + CUDA)☆14Sep 29, 2026Updated last month