Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.
☆373Jul 3, 2026Updated this week
Alternatives and similar repositories for smg
Users that are interested in smg are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Incubating P/D sidecar for llm-d☆17Nov 13, 2025Updated 7 months ago
- Efficient, Flexible, and Highly Fault-Tolerant Model Service Management Based on SGLang☆62Nov 8, 2024Updated last year
- A PyTorch native library for training speculative decoding models☆187Updated this week
- A storage plugin that provided CRI-O/Podman with the ability to lazy mount nydus images.☆43May 12, 2025Updated last year
- The living Trust and Safety User Guide for the AI Alliance (https://thealliance.ai)☆16Jun 12, 2026Updated 3 weeks ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A Distributed Engine for AI☆49Jun 22, 2026Updated 2 weeks ago
- A userspace filesystem backing by Apache OpenDAL.☆38Jun 2, 2026Updated last month
- Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, T…☆478Updated this week
- An LLM Mock Server that supports simulating the protocols of all LLM providers.☆15Updated this week
- A high-performance and light-weight router for vLLM large scale deployment☆290Updated this week
- See vLLM official support: https://github.com/vllm-project/vllm-ascend☆11Feb 5, 2025Updated last year
- upstream development the newest feature about HV.☆10Sep 12, 2021Updated 4 years ago
- (best/better) practices of megatron on veRL and tuning guide☆136May 12, 2026Updated last month
- ☆12Jun 21, 2022Updated 4 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- vLLM adapter for a TGIS-compatible gRPC server.☆55Updated this week
- Mini-pytorch implemented from scratch using Python☆15Jan 19, 2022Updated 4 years ago
- A go sdk for coding Higress wasm plugins.☆33May 14, 2026Updated last month
- ☆13Dec 20, 2016Updated 9 years ago
- ☆45Aug 21, 2025Updated 10 months ago
- Collection of docker images, helm charts and other tools needed to build DataLake on Kubernetes.☆13Oct 19, 2018Updated 7 years ago
- /j f t/ - YAML file tool☆14Updated this week
- KV cache store for distributed LLM inference☆424Nov 13, 2025Updated 7 months ago
- Hadoop Cluster with security☆13Nov 21, 2021Updated 4 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- alibabacloud-aiacc-demo☆43May 4, 2023Updated 3 years ago
- Expert Specialization MoE Solution based on CUTLASS☆27Apr 14, 2026Updated 2 months ago
- [ACL 2021] IrEne: Interpretable Energy Prediction for Transformers☆11Sep 8, 2021Updated 4 years ago
- An OS kernel module for fast **remote** fork using advanced datacenter networking (RDMA).☆72Feb 15, 2025Updated last year
- A similarity measurer on two programming assignments on Online Judge.☆10Jan 6, 2023Updated 3 years ago
- IBM Z Deep Neural Network Library (zDNN) provides an interface for applications making use of Neural Network Processing Assist Facility (…☆20Sep 17, 2025Updated 9 months ago
- GPU analyzer for Kubernetes GPU clusters☆16Apr 11, 2020Updated 6 years ago
- A Triton JIT runtime and ffi provider in C++☆37Jun 30, 2026Updated last week
- ☆17Sep 18, 2024Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Resource Exporter for volcano scheduling, e.g. NUMA-Aware scheduling.☆19Updated this week
- 中国传媒大学论文模板Latex☆11Nov 9, 2021Updated 4 years ago
- Virtual Reality Maze Game Using Unity and GVR.☆17Mar 22, 2017Updated 9 years ago
- DCL-Net: Deep Correspondence Learning Network for 6D Pose Estimation☆21Sep 29, 2022Updated 3 years ago
- InfiniBand fabric monitoring daemon written in Go☆32May 22, 2025Updated last year
- From Minimal GEMM to Everything☆221Jun 8, 2026Updated last month
- SGLang is a fast serving framework for large language models and vision language models.☆29Updated this week