Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across SGLang, vLLM, TRT-LLM, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.
☆146Apr 9, 2026Updated last week
Alternatives and similar repositories for smg
Users that are interested in smg are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Incubating P/D sidecar for llm-d☆16Nov 13, 2025Updated 5 months ago
- This CLI tool and Python3 module collects the current system state for documentation☆24Apr 9, 2026Updated last week
- ☆17Mar 31, 2024Updated 2 years ago
- A high-performance and light-weight router for vLLM large scale deployment☆188Updated this week
- Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serv…☆291Apr 2, 2026Updated 2 weeks ago
- Wordpress hosting with auto-scaling - Free Trial • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Kubernetes CSI Driver for serving OCI model artifacts☆25Mar 23, 2026Updated 3 weeks ago
- An LLM Mock Server that supports simulating the protocols of all LLM providers.☆12Oct 18, 2025Updated 5 months ago
- https://bbuf.github.io/gpu-glossary-zh/☆26Nov 7, 2025Updated 5 months ago
- Cookbook of SGLang - Recipe☆119Updated this week
- A JupyterLab extension for displaying dashboards of GPU usage.☆13Aug 24, 2023Updated 2 years ago
- HeraclesQL is a Python DSL for writing alerts!☆26Dec 3, 2025Updated 4 months ago
- /j f t/ - YAML file tool☆13Feb 9, 2026Updated 2 months ago
- The beginnings of a fast, modern, multithreaded, dynamically typed langauge☆18Updated this week
- A similarity measurer on two programming assignments on Online Judge.☆10Jan 6, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A storage plugin that provided CRI-O/Podman with the ability to lazy mount nydus images.☆43May 12, 2025Updated 11 months ago
- Evaluating LLMs performance in PR reviews as an indicator for their capability in creating PRs.☆13Apr 10, 2024Updated 2 years ago
- Official PyTorch implementation of "Evolving Search Space for Neural Architecture Search"☆12Aug 18, 2021Updated 4 years ago
- A Triton JIT runtime and ffi provider in C++☆32Updated this week
- Resource Exporter for volcano scheduling, e.g. NUMA-Aware scheduling.☆19May 30, 2025Updated 10 months ago
- A tool for creating a VM root filesystem image from a reproducible TOML build script easily.☆33Mar 19, 2025Updated last year
- Like curl, or wget, but downloads directly go to a SQLite databse☆26Oct 1, 2020Updated 5 years ago
- ☆13Dec 20, 2024Updated last year
- SGLang is a fast serving framework for large language models and vision language models.☆21Updated this week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- DCL-Net: Deep Correspondence Learning Network for 6D Pose Estimation☆21Sep 29, 2022Updated 3 years ago
- Code for the paper Polarimetric Pose Prediction☆18Jul 18, 2022Updated 3 years ago
- a simple traceroute tool for iOS☆14Oct 25, 2017Updated 8 years ago
- A Distributed, Fault-Tolerant Message Queue from Scratch. Inspired by Apache Kafka☆86Oct 23, 2025Updated 5 months ago
- Grotsky Programming Language☆20Dec 1, 2025Updated 4 months ago
- 能够远程办公（work from home）的公司名单☆16Mar 2, 2022Updated 4 years ago
- Packer templates to install Windows 10 Evaluation using the qemu/kvm builder.☆12Sep 2, 2021Updated 4 years ago
- SCU Virtual Judge☆11Feb 16, 2023Updated 3 years ago
- 优雅的实现状态机☆16Jan 26, 2019Updated 7 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Mender over-the-air software updater client for microcontrollers (MCUs).☆17Apr 8, 2026Updated last week
- Adapted iPerf3 iOS sample☆12Mar 15, 2017Updated 9 years ago
- Workflow Defined Engine☆25Nov 4, 2025Updated 5 months ago
- Installshield decompiler. It supports all versions of installshield up to v5.5 (as far as I know)☆11Jun 3, 2023Updated 2 years ago
- Code for AdaXpert (ICML'21)☆16Jul 19, 2021Updated 4 years ago
- Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, T…☆422Updated this week
- A stripped-down programming language for testing novel features☆19Jan 5, 2025Updated last year