SGLang is fast serving framework for large language models and vision language models.
☆37Aug 21, 2026Updated last month
Alternatives and similar repositories for worker-sglang
Users that are interested in worker-sglang are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ⚡️ Transform AI/ML operations: Transparency, Control and Cost Optimization. ⚡️☆23Oct 8, 2023Updated 2 years ago
- ☆15Dec 21, 2025Updated 9 months ago
- Interface for interacting with Gradient AI in Python☆15Jun 28, 2024Updated 2 years ago
- WIP: Ofen is a toolkit aimed at making transformer models production-ready. API included☆17Oct 2, 2024Updated last year
- Ultra-low-latency, high-throughput multiprocess transport over SHM and mmap. LMAX-Disruptor-style cross-process ring substrate.☆20Aug 6, 2026Updated last month
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- This repository is designed for deploying and managing server processes that handle embeddings using the Infinity Embedding model or Larg…☆25Mar 6, 2025Updated last year
- The repository is designed to help you build intent classification for user queries, and also generate tags for AI chat responses.☆12Mar 29, 2024Updated 2 years ago
- ☆40Feb 12, 2026Updated 7 months ago
- Hugging Face RoBERTa with Flash Attention 2☆23Sep 14, 2025Updated last year
- Retrieval-Augmented Generation with pgvector as vector database☆14Jan 23, 2024Updated 2 years ago
- Benchmarking the serving capabilities of vLLM☆59Aug 20, 2024Updated 2 years ago
- Python package for rematerialization-aware gradient checkpointing☆27Oct 31, 2023Updated 2 years ago
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆32Sep 19, 2025Updated last year
- ☆22Apr 29, 2022Updated 4 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- VS Code inspired text editor that mostly runs in a webworker☆12Updated this week
- Make tool-calling schemas for existing tools☆14Mar 8, 2025Updated last year
- Template for lead qualification voice AI assistant, based on the one used on my personal website☆15Apr 13, 2025Updated last year
- Create Python APIs with AI Agents.☆11Aug 16, 2024Updated 2 years ago
- A library that offers functionality to use Decawave's DW1000 chips/modules with Arduino.☆14Jan 18, 2022Updated 4 years ago
- Modified Arena-Hard-Auto LLM evaluation toolkit with an emphasis on Russian language☆47Mar 20, 2025Updated last year
- Materials for learning SGLang☆894Jan 5, 2026Updated 8 months ago
- Source code obfuscator for Golang☆33Oct 5, 2024Updated last year
- ☆18Mar 31, 2026Updated 5 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Gemini Bot is a Telegram chatbot powered by Vertex AI's generative models. This Python implementation utilizes the Telethon library to in…☆12Feb 17, 2024Updated 2 years ago
- Apache Arrow-compatible space-efficient "tape" class in pure Rust to be used with StringZilla for GPU, NUMA, and disk transfers of variab…☆33Jul 31, 2026Updated last month
- 235,886 Words for Go☆12Nov 16, 2018Updated 7 years ago
- Modular, YAML-configured Python pipeline for multi-scale fMRI functional brain network analysis. Validated on OpenNeuro ds007318 with Sch…☆15Aug 10, 2026Updated last month
- Golang program/library to stream H264 from a Raspberry Pi to a browser☆18Nov 23, 2025Updated 10 months ago
- Bootstrap + jQuery + Webpack Theme Boilerplate for October CMS☆15Nov 15, 2019Updated 6 years ago
- 🔐 go-krypto: A Go library collecting cryptographic algorithms designed in the Republic of Korea (SEED, ARIA, HIGHT, LEA, HAS160, LSH, KC…☆36Sep 2, 2026Updated 3 weeks ago
- Tiny status page generated by a Go script!☆58Sep 18, 2026Updated last week
- Mucking around with TinyGo and WebAssembly☆24Mar 23, 2020Updated 6 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Generate a schema and validate user input from types☆12Sep 1, 2026Updated 3 weeks ago
- Character Grounding and Re-Identification in Story of Videos and Text Descriptions☆10Jan 17, 2021Updated 5 years ago
- Python tool to support lazy imports.☆31Jun 9, 2025Updated last year
- Build an Invoice Generator with Next.js & PDF Download (jsPDF + shadcn UI)☆15Jul 23, 2025Updated last year
- Nanos klib for NVIDIA GPUs☆14Aug 29, 2026Updated 3 weeks ago
- ☆20Oct 5, 2025Updated 11 months ago
- A Dropbox filesystem adapter for just-bash.☆16Apr 7, 2026Updated 5 months ago