SGLang is fast serving framework for large language models and vision language models.
☆37Nov 24, 2025Updated 8 months ago
Alternatives and similar repositories for worker-sglang
Users that are interested in worker-sglang are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The Runpod worker template for serving our large language model endpoints. Powered by vLLM.☆460Updated this week
- ☆13Feb 22, 2024Updated 2 years ago
- ☆13Feb 24, 2025Updated last year
- Create embeddings with infinity as serverless endpoint☆47Nov 21, 2025Updated 8 months ago
- Interface for interacting with Gradient AI in Python☆15Jun 28, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Daily.co + Pipecat + Tavus AI Avatar Agent☆16Apr 19, 2025Updated last year
- Ultra-low-latency, high-throughput multiprocess transport over SHM and mmap. LMAX-Disruptor-style cross-process ring substrate.☆17Updated this week
- This repository is designed for deploying and managing server processes that handle embeddings using the Infinity Embedding model or Larg…☆25Mar 6, 2025Updated last year
- The repository is designed to help you build intent classification for user queries, and also generate tags for AI chat responses.☆12Mar 29, 2024Updated 2 years ago
- Django API template for my projects☆14Mar 21, 2025Updated last year
- ☆18May 4, 2023Updated 3 years ago
- ☆38Feb 12, 2026Updated 5 months ago
- Hugging Face RoBERTa with Flash Attention 2☆24Sep 14, 2025Updated 10 months ago
- Retrieval-Augmented Generation with pgvector as vector database☆14Jan 23, 2024Updated 2 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Benchmarking the serving capabilities of vLLM☆59Aug 20, 2024Updated last year
- Declarative AI Pipelines☆22Oct 2, 2024Updated last year
- ☆23Apr 29, 2022Updated 4 years ago
- Clarify your words with emojis☆12Aug 25, 2016Updated 9 years ago
- 🔀 schedule functions on the main thread☆38Jun 7, 2026Updated last month
- Memory operating system for AI agents — persistent memory, BM25 search, atomic decomposition, reflection engine, immune system. Zero API …☆39Updated this week
- VS Code inspired text editor that mostly runs in a webworker☆11Updated this week
- ☆10Aug 17, 2014Updated 11 years ago
- Make tool-calling schemas for existing tools☆14Mar 8, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Universal connector to LLMs for Node.js & Bun☆30Updated this week
- A library that offers functionality to use Decawave's DW1000 chips/modules with Arduino.☆14Jan 18, 2022Updated 4 years ago
- Problem statements and code from Google Foobar☆10Nov 10, 2020Updated 5 years ago
- Modified Arena-Hard-Auto LLM evaluation toolkit with an emphasis on Russian language☆47Mar 20, 2025Updated last year
- THINK LESS, SCREAM MORE!☆11Feb 17, 2016Updated 10 years ago
- Materials for learning SGLang☆861Jan 5, 2026Updated 6 months ago
- Simple and lightweight compressor/decompressor for microcontrollers.☆16Nov 4, 2024Updated last year
- ☆11May 31, 2019Updated 7 years ago
- Render React components to DMX light systems.☆18Mar 24, 2018Updated 8 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Source code obfuscator for Golang☆33Oct 5, 2024Updated last year
- A Collection of Problems from Cracking the Coding Interview☆10Mar 27, 2018Updated 8 years ago
- Ask Poddy: Run Open Source LLMs and Embeddings as OpenAI-Compatible Serverless Endpoints (Tutorial)☆11Jul 19, 2024Updated 2 years ago
- always amend and --force push☆12Nov 28, 2017Updated 8 years ago
- Wi-Fi and BT drivers packaged for integration into 3rd party repositories. Work in progress.☆24Mar 31, 2026Updated 3 months ago
- A collection of examples demonstrating how to use dstack☆26Jun 11, 2024Updated 2 years ago
- HTM Learning Algorithm Implementation for learning and generating musical sequences☆10Apr 14, 2015Updated 11 years ago