SGLang is fast serving framework for large language models and vision language models.
☆33Nov 24, 2025Updated 4 months ago
Alternatives and similar repositories for worker-sglang
Users that are interested in worker-sglang are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆12Feb 22, 2024Updated 2 years ago
- Create embeddings with infinity as serverless endpoint☆42Nov 21, 2025Updated 4 months ago
- ☆14Dec 21, 2025Updated 3 months ago
- ☆97Mar 26, 2025Updated 11 months ago
- Apache Arrow-compatible space-efficient "tape" class in pure Rust to be used with StringZilla for GPU, NUMA, and disk transfers of variab…☆29Nov 21, 2025Updated 4 months ago
- Unofficial GitLab Android client. Support self hosted GitLab and Push notifications☆10May 18, 2016Updated 9 years ago
- Interface for interacting with Gradient AI in Python☆15Jun 28, 2024Updated last year
- A server code for serving BERT-based models for text classification. It is designed by SerpApi for heavy-load prototyping and production …☆15Apr 17, 2024Updated last year
- Multi-Agent Reinforcement Learning Environment for the card game SkyJo, compatible with PettingZoo and RLLIB☆16Feb 21, 2026Updated last month
- Normalize Text in Russian☆28Nov 7, 2023Updated 2 years ago
- ☆35Mar 5, 2026Updated 2 weeks ago
- Benchmarking the serving capabilities of vLLM☆59Aug 20, 2024Updated last year
- Clarify your words with emojis☆12Aug 25, 2016Updated 9 years ago
- Golang SDK for Truss☆40Feb 26, 2026Updated 3 weeks ago
- Hugging Face RoBERTa with Flash Attention 2☆24Sep 14, 2025Updated 6 months ago
- The repository is designed to help you build intent classification for user queries, and also generate tags for AI chat responses.☆12Mar 29, 2024Updated last year
- Self-host LLMs with LMDeploy and BentoML☆22Dec 26, 2025Updated 2 months ago
- Retrieval-Augmented Generation with pgvector as vector database☆13Jan 23, 2024Updated 2 years ago
- Official Telnyx skills for AI coding agents☆153Updated this week
- ☆13Jul 28, 2024Updated last year
- Building a Deep Learning Powered Emoji Slackbot!☆16Jul 23, 2020Updated 5 years ago
- Datamallet is a python library which contains several helper functions and module for the common tasks in a typical data science workflow…☆11May 19, 2022Updated 3 years ago
- 🦾💻🌐 distributed training & serverless inference at scale on RunPod☆19May 26, 2024Updated last year
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆32Sep 19, 2025Updated 6 months ago
- Open Source multi-modal LLM environment. Host your own web and mobile chat interface, powered by real-time bots and voice AI functionalit…☆52Oct 14, 2025Updated 5 months ago
- Moondream MCP Server in Python☆44Jul 2, 2025Updated 8 months ago
- Resources for the Web MIDI API: Books, articles, software, demos etc...☆11Sep 14, 2017Updated 8 years ago
- VS Code inspired text editor that mostly runs in a webworker☆11Updated this week
- 🔀 schedule functions on the main thread☆37Mar 10, 2022Updated 4 years ago
- LlamaNet: Decentralized Inference Swarm for llama.cpp☆23Jan 18, 2026Updated 2 months ago
- One Repo To Quickly Build One Docker File for HuggingChat Front and BackEnd☆26Jul 5, 2023Updated 2 years ago
- Machinery data, made easy. Easily download and prepare common industrial datasets.☆23Feb 13, 2024Updated 2 years ago
- Ask Poddy: Run Open Source LLMs and Embeddings as OpenAI-Compatible Serverless Endpoints (Tutorial)☆11Jul 19, 2024Updated last year
- Dashboard to monitor the performance of your Freqtrade instances☆13Apr 13, 2023Updated 2 years ago
- Open Pixel Control protocol☆15May 6, 2018Updated 7 years ago
- Step-by-step introduction to the Service Worker API☆14Mar 14, 2016Updated 10 years ago
- ☆13Jan 17, 2024Updated 2 years ago
- Modified Arena-Hard-Auto LLM evaluation toolkit with an emphasis on Russian language☆47Mar 20, 2025Updated last year
- ☆25Dec 5, 2025Updated 3 months ago