vLLM with support for span semantics
☆26Feb 27, 2026Updated 5 months ago
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 🚀 Guardrails orchestration server for application of various detections on text generation input and output.☆35Jul 6, 2026Updated last month
- Small, simple agent task environments for training and evaluation☆20Nov 1, 2024Updated last year
- FMS Model Optimizer is a framework for developing reduced precision neural network models.☆21Jun 24, 2026Updated last month
- Repository for tw.org site☆14Updated this week
- 🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.☆58Jul 21, 2026Updated 3 weeks ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- 🚀 Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.☆14Jan 30, 2026Updated 6 months ago
- ☆18Jan 19, 2026Updated 6 months ago
- Community maintained hardware plugin for vLLM on Spyre☆53Updated this week
- Evals meant to evaluate language models' ability to reason over long contexts.☆10Sep 12, 2024Updated last year
- ☆26Sep 9, 2024Updated last year
- s390/s390x ABI specification☆20May 7, 2026Updated 3 months ago
- Code for Columbia University COMS 3997 – LLM Ethics and Foundations☆16Jan 7, 2025Updated last year
- ☆18Updated this week
- Cloyster HPC is a turnkey HPC cluster solution with an user-friendly installer☆10Apr 16, 2026Updated 3 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- IBM Z Deep Neural Network Library (zDNN) provides an interface for applications making use of Neural Network Processing Assist Facility (…☆20Sep 17, 2025Updated 10 months ago
- Makes it easy to use altair from FastHTML☆28Oct 9, 2024Updated last year
- Server-side and client-side content management system to create, edit, and remove pages dynamically☆11Dec 7, 2014Updated 11 years ago
- automated insights for tabular data☆10Feb 10, 2025Updated last year
- Scrape South African news☆13May 22, 2023Updated 3 years ago
- Using Siamese LSTM to classify repeated quora questions. Attempted pretrained bert embeddings, Word2Vec and training own embeddings toget…☆10Aug 28, 2020Updated 5 years ago
- Reading comprehension based question-answering model for news articles.☆11Jun 22, 2022Updated 4 years ago
- Helps a candidate find the next job position.☆34May 7, 2021Updated 5 years ago
- Open Source AI Project Governance and Security Baseline (OSAIPGS Baseline)☆25Updated this week
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Inference Platform Simulation☆24Updated this week
- Triton backend for https://github.com/OpenNMT/CTranslate2☆11Aug 20, 2024Updated last year
- Deep Diff Pizza is a simple, 0 dependency utility function that takes in 2 JSON Objects and returns the differences in an easy-to-use for…☆11Aug 8, 2022Updated 4 years ago
- Provides pipeAsync and traversePromises functions that play well with the rest of Ramda ecosystem.☆12Jan 30, 2024Updated 2 years ago
- InstaSlice facilitates the use of Dynamic Resource Allocation (DRA) on Kubernetes clusters for GPU sharing☆30Nov 27, 2024Updated last year
- Open source RAG with Llama Index for Japanese LLM in low resource settting☆10May 12, 2025Updated last year
- Quora Paraphrasing Dataset Bahasa Indonesia Version☆11Apr 18, 2021Updated 5 years ago
- cuda-mode for Emacs.☆27Aug 19, 2024Updated last year
- ☆29Oct 16, 2025Updated 9 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Newspaper Segmentation into images and text☆12Jan 11, 2019Updated 7 years ago
- An offline CPU-first low-resource chat application to perform RAG on your corpus of data. Powered by OpenChat and CTranslate2.☆15May 14, 2025Updated last year
- Build SPARQL with string templates☆14Mar 10, 2025Updated last year
- PrintCSS Examples created over the time. Mostly HTML some Markdown.☆15Apr 15, 2022Updated 4 years ago
- secure your api endpoint by limiting access over period of time.☆10Oct 18, 2019Updated 6 years ago
- Genesis Build Script for Terra 2.0☆11Aug 29, 2023Updated 2 years ago
- Example using `Rollup` to bundle k6 tests and release a shared library.☆13May 27, 2026Updated 2 months ago