vLLM with support for span semantics
☆27Feb 27, 2026Updated 6 months ago
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 🚀 Guardrails orchestration server for application of various detections on text generation input and output.☆35Updated this week
- Small, simple agent task environments for training and evaluation☆20Nov 1, 2024Updated last year
- FMS Model Optimizer is a framework for developing reduced precision neural network models.☆21Updated this week
- Repository for tw.org site☆14Updated this week
- 🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.☆59Sep 3, 2026Updated 3 weeks ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 🚀 Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.☆14Sep 8, 2026Updated 2 weeks ago
- ☆19Jan 19, 2026Updated 8 months ago
- Jason Meridth's blog☆14Sep 3, 2026Updated 2 weeks ago
- Community maintained hardware plugin for vLLM on Spyre☆53Sep 9, 2026Updated 2 weeks ago
- Evals meant to evaluate language models' ability to reason over long contexts.☆10Sep 12, 2024Updated 2 years ago
- ☆27Sep 9, 2024Updated 2 years ago
- s390/s390x ABI specification☆20May 7, 2026Updated 4 months ago
- This is the ultimate web scraping tool for extracting the most relevant data points from products on Walmart.com! this powerful scraper i…☆22Mar 6, 2023Updated 3 years ago
- Code for Columbia University COMS 3997 – LLM Ethics and Foundations☆16Jan 7, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆18Sep 14, 2026Updated last week
- Cloyster HPC is a turnkey HPC cluster solution with an user-friendly installer☆10Apr 16, 2026Updated 5 months ago
- IBM Z Deep Neural Network Library (zDNN) provides an interface for applications making use of Neural Network Processing Assist Facility (…☆20Sep 17, 2025Updated last year
- ☆31Jan 18, 2025Updated last year
- A very basic game of chess☆11Feb 26, 2021Updated 5 years ago
- 🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…☆288Nov 24, 2025Updated 9 months ago
- automated insights for tabular data☆10Feb 10, 2025Updated last year
- Scrape South African news☆14May 22, 2023Updated 3 years ago
- A modern EdgeHTML-based WebView for Rust on Windows.☆13Jul 12, 2018Updated 8 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Keyword extraction using Scake, KeyBERT, Fine-tuning Transformer BERT-like models and ChatGPT.☆12May 22, 2023Updated 3 years ago
- Cloud Resource and Infrastructure-as-Code Generator (or CRAIG) allows users to generate Terraform to create a fully customizable environm…☆22Sep 15, 2026Updated last week
- A Rust crate offering similar functionality to the Python transformers package using Candle.☆15Nov 19, 2024Updated last year
- Codebase, data and models for the Headline Grouping paper at NAACL2021☆12Oct 2, 2022Updated 3 years ago
- 3D Mesh Generation from 2D Images in Python☆13Feb 12, 2024Updated 2 years ago
- Synthetic Data Generation for Foundation Models☆21Nov 10, 2025Updated 10 months ago
- Deep Diff Pizza is a simple, 0 dependency utility function that takes in 2 JSON Objects and returns the differences in an easy-to-use for…☆11Aug 8, 2022Updated 4 years ago
- Provides pipeAsync and traversePromises functions that play well with the rest of Ramda ecosystem.☆12Jan 30, 2024Updated 2 years ago
- Open source RAG with Llama Index for Japanese LLM in low resource settting☆10May 12, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- InstaSlice facilitates the use of Dynamic Resource Allocation (DRA) on Kubernetes clusters for GPU sharing☆30Nov 27, 2024Updated last year
- Inference Platform Simulation☆36Updated this week
- Quora Paraphrasing Dataset Bahasa Indonesia Version☆11Apr 18, 2021Updated 5 years ago
- cuda-mode for Emacs.☆27Aug 19, 2024Updated 2 years ago
- An offline CPU-first low-resource chat application to perform RAG on your corpus of data. Powered by OpenChat and CTranslate2.☆15Updated this week
- A TypeScript/JavaScript implementation of the RDF/JS data factory.☆13Jul 15, 2026Updated 2 months ago
- This repo contains the code for the tutorial for using the CrewAI agent framework to generate Sales Reports based on Salesforce data☆13Mar 16, 2024Updated 2 years ago