vLLM with support for span semantics
☆27Feb 27, 2026Updated 8 months ago
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Evals meant to evaluate language models' ability to reason over long contexts.☆10Sep 12, 2024Updated 2 years ago
- Run AI coding agents in sandboxed CI environments☆14Updated this week
- [ICLR 2026] LookaheadKV: Fast and Accurate KV Cache Eviction by Glimpsing into the Future without Generation☆14Mar 16, 2026Updated 7 months ago
- 🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.☆59Oct 1, 2026Updated last month
- FMS Model Optimizer is a framework for developing reduced precision neural network models.☆21Oct 8, 2026Updated 3 weeks ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Framework-agnostic OCI-based registry for AI agent skills☆15Aug 31, 2026Updated 2 months ago
- Position-independent caching for hybrid-attention LLM serving.☆20Jul 27, 2026Updated 3 months ago
- Scarfbench: Self-Contained Application Refactoring Benchmark☆36Oct 19, 2026Updated 2 weeks ago
- Code for Columbia University COMS 3997 – LLM Ethics and Foundations☆16Jan 7, 2025Updated last year
- ☆31Jan 18, 2025Updated last year
- Makes it easy to use altair from FastHTML☆28Oct 9, 2024Updated 2 years ago
- 🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…☆289Nov 24, 2025Updated 11 months ago
- Server-side and client-side content management system to create, edit, and remove pages dynamically☆11Dec 7, 2014Updated 11 years ago
- FlashPrefill V2: Block-Sparse Prefill Attention for Long-Context LLM Serving☆32Aug 28, 2026Updated 2 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- An open-source toolkit for BigMac-style pipeline-parallel training of multimodal large language models.☆37Jul 21, 2026Updated 3 months ago
- Deep Diff Pizza is a simple, 0 dependency utility function that takes in 2 JSON Objects and returns the differences in an easy-to-use for…☆11Aug 8, 2022Updated 4 years ago
- Auto Model Factorization☆12Sep 14, 2021Updated 5 years ago
- Robust people recognition with the combination of face recognition, people detection and kalman filter☆10Dec 14, 2019Updated 6 years ago
- Reading comprehension based question-answering model for news articles.☆11Jun 22, 2022Updated 4 years ago
- Using Siamese LSTM to classify repeated quora questions. Attempted pretrained bert embeddings, Word2Vec and training own embeddings toget…☆10Aug 28, 2020Updated 6 years ago
- Triton backend for https://github.com/OpenNMT/CTranslate2☆11Aug 20, 2024Updated 2 years ago
- ☆40May 14, 2025Updated last year
- Open source RAG with Llama Index for Japanese LLM in low resource settting☆10May 12, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Newspaper Segmentation into images and text☆13Jan 11, 2019Updated 7 years ago
- Quora Paraphrasing Dataset Bahasa Indonesia Version☆11Apr 18, 2021Updated 5 years ago
- ☆12Apr 9, 2021Updated 5 years ago
- learning management system written in python/django☆10Feb 9, 2026Updated 8 months ago
- Převod formátu ABO/GPC do formátu CSV☆10Oct 29, 2024Updated 2 years ago
- detecting the meotions using by analysing the sound of the person unsing python☆11Oct 7, 2019Updated 7 years ago
- Create a localization file from a Google Spreadsheet☆11Oct 31, 2025Updated last year
- NewsLLM is a RAG-based LLM application designed to analyze and summarize news articles☆13Dec 10, 2024Updated last year
- Targeted Aspect-based Sentiment Analysis on SentiHood Dataset (PyTorch)☆11Aug 4, 2020Updated 6 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- OpenTelemetry traces & metrics extension for pi coding agent☆15Apr 13, 2026Updated 6 months ago
- PrintCSS Examples created over the time. Mostly HTML some Markdown.☆15Apr 15, 2022Updated 4 years ago
- Ecommerce project - using React, FastAPI & MongoDB☆16Dec 23, 2022Updated 3 years ago
- ☆58Updated this week
- Pohoda XML implementation in Python☆10Mar 16, 2024Updated 2 years ago
- How Media Cloud approaches extracting metadata from online news stories☆18Oct 22, 2026Updated last week
- ☆15Nov 28, 2023Updated 2 years ago