a fun and educational take on vLLM
☆232Jan 25, 2026Updated 9 months ago
Alternatives and similar repositories for nano-vllm
Users that are interested in nano-vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Course on Flash-attention in Triton☆103Feb 9, 2026Updated 8 months ago
- Plug-and-play PyTorch transformer research framework. Swap attention, FFN, norm, positional, connection, projection, optimizer, scheduler…☆18Oct 25, 2026Updated last week
- A small, readable PyTorch inference engine for Qwen3-4B with continuous batching, native paged attention, prefix caching, and an OpenAI-c…☆18Oct 24, 2026Updated 2 weeks ago
- minimal pytorch 4D parallelism☆74Feb 16, 2026Updated 8 months ago
- Based on Nano-vLLM, a simple replication of vLLM with self-contained paged attention and flash attention implementation☆1,101Aug 29, 2026Updated 2 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- All-in-one benchmarking platform for evaluating LLM.☆16Nov 12, 2025Updated 11 months ago
- Implementation of "YaPO: Learnable Sparse Activation Steering Vectors for Domain Adaptation"☆12Sep 30, 2026Updated last month
- everything you need to know about inference engineering☆44Sep 29, 2026Updated last month
- ☆25Jan 28, 2026Updated 9 months ago
- My hands-on learning experience with transformers (GPTs)☆10Apr 27, 2024Updated 2 years ago
- A framework to meta-train transformers for causal ICL☆11Jul 15, 2026Updated 3 months ago
- A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.☆5,523May 17, 2026Updated 5 months ago
- Official code for the paper Scale leads to compositional generalization.☆13Jul 11, 2025Updated last year
- Experiments on Multi-Head Latent Attention☆102Aug 19, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Nano vLLM☆16,325Apr 26, 2026Updated 6 months ago
- Scripts for training Qwen 2.5 VL with ms-swift and GRPO☆13Feb 27, 2025Updated last year
- Structured Generation Evals☆14Sep 25, 2024Updated 2 years ago
- Open source framework for evaluating AI Agents☆32Feb 24, 2026Updated 8 months ago
- Learning notes for understanding modern Machine Learning System.☆66Oct 30, 2026Updated last week
- ☆20Sep 11, 2026Updated last month
- A PyTorch implementation of the GPT-OSS-20B architecture. All components are coded from scratch: RoPE with YaRN, RMSNorm, SwiGLU with cla…☆238Dec 2, 2025Updated 11 months ago
- ☆12Feb 5, 2026Updated 9 months ago
- Run perfetto with Docker and docker-compose (self signed certificates)☆12Feb 1, 2023Updated 3 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- learning nano-vllm 0.11.2☆43Dec 28, 2025Updated 10 months ago
- Benchmarking the serving capabilities of vLLM☆58Aug 20, 2024Updated 2 years ago
- Official code for PLoP☆20Aug 31, 2026Updated 2 months ago
- My Gen AI research☆11Jun 3, 2024Updated 2 years ago
- The Newton-Muon optimizer☆35Jun 5, 2026Updated 5 months ago
- minimal C implementation of speculative decoding based on llama2.c☆30Jul 15, 2024Updated 2 years ago
- ☆15Mar 11, 2026Updated 7 months ago
- Terminus is an AI coding agent that works directly inside your terminal and understands your codebase. It investigates bugs, builds fea…☆16Sep 16, 2026Updated last month
- A curated resource list for learning AI performance engineering, from GPU fundamentals to production inference.☆4,336Oct 17, 2026Updated 2 weeks ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- CursorWeb: Implement popular features of Cursor in the browser.☆13Oct 10, 2024Updated 2 years ago
- ☆11Jan 27, 2025Updated last year
- ☆19Mar 29, 2026Updated 7 months ago
- Notes on Direct Preference Optimization☆29Apr 14, 2024Updated 2 years ago
- 赛博苏神：你的 research 好老师☆15Jun 16, 2026Updated 4 months ago
- Dataset accompanying "PARIKSHA: A Large-Scale Investigation of Human-LLM Evaluator Agreement on Multilingual and Multi-Cultural Data" (pu…☆14Dec 4, 2024Updated last year
- LangGraph Multi-Agent Handoffs, Clearly Explained☆13Dec 12, 2025Updated 10 months ago