☆56Oct 16, 2026Updated 3 weeks ago
Alternatives and similar repositories for vllm_notes
Users that are interested in vllm_notes are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆17Apr 23, 2026Updated 6 months ago
- CUDA 13.1 Tutorial Series for RTX 5090 (Blackwell) - Chinese teaching materials☆33Jan 18, 2026Updated 9 months ago
- CodeWiz 是一个端到端的 AI 应用开发平台，用户通过自然语言描述需求，系统自动生成完整可运行的项目代码☆14Jun 10, 2026Updated 5 months ago
- Description: Experimental nano-vLLM fork for Qwen3.6 support, CUDA Graph, paged KV cache, and inference-engine learning.☆20Oct 15, 2026Updated 3 weeks ago
- 开箱即用的轻量级推理引擎，全面超越nano-vllm；支持Qwen3系列模型 ；流式调用与openai兼容接口/ A lightweight LLM inference engine built from scratch☆19Sep 10, 2026Updated 2 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆18Nov 2, 2026Updated last week
- Lightning-fast LLM inference engine - Built with Rust (inspiration from https://github.com/GeeeekExplorer/nano-vllm)☆38Jun 24, 2025Updated last year
- ACPO: Python ML training/inference framework for LLVM optimizations☆15Jul 2, 2025Updated last year
- ☆67Nov 21, 2024Updated last year
- ☆14Jun 30, 2019Updated 7 years ago
- A curated collection of Claude Code agent skills that accelerate the entire vLLM development lifecycle.☆32Updated this week
- A scalable serving system for building and running modular diffusion workflows across GPU clusters.☆12Sep 23, 2026Updated last month
- Multi-agent deep research system with autonomous web/academic search, quality-gated retrieval, and structured report generation.☆26Oct 13, 2026Updated 3 weeks ago
- ☆10Apr 21, 2022Updated 4 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Lock-free ARENA allocator and a set of lock-free data structures based on the ARENA allocator.☆17Mar 14, 2026Updated 7 months ago
- Market-guided Transformer research framework for A-share cross-sectional return forecasting with intraday price-volume features.☆16Sep 10, 2026Updated 2 months ago
- ☆18Mar 29, 2026Updated 7 months ago
- N.E.O.N. Architecture — Open source GPU RTL in Verilog. Token dataflow, hardware ray tracing, frame generation. First silicon target: 28n…☆24Jun 14, 2026Updated 4 months ago
- 北京大学未名超算队与北京大学学生 Linux 俱乐部合办的暑期 AI Infra 系列活动仓库☆256Aug 22, 2026Updated 2 months ago
- ☆48Nov 1, 2025Updated last year
- A novel temporal fusion framework for propelling autoregressive model inference☆11Updated this week
- ☆13Mar 19, 2026Updated 7 months ago
- 训练营讲义☆21Jan 21, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- QChatGPT的插件,用于将QQ机器人与Poe上的机器人连接☆13Aug 31, 2023Updated 3 years ago
- commit rtl and build cosim env☆16Feb 15, 2024Updated 2 years ago
- ⚡ Official code for “ReaDy: Recurrent States as Dynamic Context for Speculative Drafting in Hybrid Linear Attention Large Language Models…☆17Oct 15, 2026Updated 3 weeks ago
- Study CUDA☆14Apr 18, 2025Updated last year
- ☆14May 11, 2026Updated 6 months ago
- ☆17Mar 24, 2026Updated 7 months ago
- Filter RSS Feed with GPT-4☆16May 22, 2023Updated 3 years ago
- ☆17Jan 31, 2026Updated 9 months ago
- ☆10Oct 29, 2026Updated last week
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Analyze LLM inference: FLOPs, memory, Roofline model. Supports GQA, MoE, MLA, RoPE, SwiGLU. 19 models × 20+ hardware platforms.☆23Nov 4, 2026Updated last week
- High-performance GEMM implementation optimized for NVIDIA H100 GPUs, leveraging Hopper architecture's TMA, WGMMA, and Thread Block Cluste…☆11Aug 25, 2026Updated 2 months ago
- AI Infra / 机器学习系统面经（305 题）☆50May 5, 2026Updated 6 months ago
- Patterns for parallel programming☆10Mar 12, 2019Updated 7 years ago
- SGEMM and DGEMM subroutines using AVX512F instructions.☆15May 22, 2022Updated 4 years ago
- A Valgrind extension for CUDA, unofficial mirror for https://www.hlrs.de/organization/av/spmt/research/cudagrind/☆10Aug 5, 2015Updated 11 years ago
- Official codes for "Understanding Deep Gradient Leakage via Inversion Influence Functions", NeurIPS 2023☆16Oct 13, 2023Updated 3 years ago
Are these results useful?