Nano vLLM Triton
☆14Aug 27, 2025Updated last year
Alternatives and similar repositories for nano-vllm-triton
Users that are interested in nano-vllm-triton are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Radix Tree KV Cache with Turn-Aware Growth☆12Jul 21, 2025Updated last year
- Nano vLLM☆15Jun 1, 2026Updated 5 months ago
- learning nano-vllm 0.11.2☆43Dec 28, 2025Updated 10 months ago
- ☆60Aug 3, 2026Updated 3 months ago
- ☆16Aug 26, 2026Updated 2 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- This repository, deepspeed-grpo-qlora-vllm, provides a complete framework for fine-tuning LLMs using Group Relative Policy Optimization (…☆13Jul 15, 2025Updated last year
- Synthetic GUI Pointing Data Generation☆15Apr 13, 2026Updated 6 months ago
- nano-vllm是开源的一个gpu推理项目，基于开源版本弄的一个ascend npu版本推理小demo，旨在帮助初学者了解推理的整体流程，区别于vllm，nano-vllm体量更小，麻雀虽小五脏俱全，更有助于初学者学习。☆95May 4, 2026Updated 6 months ago
- Pytorch最小实践☆17Jun 27, 2022Updated 4 years ago
- 实现 mHC: Manifold-Constrained Hyper-Connections☆17Jan 2, 2026Updated 10 months ago
- A pytorch implementation of Attention Is All You Need (Transformer) for image captioning.☆12Nov 15, 2021Updated 4 years ago
- ☆17Mar 24, 2026Updated 7 months ago
- simple grpo☆13May 28, 2025Updated last year
- Made a CPU in Logisim when I was 14 (2009), and wrote a naive assembler and compiler for it in Flash. The CPU's design is inspired by Don…☆10Sep 30, 2016Updated 10 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ML framework featuring compile time checks and accelerated by a JIT compiler.☆10Mar 19, 2026Updated 7 months ago
- ☆13Jun 3, 2020Updated 6 years ago
- Very small and high performance CPU☆13Dec 3, 2024Updated last year
- IntelliJ ExcelReader Plugin☆12Aug 8, 2024Updated 2 years ago
- fused MoE kernel in Candle backend☆14Feb 3, 2026Updated 9 months ago
- Nano vLLM☆27Aug 11, 2025Updated last year
- Minimal uart for small iCE40 Lattice FPGAs. 8N1. 32 or 34 logicCells☆10Jul 20, 2017Updated 9 years ago
- FlashFunAsr: A lightweight vLLM implementation built from scratch for FunASR nano☆12Jan 5, 2026Updated 10 months ago
- Code for paper "Spider: Any-to-Many Multimodal LLM"☆16Apr 26, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- a simple new ISA nnISA and nnSOC nnCPU nnAs nnCc☆10Mar 15, 2020Updated 6 years ago
- LightRFT (Light Reinforcement Fine-Tuning) is an advanced reinforcement learning fine-tuning framework designed for Large Language Models…☆19Jan 12, 2026Updated 10 months ago
- Running LLaMA 3 with Rust.☆10May 21, 2024Updated 2 years ago
- 更纯粹、更高压缩率的Tokenizer in Rust☆14Sep 7, 2026Updated 2 months ago
- vmarker (Auto Chapter Bar or `acb` in CLI) is an open-source Python tool that converts SRT subtitle files into transparent video chapter …☆19May 4, 2026Updated 6 months ago
- Nano vLLM with vLLM v1's request scheduling strategy and chunked prefill☆104Jan 26, 2026Updated 9 months ago
- DiffBatt: A Diffusion Model for Battery Degradation Prediction and Synthesis☆26Dec 7, 2024Updated last year
- Graph model execution API for Candle☆19Jul 27, 2025Updated last year
- ☆10Jul 21, 2026Updated 3 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ☆12Dec 30, 2024Updated last year
- AI Hedge Fund Repo integrate with DeepSeek V3 and R1 hosted on SiliconFlow.☆14Feb 3, 2025Updated last year
- Educational implementation of Kimi Delta Attention from 'Kimi Linear: An Expressive, Efficient Attention Architecture' (arXiv:2510.26692)☆17Updated this week
- 天池“公益AI之星”挑战赛-新冠疫情相似句对判定大赛☆16Apr 12, 2020Updated 6 years ago
- 🚀 轻量视频🎥 大模型🤖☆23Apr 27, 2025Updated last year
- Source Code for the Paper: "Channel Charting-Based Channel Prediction on Real-World Distributed Massive MIMO CSI"☆12Apr 9, 2026Updated 7 months ago
- 8-bit RISC Processor on Logisim☆14Oct 1, 2020Updated 6 years ago
Are these results useful?