☆15Mar 11, 2026Updated 4 months ago
Alternatives and similar repositories for nano-vllm
Users that are interested in nano-vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Coding-Insight is another KFASC project which recieved the Chairman's Award. It did not recieve the respect it got from the judges becaus…☆16Aug 18, 2024Updated last year
- Curated collection of AI inference engineering resources — LLM serving, GPU kernels, quantization, distributed inference, and production …☆245Feb 4, 2026Updated 5 months ago
- ☆12Dec 13, 2022Updated 3 years ago
- original 8bit CPU of ICF3-Z☆12Feb 20, 2020Updated 6 years ago
- The smallest 6502 / NES CPU simulator in JS (944b gzipped)☆15Mar 1, 2022Updated 4 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Made a CPU in Logisim when I was 14 (2009), and wrote a naive assembler and compiler for it in Flash. The CPU's design is inspired by Don…☆10Sep 30, 2016Updated 9 years ago
- A GPT-2 inference engine written from scratch in CUDA and C++. Implements custom CUDA kernels for tiled matrix multiplication, LayerNorm,…☆42May 17, 2026Updated 2 months ago
- My various presentations to conferences, user groups and so on.☆13Sep 12, 2021Updated 4 years ago
- ☆13Apr 4, 2019Updated 7 years ago
- ☆19Jul 24, 2025Updated 11 months ago
- ☆20Apr 18, 2024Updated 2 years ago
- Demo of running NNs across different frameworks☆18Aug 30, 2017Updated 8 years ago
- The training framework of PCMind-2.1-Kaiyuan-2B built on MindFormers☆15Dec 9, 2025Updated 7 months ago
- Tool for building packages targeting Pyodide☆16Updated this week
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- A lightweight, configurable, and real-time simulator designed to mimic the behavior of vLLM without the need for GPUs or running actual h…☆167Updated this week
- Our Clone of Orca used for experimentation☆19Oct 15, 2024Updated last year
- Easy, Fast, and Scalable Multimodal AI☆128Jun 2, 2026Updated last month
- ☆16Dec 15, 2025Updated 7 months ago
- ☆28Oct 28, 2021Updated 4 years ago
- ☆16May 11, 2025Updated last year
- Artifact for StarCDN's simulation framework☆17Apr 14, 2026Updated 3 months ago
- Python bindings for NVIDIA CUDA APIs.☆14Mar 2, 2024Updated 2 years ago
- Go bindings for LLama.cpp☆14Apr 11, 2023Updated 3 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- High-performance GPU kernels for LLM inference in OpenAI Triton. Fused RMSNorm, SwiGLU, INT8 GEMM with benchmarks and roofline analysis.☆31Apr 5, 2026Updated 3 months ago
- A Verilog HDL model of the MOS 6502 CPU☆24Dec 14, 2025Updated 7 months ago
- Analyze LLM inference: FLOPs, memory, Roofline model. Supports GQA, MoE, MLA, RoPE, SwiGLU. 19 models × 20+ hardware platforms.☆21Apr 16, 2026Updated 3 months ago
- 根据最近看的一本书编写的对应RTL以及Testbench☆20Mar 12, 2017Updated 9 years ago
- DiffSinger: Singing Voice Synthesis via Shallow Diffusion Mechanism (SVS & TTS); AAAI 2022; Official code☆10Mar 8, 2022Updated 4 years ago
- GPU Functional Descriptor for memory access☆34May 24, 2026Updated last month
- ☆19Apr 15, 2025Updated last year
- ☆25Updated this week
- TypeLeap☆12Mar 8, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Converts obsidian markdown syntax to other platforms.☆29Mar 26, 2026Updated 3 months ago
- PyTorch implementation of Retriever: Learning Content-Style Representation☆12Jan 27, 2023Updated 3 years ago
- 광운대학교 KLAS 앱 개선 프로젝트☆22Updated this week
- This repo contains the baseline model recipes and pre-trained model for GramVanni hindi ASR challenge☆16Mar 26, 2022Updated 4 years ago
- GPT for FACodec☆13Mar 25, 2024Updated 2 years ago
- bumble bee transformer☆14Apr 19, 2021Updated 5 years ago
- Deep Multi-Speech model☆11Jul 25, 2018Updated 7 years ago