☆15Mar 11, 2026Updated 8 months ago
Alternatives and similar repositories for nano-vllm
Users that are interested in nano-vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Speed-of-Light SW efficiency by using ultra low-latency primitives for comms collectives☆13Apr 8, 2026Updated 7 months ago
- Deep neural architecture research framework☆12Mar 24, 2023Updated 3 years ago
- Lightning-fast LLM inference engine - Built with Rust (inspiration from https://github.com/GeeeekExplorer/nano-vllm)☆38Jun 24, 2025Updated last year
- eye-movement similarity analysis☆11Updated this week
- Enhancing Parameter-Efficient Fine-Tuning of Vision Transformers through Frequency-Based Adaptation☆10Jan 29, 2025Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- observability for speculative decoding☆15Aug 23, 2026Updated 2 months ago
- Interactive 3D model of NVIDIA Vera Rubin hardware (superchip, NVL72 compute tray, HGX NVL8) with connection tracing and a guided tour☆17Oct 1, 2026Updated last month
- The smallest 6502 / NES CPU simulator in JS (944b gzipped)☆15Mar 1, 2022Updated 4 years ago
- A notebook using numpy, scipy, and matplotlib to show the concepts taught in the course Linear Algebra by Prof. Gilbert Strang at MIT☆11Jul 16, 2022Updated 4 years ago
- Plug-and-play PyTorch transformer research framework. Swap attention, FFN, norm, positional, connection, projection, optimizer, scheduler…☆18Oct 25, 2026Updated 3 weeks ago
- Tiny OS in RISC-V assembly (32-bit)☆10Aug 23, 2026Updated 2 months ago
- Ruby programming language compiled for android to run Jekyll natively on JekyllEx☆19Aug 16, 2026Updated 3 months ago
- A tiny 32-bit Forth operating system I wrote when I was 16☆15Sep 12, 2023Updated 3 years ago
- ☆11May 4, 2018Updated 8 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- llvmのAZ Processor Backend☆11Oct 29, 2013Updated 13 years ago
- A mini redis like repository that is built upon gRPC for effective communication☆11Mar 30, 2024Updated 2 years ago
- A mini reproduction of deepseek v4☆12Jul 21, 2026Updated 3 months ago
- 创意计算课程资源☆17Oct 16, 2020Updated 6 years ago
- The training framework of PCMind-2.1-Kaiyuan-2B built on MindFormers☆15Dec 9, 2025Updated 11 months ago
- A GPT-2 inference engine written from scratch in CUDA and C++. Implements custom CUDA kernels for tiled matrix multiplication, LayerNorm,…☆44May 17, 2026Updated 6 months ago
- An implementation of Vector Clock in Java☆13Jun 27, 2025Updated last year
- Build your own social media analytics with Apache Kafka☆15Jun 17, 2024Updated 2 years ago
- fzf-based test selection with pytest☆16Jan 26, 2026Updated 9 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- AI Hedge Fund Repo integrate with DeepSeek V3 and R1 hosted on SiliconFlow.☆14Feb 3, 2025Updated last year
- ☆12Dec 30, 2024Updated last year
- SemEval 2019 Task 4: Hyperpartisan News Detection☆10Nov 9, 2019Updated 7 years ago
- Implemented and benchmarked KV cache compression methods for LLM inference in Triton. Optimized kernels for KIVI and TurboQuant with Flas…☆18Jun 19, 2026Updated 4 months ago
- Incubating P/D sidecar for llm-d☆17Nov 13, 2025Updated last year
- Core rendering system of ragnar☆18May 31, 2026Updated 5 months ago
- ☆24Jul 20, 2026Updated 3 months ago
- ☆13Apr 4, 2019Updated 7 years ago
- MSc. Dissertation: using machine learning to predict judicial decisions of the ECHR☆14Jan 26, 2021Updated 5 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Code repo for paper "KERAP: A Knowledge-Enhanced Reasoning Approach for Accurate Zero-shot Diagnosis Prediction Using Multi-agent LLMs"☆15Mar 25, 2025Updated last year
- ☆19Jul 24, 2025Updated last year
- ☆18Oct 26, 2025Updated last year
- DACO - Decentralized autonomous charity organization☆10Dec 11, 2017Updated 8 years ago
- FLAT: Flash Linear Attention on TPUs☆24Oct 13, 2026Updated last month
- A pure C implementation of part of the HTTP protocol, for my youtube series☆14Mar 30, 2025Updated last year
- ☆28Nov 10, 2026Updated last week
Are these results useful?