📖A curated list of Awesome LLM/VLM Inference Papers with codes: WINT8/4, FlashAttention, PagedAttention, MLA, Parallelism, etc. 🎉🎉
☆21Mar 30, 2025Updated last year
Alternatives and similar repositories for Awesome-LLM-Inference
Users that are interested in Awesome-LLM-Inference are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Training codebase for K2-V2☆22Dec 17, 2025Updated 9 months ago
- This repository contains the code for the paper "TaylorShift: Shifting the Complexity of Self-Attention from Squared to Linear (and Back)…☆15Feb 25, 2026Updated 6 months ago
- Minimal PyTorch implementation of TP, SP, FSDP and sharded-EMA☆32Nov 27, 2025Updated 9 months ago
- RCS Radar Simulator for Matlab☆12Dec 5, 2017Updated 8 years ago
- Code for Radar HRRP Target Recognition Based on Variational Auto-encoder with Learnable Prior☆12Nov 15, 2025Updated 10 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- multiview and self-supervised learning☆11May 8, 2022Updated 4 years ago
- A PyTorch implementation of ClipPrompt based on CVPR 2023 paper "CLIP for All Things Zero-Shot Sketch-Based Image Retrieval, Fine-Grained…☆19Nov 5, 2023Updated 2 years ago
- Compare PyTorch models from MATLAB using co-execution☆14Apr 6, 2026Updated 5 months ago
- Courses_in_ML_DL5☆15Nov 6, 2022Updated 3 years ago
- Experimental command suggestion system based on historical usage of commands in certain locations.☆13Feb 18, 2026Updated 7 months ago
- this is the simulation of mimo radar for Graduation Design☆11May 4, 2020Updated 6 years ago
- MSTAR数据的处理☆18Jan 12, 2019Updated 7 years ago
- Wrappers for git commands to be efficient in the shell☆13Aug 12, 2020Updated 6 years ago
- ☆16May 29, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Code for "Adaptive-Weighting Discriminative Regression for Multi-View Classification" in Pattern Recognition☆13May 18, 2019Updated 7 years ago
- Seperated from oh-my-zsh☆13Dec 24, 2023Updated 2 years ago
- SIFT: Grounding LLM Reasoning in Contexts via Stickers☆58Mar 6, 2025Updated last year
- c++ 实现stanford cs149 assignment1☆14Feb 19, 2023Updated 3 years ago
- Rustup completion plugin for oh-my-zsh framework☆15Oct 24, 2019Updated 6 years ago
- 很好用的tnn classify demo☆11Mar 24, 2021Updated 5 years ago
- View vim plugin manuals (help) like man in zsh☆21Aug 19, 2014Updated 12 years ago
- ☆20Mar 18, 2026Updated 6 months ago
- 输入链接就将公众号文章转为本地 Markdown 文档☆18Mar 17, 2026Updated 6 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Curses-based tools for Zsh, e.g. multi-word history searcher☆16Apr 15, 2023Updated 3 years ago
- FocusLLM: Scaling LLM’s Context by Parallel Decoding☆45Dec 8, 2024Updated last year
- Decoding Attention is specially optimized for MHA, MQA, GQA and MLA using CUDA core for the decoding stage of LLM inference.☆48Jun 11, 2025Updated last year
- UnitEval is a benchmarking and evaluation tools for AutoDev Coder.☆14Jan 2, 2024Updated 2 years ago
- ☆15May 13, 2024Updated 2 years ago
- Virtualfish-alike Python virtualenv wrapper for Zsh☆10Apr 3, 2024Updated 2 years ago
- [NeurIPS 2025] Official PyTorch implementation for the paper AutoJudge: Judge Decoding Without Manual Annotation☆21Dec 22, 2025Updated 8 months ago
- Interactive git commands using fzf, available as zsh plugin☆19May 5, 2026Updated 4 months ago
- Zsh safe-paste plugin for antigen. See http://cirw.in/blog/bracketed-paste☆13Jan 22, 2015Updated 11 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- MetaLadder: Ascending Mathematical Solution Quality via Analogical-Problem Reasoning Transfer (EMNLP 2025)☆12Apr 18, 2025Updated last year
- Plugin for Bash or ZSH to be used with the Git Time Metric platform☆17Nov 19, 2020Updated 5 years ago
- ☆11Aug 20, 2025Updated last year
- A Chinese-focused PyTorch framework for exploring Attention Residuals in Qwen3-style causal LMs, with baseline, Block AttnRes, Full AttnR…☆21May 3, 2026Updated 4 months ago
- EMNLP 2022: Analyzing and Evaluating Faithfulness in Dialogue Summarization☆13Mar 20, 2025Updated last year
- 📦 ❮ ZI ❯ Package - Brew Completions☆10Sep 12, 2026Updated last week
- dzen2 bar \w multiple monitors support☆11Mar 13, 2024Updated 2 years ago