📖A curated list of Awesome LLM/VLM Inference Papers with codes: WINT8/4, FlashAttention, PagedAttention, MLA, Parallelism, etc. 🎉🎉
☆21Mar 30, 2025Updated last year
Alternatives and similar repositories for Awesome-LLM-Inference
Users that are interested in Awesome-LLM-Inference are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This repository contains the code for the paper "TaylorShift: Shifting the Complexity of Self-Attention from Squared to Linear (and Back)…☆15Feb 25, 2026Updated 6 months ago
- Minimal PyTorch implementation of TP, SP, FSDP and sharded-EMA☆32Nov 27, 2025Updated 9 months ago
- Some funny cute/cuteDSL code snippets☆34Mar 2, 2026Updated 5 months ago
- Code for Radar HRRP Target Recognition Based on Variational Auto-encoder with Learnable Prior☆12Nov 15, 2025Updated 9 months ago
- A class for synchronizing sensor readings to the system clock☆11Oct 25, 2018Updated 7 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Context & Guide For Reinforcement Learning with Verifiable Rewards with Large Language Models☆21Nov 3, 2025Updated 9 months ago
- A PyTorch implementation of ClipPrompt based on CVPR 2023 paper "CLIP for All Things Zero-Shot Sketch-Based Image Retrieval, Fine-Grained…☆19Nov 5, 2023Updated 2 years ago
- 📚200+ Tensor/CUDA Cores Kernels, ⚡️flash-attn-mma, ⚡️hgemm with WMMA, MMA and CuTe (98%~100% TFLOPS of cuBLAS/FA2 🎉🎉).☆93Apr 26, 2025Updated last year
- An overview of popular reranking models and architectures for 2 stage RAG pipelines☆24Jun 10, 2025Updated last year
- Courses_in_ML_DL5☆15Nov 6, 2022Updated 3 years ago
- ☆19Apr 19, 2025Updated last year
- Experimental command suggestion system based on historical usage of commands in certain locations.☆13Feb 18, 2026Updated 6 months ago
- ☆18Aug 25, 2025Updated last year
- ☆26Mar 2, 2026Updated 5 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- A ZSH plugin that lets you move items into a parent directoy and then delete the original directory with a single command☆10Jan 29, 2025Updated last year
- Awesome-interview-questions-on-Autonomous-Driving☆23Apr 13, 2024Updated 2 years ago
- ☆16May 29, 2024Updated 2 years ago
- A*, RRT 等规划算法的 C++/Matlab 仿真代码及博客总结☆30Apr 14, 2021Updated 5 years ago
- Terminal aliases for faster and more convenient work with the terminal. Mainly focused on git and terraform work.☆11Jan 4, 2024Updated 2 years ago
- Code for "Adaptive-Weighting Discriminative Regression for Multi-View Classification" in Pattern Recognition☆13May 18, 2019Updated 7 years ago
- ☆32Apr 11, 2026Updated 4 months ago
- Seperated from oh-my-zsh☆13Dec 24, 2023Updated 2 years ago
- Prototypes and experiments for WG Device Management.☆16May 21, 2026Updated 3 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- SIFT: Grounding LLM Reasoning in Contexts via Stickers☆58Mar 6, 2025Updated last year
- c++ 实现stanford cs149 assignment1☆14Feb 19, 2023Updated 3 years ago
- Rustup completion plugin for oh-my-zsh framework☆15Oct 24, 2019Updated 6 years ago
- 很好用的tnn classify demo☆11Mar 24, 2021Updated 5 years ago
- zsh plugins for vivid☆14Apr 22, 2026Updated 4 months ago
- ☆44May 7, 2026Updated 3 months ago
- ☆20Mar 18, 2026Updated 5 months ago
- Curses-based tools for Zsh, e.g. multi-word history searcher☆16Apr 15, 2023Updated 3 years ago
- A kubectl plugin for allowing kubectl plugin completions☆15Jun 7, 2022Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- FocusLLM: Scaling LLM’s Context by Parallel Decoding☆45Dec 8, 2024Updated last year
- Decoding Attention is specially optimized for MHA, MQA, GQA and MLA using CUDA core for the decoding stage of LLM inference.☆48Jun 11, 2025Updated last year
- Repository about single/multi-agent, robotics, llm/vlm/vla, scientific discovery, etc.☆20Jul 10, 2025Updated last year
- UnitEval is a benchmarking and evaluation tools for AutoDev Coder.☆14Jan 2, 2024Updated 2 years ago
- ☆15May 13, 2024Updated 2 years ago
- [NeurIPS 2025] Official PyTorch implementation for the paper AutoJudge: Judge Decoding Without Manual Annotation☆21Dec 22, 2025Updated 8 months ago
- This is a zsh plugin to provided smart input.☆10Dec 24, 2023Updated 2 years ago