📖A curated list of Awesome LLM/VLM Inference Papers with codes: WINT8/4, FlashAttention, PagedAttention, MLA, Parallelism, etc. 🎉🎉
☆21Mar 30, 2025Updated last year
Alternatives and similar repositories for Awesome-LLM-Inference
Users that are interested in Awesome-LLM-Inference are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Training codebase for K2-V2☆22Dec 17, 2025Updated 10 months ago
- Official implementation of RP-OPSD for multimodal large language models☆13Aug 13, 2026Updated 2 months ago
- ☆15Dec 10, 2025Updated 10 months ago
- This repository contains the code for the paper "TaylorShift: Shifting the Complexity of Self-Attention from Squared to Linear (and Back)…☆15Feb 25, 2026Updated 8 months ago
- Phishing Detection System using Natural Language Processing and Machine Learning☆11Jul 28, 2022Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Human Mobility Prediction Challenge: Next Location Prediction using Spatiotemporal BERT☆12Dec 18, 2023Updated 2 years ago
- Virus Infection Attack on LLMs: Your Poisoning Can Spread "VIA" Synthetic Data. NeurIPS'25 Spotlight☆12Jul 30, 2025Updated last year
- Multi-view dimensionality reduction using tensor canonical correlation analysis☆10Jun 28, 2018Updated 8 years ago
- Artifacts for the NDSS'26 paper "Chasing Shadows: Pitfalls in LLM Security Research"☆15Mar 20, 2026Updated 7 months ago
- Code for AISTATS'25 paper - On the Power of Adaptive Weighted Aggregation in Heterogeneous Federated Learning and Beyond☆14Sep 23, 2025Updated last year
- Minimal PyTorch implementation of TP, SP, FSDP and sharded-EMA☆32Nov 27, 2025Updated 11 months ago
- A Comprehensive Benchmark Framework for Retrieval-Augmented Generation (RAG) Routing and Query-Corpus Compatibility.☆14Feb 3, 2026Updated 8 months ago
- ☆13Dec 30, 2021Updated 4 years ago
- FGLA: Fast Generation-Based Gradient Leakage Attacks against Highly Compressed Gradients☆16Mar 17, 2026Updated 7 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- A detailed comparison of performance scores achieved by Machine Learning and Deep Learning algorithms on 3 different Phishing datasets. 3…☆16Sep 17, 2019Updated 7 years ago
- Some funny cute/cuteDSL code snippets☆35Mar 2, 2026Updated 7 months ago
- A static performance model for LLM inference: given (model, GPU, interconnect, workload), instantly answer VRAM feasibility, latency(TTFT…☆22Oct 6, 2026Updated 3 weeks ago
- Code for paper "Deep Multi-View Learning Using Neuron-Wise Correlation-Maximizing Regularizers"☆10Dec 30, 2019Updated 6 years ago
- ☆12May 11, 2025Updated last year
- multiview and self-supervised learning☆11May 8, 2022Updated 4 years ago
- DRSM: De-Randomized Smoothing on Malware Classifier Providing Certified Robustness (ICLR 2024)☆17Apr 22, 2024Updated 2 years ago
- [EuroSys27] TokenCake: A KV-Cache-centric Serving Framework for LLM-based Multi-Agent Applications☆14Updated this week
- Rethinking Urban Mobility Prediction: A Super-Multivariate Time Series Forecasting Approach (TITS)☆20Nov 22, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Local isolated launcher for the public Claude Code package☆18Mar 31, 2026Updated 6 months ago
- A class for synchronizing sensor readings to the system clock☆11Oct 25, 2018Updated 8 years ago
- Scope: On Detecting Constrained Backdoor Attacks in Federated Learning☆23Jul 2, 2025Updated last year
- ☆20Aug 27, 2026Updated 2 months ago
- ☆24Jan 14, 2025Updated last year
- A Rust built code judger utils with Web & CLI executables☆17Apr 7, 2025Updated last year
- 📦 The lab code of MIT 6.S081☆11Jul 19, 2023Updated 3 years ago
- Codebase for Active Membership Inference Attack under Local Differential Privacy in Federated Learning☆17Feb 9, 2024Updated 2 years ago
- [ICLR 2025] Official implementation for "Bad-PFL: EXPLORING BACKDOOR ATTACKS AGAINST PERSONALIZED FEDERATED LEARNING"☆17Feb 14, 2025Updated last year
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- ☆34Aug 18, 2026Updated 2 months ago
- 📚200+ Tensor/CUDA Cores Kernels, ⚡️flash-attn-mma, ⚡️hgemm with WMMA, MMA and CuTe (98%~100% TFLOPS of cuBLAS/FA2 🎉🎉).☆98Apr 26, 2025Updated last year
- AI 创始人 & 研究员长访谈深度分析库 | 张小 珺商业访谈录、WhynotTV、雪球《方略》结构化拆解：段永平、姚顺宇、翁家翌、何小鹏、杨植麟(Kimi)、罗福莉、张鹏(智谱)☆30Jul 16, 2026Updated 3 months ago
- ☆14Jan 25, 2023Updated 3 years ago
- [NDSS 2025] CENSOR: Defense Against Gradient Inversion via Orthogonal Subspace Bayesian Sampling☆20Jan 18, 2025Updated last year
- Cache Me, Catch You: Cache Related Security Threats in LLM Serving Frameworks (NDSS 2026)☆22Dec 18, 2025Updated 10 months ago
- ☆23Jan 26, 2026Updated 9 months ago