πA curated list of Awesome LLM/VLM Inference Papers with codes: WINT8/4, FlashAttention, PagedAttention, MLA, Parallelism, etc. ππ
β21Mar 30, 2025Updated last year
Alternatives and similar repositories for Awesome-LLM-Inference
Users that are interested in Awesome-LLM-Inference are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Democratizing AlphaFold3: an PyTorch reimplementation to accelerate protein structure predictionβ22Oct 20, 2026Updated last month
- Training codebase for K2-V2β22Dec 17, 2025Updated 11 months ago
- Official implementation of RP-OPSD for multimodal large language modelsβ13Aug 13, 2026Updated 3 months ago
- Phishing Detection System using Natural Language Processing and Machine Learningβ11Jul 28, 2022Updated 4 years ago
- large language model internal-medicine monitor toolboxβ17Oct 28, 2026Updated 3 weeks ago
- AI Agents on DigitalOcean Gradient AI Platform β’ AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Virus Infection Attack on LLMs: Your Poisoning Can Spread "VIA" Synthetic Data. NeurIPS'25 Spotlightβ12Jul 30, 2025Updated last year
- ACE: the Abstract-Concrete-Execute security architecture for LLM-integrated app systems.β16Apr 21, 2026Updated 6 months ago
- This repository contains the code for the paper "TaylorShift: Shifting the Complexity of Self-Attention from Squared to Linear (and Back)β¦β15Feb 25, 2026Updated 8 months ago
- Human Mobility Prediction Challenge: Next Location Prediction using Spatiotemporal BERTβ12Dec 18, 2023Updated 2 years ago
- A Comprehensive Benchmark Framework for Retrieval-Augmented Generation (RAG) Routing and Query-Corpus Compatibility.β14Feb 3, 2026Updated 9 months ago
- π€ Implementation of Self Normalizing Networks (SNN) in PyTorch.β15Jun 19, 2017Updated 9 years ago
- Minimal PyTorch implementation of TP, SP, FSDP and sharded-EMAβ32Nov 27, 2025Updated 11 months ago
- Tools for merging pretrained large language models.β10Jan 7, 2024Updated 2 years ago
- Vectors of Locally Aggregated Conceptsβ14Jun 17, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI β’ AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- β13Dec 30, 2021Updated 4 years ago
- Some funny cute/cuteDSL code snippetsβ35Mar 2, 2026Updated 8 months ago
- Towards Automating Data Access Permissions in AI Agentsβ15Jan 27, 2026Updated 9 months ago
- A detailed comparison of performance scores achieved by Machine Learning and Deep Learning algorithms on 3 different Phishing datasets. 3β¦β16Sep 17, 2019Updated 7 years ago
- The repository presents the code for the paper "Revisiting Concept Drift in Windows Malware Detection: Adaptation to Real Drifted Malwareβ¦β16Sep 25, 2025Updated last year
- [NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.β12Mar 29, 2024Updated 2 years ago
- Uses a LIDAR, IMU, GPS. Implemented and tested a planner based on frenet frame. Credits to atsushi sakai for the implementation of the frβ¦β10Jan 16, 2020Updated 6 years ago
- vLLM wall-clock emulation pluging to allow running the real vllm serve and benchmark without gpu with simple mockingβ17Aug 21, 2026Updated 2 months ago
- β12May 11, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer β’ AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Scaffold production-ready AI agent projects in Python (ReAct, RAG, and Multi-Agent Supervisor) with one CLI commandβ21Apr 28, 2026Updated 6 months ago
- DRSM: De-Randomized Smoothing on Malware Classifier Providing Certified Robustness (ICLR 2024)β17Apr 22, 2024Updated 2 years ago
- β13Oct 23, 2025Updated last year
- Model analysis tools for TensorFlowβ12Oct 27, 2019Updated 7 years ago
- Local isolated launcher for the public Claude Code packageβ18Mar 31, 2026Updated 7 months ago
- Rethinking Urban Mobility Prediction: A Super-Multivariate Time Series Forecasting Approach (TITS)β20Nov 22, 2024Updated last year
- A library for mechanistic interpretability of GPT-style language modelsβ10Aug 2, 2024Updated 2 years ago
- Claude Code Plugin for Interacting with Apple Notes via Agent Skillsβ14Dec 29, 2025Updated 10 months ago
- A class for synchronizing sensor readings to the system clockβ11Oct 25, 2018Updated 8 years ago
- Managed hosting for WordPress and PHP on Cloudways β’ AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- β13Jan 16, 2019Updated 7 years ago
- A Rust built code judger utils with Web & CLI executablesβ17Apr 7, 2025Updated last year
- π¦ The lab code of MIT 6.S081β11Jul 19, 2023Updated 3 years ago
- Codebase for Active Membership Inference Attack under Local Differential Privacy in Federated Learningβ17Feb 9, 2024Updated 2 years ago
- β10Jul 30, 2023Updated 3 years ago
- [ICLR 2025] Official implementation for "Bad-PFL: EXPLORING BACKDOOR ATTACKS AGAINST PERSONALIZED FEDERATED LEARNING"β17Feb 14, 2025Updated last year
- Cache Me, Catch You: Cache Related Security Threats in LLM Serving Frameworks (NDSS 2026)β22Dec 18, 2025Updated 11 months ago
Are these results useful?