☆49Apr 29, 2025Updated last year
Alternatives and similar repositories for Awesome-LLM-Inference-Serving
Users that are interested in Awesome-LLM-Inference-Serving are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆22Apr 22, 2024Updated 2 years ago
- ☆27May 12, 2026Updated last month
- 上海大学本 硕博一体化选课系统自动选课工具☆18Oct 30, 2022Updated 3 years ago
- PipeRAG: Fast Retrieval-Augmented Generation via Algorithm-System Co-design (KDD 2025)☆32Jun 14, 2024Updated 2 years ago
- [NeurIPS 2024] Efficient LLM Scheduling by Learning to Rank☆81Nov 4, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- [ACL'25 Findings] Official repo for "HumanEval Pro and MBPP Pro: Evaluating Large Language Models on Self-invoking Code Generation Task"☆41Apr 7, 2025Updated last year
- ☆24Mar 7, 2025Updated last year
- ☆222Apr 27, 2026Updated 2 months ago
- This project develops compact transformer models tailored for clinical text analysis, balancing efficiency and performance for healthcare…☆18Mar 26, 2024Updated 2 years ago
- [ICML 2025] This is the official PyTorch implementation of "ZipAR: Accelerating Auto-regressive Image Generation through Spatial Locality…☆51Mar 25, 2025Updated last year
- [AAAI 2026] Official Repository for "Oblivionis: A Lightweight Learning and Unlearning Framework for Federated Large Language Models"☆41May 29, 2026Updated last month
- [COLM 2025] Official PyTorch implementation of "Quantization Hurts Reasoning? An Empirical Study on Quantized Reasoning Models"☆76Jul 8, 2025Updated 11 months ago
- HALO: Hadamard-Assisted Low-Precision Optimization and Training method for finetuning LLMs. 🚀 The official implementation of https://arx…☆29Feb 17, 2025Updated last year
- ☆16Sep 22, 2024Updated last year
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- The code for "AttentionPredictor: Temporal Pattern Matters for Efficient LLM Inference", Qingyue Yang, Jie Wang, Xing Li, Zhihai Wang, Ch…☆29Jul 15, 2025Updated 11 months ago
- ☆15Mar 20, 2025Updated last year
- ☆52Mar 20, 2026Updated 3 months ago
- LLM Serving Performance Evaluation Harness☆84Feb 25, 2025Updated last year
- Awesome latest models, datasets and benchmarks on streaming/online video understanding.☆30Oct 19, 2025Updated 8 months ago
- Flow level simulation☆16Nov 22, 2015Updated 10 years ago
- ☆89May 24, 2026Updated last month
- [Archived - See https://github.com/rustsbi/rustsbi/] RustSBI prototyper☆12Feb 16, 2025Updated last year
- Try HopWeaver: The first automatic synthesis framework based on any corpora, with quality approaching manual annotation.☆27Apr 7, 2026Updated 2 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A Comprehensive Survey on Long Context Language Modeling☆250May 29, 2026Updated last month
- Use Amazon Comprehend Medical to extract medical insight from notes inside the OMOP Common Data Model☆14Feb 28, 2019Updated 7 years ago
- ☆21Apr 3, 2026Updated 2 months ago
- This is an official GitHub repository for the paper, "Towards timeout-less transport in commodity datacenter networks.".☆15Sep 7, 2022Updated 3 years ago
- ☆115Feb 26, 2026Updated 4 months ago
- "Microsoft Power BI Performance Best Practices - Second Edition, published by Packt"☆13Mar 2, 2026Updated 3 months ago
- The Easiest Pytorch Implementation of Branching-DQN☆12Feb 10, 2021Updated 5 years ago
- Aplicação em Python para Optical Character Recognition (OCR), uma técnica para extrair textos em imagens. Adicionalmente, o programa tent…☆12Aug 13, 2021Updated 4 years ago
- [ICLR 2025] Official Pytorch Implementation of "Mix-LN: Unleashing the Power of Deeper Layers by Combining Pre-LN and Post-LN" by Pengxia…☆30Jul 24, 2025Updated 11 months ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- A Haskell binding to the wiringPi library, for using GPIO on the Raspberry Pi.☆16Jan 8, 2020Updated 6 years ago
- [MobiCom '23] AccuMO: Accuracy-Centric Multitask Offloading in Edge-Assisted Mobile Augmented Reality☆18Oct 8, 2023Updated 2 years ago
- Aulas de conceitos básicos de Processamento de Linguagem Natural oferecida no Discord aberto no Turing USP☆10Jul 30, 2021Updated 4 years ago
- AMD Software Development Kit 2.5 Sources☆10Feb 29, 2016Updated 10 years ago
- ☆12Apr 23, 2026Updated 2 months ago
- Self-contained, comprehensive overview of PT-BR-LLMs advancements, architectures, and resources.☆33Dec 31, 2025Updated 5 months ago
- A platform that provides users with easy access to AI services developed by Montimage and usage of explainable AI techniques (e.g., LIME,…☆10Feb 17, 2026Updated 4 months ago