Must-read papers on improving efficiency for LLM serving clusters
☆34May 28, 2025Updated last year
Alternatives and similar repositories for Awesome-Large-Scale-LLM-Serving
Users that are interested in Awesome-Large-Scale-LLM-Serving are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆40Mar 17, 2025Updated last year
- A curated reading list for machine learning reliability research and practice☆31Sep 18, 2025Updated 11 months ago
- ☆12Jun 10, 2022Updated 4 years ago
- Calibrating LLM Confidence by Probing Perturbed Representation Stability☆19Jul 5, 2025Updated last year
- ☆12Oct 16, 2022Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ICSE2021 Submission☆13Aug 28, 2022Updated 4 years ago
- ☆20Aug 26, 2021Updated 5 years ago
- for paper @ ASPLOS‘25’☆16Mar 27, 2025Updated last year
- 🧠Plan-and-Budget: Training-free test-time reasoning framework for adaptive token allocation in large language models (ICLR 2026).☆16Mar 2, 2026Updated 6 months ago
- Berkeley OS Prelim Reading Notes☆15Sep 20, 2023Updated 2 years ago
- 为GPT/GLM等LLM大语言模型提供实用化交互接口，特别优化论文阅读/润色/写作体验，模块化设计，支持自定义快捷按钮&函数插件，支持Python和C++等项目剖析&自译解功能，PDF/LaTex论文翻译&总结功能，支持并行问询多种LLM模型，支持chatglm3等本地模型…☆15Feb 18, 2024Updated 2 years ago
- NLPCC2023 shared-task DiaASQ first-place solution. （NLPCC2023对话式细粒度情感识别大赛第一名方案）☆15Jun 21, 2023Updated 3 years ago
- Code for building ConceptNet from raw data.☆23Jan 26, 2024Updated 2 years ago
- ☆19Jan 10, 2023Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ACL'2025: SoftCoT: Soft Chain-of-Thought for Efficient Reasoning with LLMs. and preprint: SoftCoT++: Test-Time Scaling with Soft Chain-of…☆95May 30, 2025Updated last year
- A development guide for building custom robot assemblies in Solidworks, converting them to URDF, importing to pybullet environment, and s…☆12Aug 25, 2020Updated 6 years ago
- The repository for papaer "Distance between Relevant Information Pieces Causes Bias in Long-Context LLMs"☆14Dec 16, 2024Updated last year
- NEO is a LLM inference engine built to save the GPU memory crisis by CPU offloading☆99Jun 16, 2025Updated last year
- ☆21Jun 9, 2025Updated last year
- PaiNN in jax☆11Jan 14, 2025Updated last year
- feishu custom bot action☆20Updated this week
- 电动笛子！☆12Jul 13, 2024Updated 2 years ago
- Benchmark AFLOW Data Sets for Machine Learning doi.org/10.1007/s40192-020-00174-4☆11Aug 29, 2020Updated 6 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Automated Testing and Adaptive Detection of **Slow Faults** in Distributed Systems☆19Mar 6, 2025Updated last year
- Open-Pandora: On-the-fly Control Video Generation☆35Nov 28, 2024Updated last year
- ☆19May 9, 2025Updated last year
- ☆14Mar 11, 2025Updated last year
- [COLM 2025] Official code for "When To Solve, When To Verify: Compute-Optimal Problem Solving and Generative Verification for LLM Reasoni…☆15Oct 31, 2025Updated 10 months ago
- ☆13Jan 25, 2026Updated 7 months ago
- A benchmarking framework for on-device AI☆20Aug 20, 2026Updated 3 weeks ago
- 🫧 Code for Holistic Reasoning with Long-Context LMs: A Benchmark for Database Operations on Massive Textual Data (Maekawa*, Iso* et al.…☆12Feb 25, 2025Updated last year
- ☆12Apr 29, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- To assess the longtext capabilities more comprehensively, we propose Needle-in-a-Haystack PLUS, which shifts the focus from simple fact r…☆13Mar 4, 2024Updated 2 years ago
- ☆45Apr 2, 2023Updated 3 years ago
- [ASPLOS' 26] TetriServe: Efficiently Serving Mixed DiT Workloads☆19Mar 12, 2026Updated 5 months ago
- ☆14Oct 3, 2024Updated last year
- Confidence Regulation Neurons in Language Models (NeurIPS 2024)☆16Feb 1, 2025Updated last year
- Dotfile management with bare git☆22Updated this week
- This is the repository of the EnviroDetaNet☆14Sep 3, 2024Updated 2 years ago