Must-read papers on improving efficiency for LLM serving clusters
☆34May 28, 2025Updated last year
Alternatives and similar repositories for Awesome-Large-Scale-LLM-Serving
Users that are interested in Awesome-Large-Scale-LLM-Serving are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This repository contains PyTorch implementation for Unsupervised Point Cloud Completion and Segmentation by Generative Adversarial Autoen…☆10Nov 30, 2022Updated 3 years ago
- ☆39Updated this week
- This is a displayer for Live2Dv3 model☆19Mar 11, 2020Updated 6 years ago
- 🔥 Must-read papers for LLM-based Latent Reasoning☆10Mar 7, 2025Updated last year
- This repository contains PyTorch implementation for Symmetric Shape-Preserving Autoencoder for Unsupervised Real Scene Point Cloud Comple…☆23May 22, 2023Updated 3 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A curated reading list for machine learning reliability research and practice☆32Sep 18, 2025Updated last year
- ☆13Oct 4, 2025Updated last year
- Automated Testing and Adaptive Detection of **Slow Faults** in Distributed Systems☆20Mar 6, 2025Updated last year
- A compiler framework for eBPF programs☆23Updated this week
- ☆11Oct 11, 2022Updated 4 years ago
- Efficient Interactive LLM Serving with Proxy Model-based Sequence Length Prediction | A tiny BERT model can tell you the verbosity of an …☆53Jun 1, 2024Updated 2 years ago
- A rust-version of NVIDIA BlueField DOCA kit.☆13Jun 11, 2023Updated 3 years ago
- ICSE2021 Submission☆13Aug 28, 2022Updated 4 years ago
- [NeurIPS 2024] Efficient LLM Scheduling by Learning to Rank☆86Nov 4, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆11Oct 16, 2022Updated 4 years ago
- library for power, frequency, and temperature measurement on Intel processors☆11Dec 9, 2014Updated 11 years ago
- An Observability Framework for AI Training☆75Updated this week
- Code release for "CAPNet: Continuous Approximation Projection For 3D Point Cloud Reconstruction Using 2D Supervision", (AAAI-19)☆21May 6, 2019Updated 7 years ago
- ☆21May 11, 2026Updated 6 months ago
- NLPCC2023 shared-task DiaASQ first-place solution. (NLPCC2023对话式细粒度情感识别大赛第一名方案)☆15Jun 21, 2023Updated 3 years ago
- Piecewise-Taylor Attention☆48Aug 4, 2026Updated 3 months ago
- A toolchain for distributed system runtime checkers☆13May 20, 2025Updated last year
- Official repository for VideoAR☆28Jan 14, 2026Updated 10 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆29Jul 20, 2026Updated 4 months ago
- NEO is a LLM inference engine built to save the GPU memory crisis by CPU offloading☆101Jun 16, 2025Updated last year
- VM migration related toolset☆14Oct 16, 2026Updated last month
- [SemEval-2024 Task 3] Multimodal Emotion Cause Analysis in Conversations☆28Apr 20, 2025Updated last year
- ☆21Jun 9, 2025Updated last year
- another BibTeX-to-HTML (with Jinja2 templates)☆17Jun 23, 2020Updated 6 years ago
- The repository for papaer "Distance between Relevant Information Pieces Causes Bias in Long-Context LLMs"☆14Dec 16, 2024Updated last year
- DeepSeek-V3/R1 inference performance simulator☆199Mar 27, 2025Updated last year
- 电动笛子!☆12Jul 13, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- [NeurIPS 2024] From Instance Training to Instruction Learning: Task Adapters Generation from Instructions☆11Apr 20, 2025Updated last year
- ☆25Dec 10, 2021Updated 4 years ago
- ☆149Updated this week
- Code for evaluating WebRTC performance☆14Sep 18, 2017Updated 9 years ago
- Benchmark AFLOW Data Sets for Machine Learning doi.org/10.1007/s40192-020-00174-4☆11Aug 29, 2020Updated 6 years ago
- Diverse Video Generation using a Gaussian Process Trigger☆20Dec 13, 2022Updated 3 years ago
- ☆12Apr 29, 2024Updated 2 years ago
Are these results useful?