Ketonmi / Awesome-Large-Scale-LLM-ServingView external linksLinks
Must-read papers on improving efficiency for LLM serving clusters
☆33May 28, 2025Updated 8 months ago
Alternatives and similar repositories for Awesome-Large-Scale-LLM-Serving
Users that are interested in Awesome-Large-Scale-LLM-Serving are comparing it to the libraries listed below
Sorting:
- ☆34Mar 17, 2025Updated 11 months ago
- A Framework for Automated Validation of Deep Learning Training Tasks☆61Updated this week
- Benchmark AFLOW Data Sets for Machine Learning doi.org/10.1007/s40192-020-00174-4☆11Aug 29, 2020Updated 5 years ago
- GenoCraft: A Comprehensive, User-Friendly Web Platform for High-Throughput Omics Data Analysis and Visualization (https://arxiv.org/pdf/2…☆19May 28, 2025Updated 8 months ago
- [AAAI 2025] Neural-Symbolic Collaborative Distillation: Advancing Small Language Models for Complex Reasoning Tasks☆11Jun 19, 2025Updated 7 months ago
- The first high school physics Olympiad benchmark for evaluating (M)LLMs with step-level grading and human-level comparison.☆26Dec 19, 2025Updated last month
- The repository for papaer "Distance between Relevant Information Pieces Causes Bias in Long-Context LLMs"☆14Dec 16, 2024Updated last year
- Uncertainty quantification for data-driven weather models.☆14Apr 9, 2025Updated 10 months ago
- PaiNN in jax☆11Jan 14, 2025Updated last year
- 电动笛子！☆12Jul 13, 2024Updated last year
- ☆15Jan 27, 2025Updated last year
- [ICLR 2025] ELICIT: LLM Augmentation Via External In-context Capability☆13Mar 11, 2025Updated 11 months ago
- [ICML 2025] LaCache: Ladder-Shaped KV Caching for Efficient Long-Context Modeling of Large Language Models☆17Nov 4, 2025Updated 3 months ago
- Efficient Interactive LLM Serving with Proxy Model-based Sequence Length Prediction | A tiny BERT model can tell you the verbosity of an …☆46Jun 1, 2024Updated last year
- 🫧 Code for Holistic Reasoning with Long-Context LMs: A Benchmark for Database Operations on Massive Textual Data (Maekawa*, Iso* et al.…☆12Feb 25, 2025Updated 11 months ago
- A script for the statistical learning theory course at ETH☆11Aug 19, 2021Updated 4 years ago
- [NeurIPS25] RULE: Reinforcement UnLEarning Achieves Forge-retain Pareto Optimality☆19Oct 22, 2025Updated 3 months ago
- Confidence Regulation Neurons in Language Models (NeurIPS 2024)☆15Feb 1, 2025Updated last year
- KnowLA: Enhancing Parameter-efficient Finetuning with Knowledgeable Adaptation, NAACL 2024☆16Jul 29, 2024Updated last year
- [ICLR 2025] The source code of "MolSpectra: Pre-training 3D Molecular Representation with Multi-modal Energy Spectra"☆19Apr 19, 2025Updated 9 months ago
- ☆13Jun 30, 2020Updated 5 years ago
- ☆14Mar 11, 2025Updated 11 months ago
- [COLM 2025] Official code for "When To Solve, When To Verify: Compute-Optimal Problem Solving and Generative Verification for LLM Reasoni…☆15Oct 31, 2025Updated 3 months ago
- An exploration of LLM steering☆24Jun 15, 2024Updated last year
- Berkeley OS Prelim Reading Notes☆15Sep 20, 2023Updated 2 years ago
- Official release of KnowUREnvironment, a knowledge graph on climate change and related environmental issues. Paper link: https://www.clim…☆13Feb 16, 2024Updated 2 years ago
- Evaluation framework for computationally inferred gene networks from single-cell data.☆18Oct 23, 2025Updated 3 months ago
- Simple python interface for the OpenProtein.AI REST API.☆15Feb 6, 2026Updated last week
- To assess the longtext capabilities more comprehensively, we propose Needle-in-a-Haystack PLUS, which shifts the focus from simple fact r…☆13Mar 4, 2024Updated last year
- Code for the examples in Spectral and Algebraic Graph Theory☆21Jan 7, 2025Updated last year
- RAG-RewardBench: Benchmarking Reward Models in Retrieval Augmented Generation for Preference Alignment☆16Dec 19, 2024Updated last year
- RetroDFM-R: Reasoning-Driven Retrosynthesis Prediction with Large Language Models via Reinforcement Learning☆19Nov 22, 2025Updated 2 months ago
- for paper @ ASPLOS‘25’☆17Mar 27, 2025Updated 10 months ago
- ☆12Apr 29, 2024Updated last year
- Repository for GeoUni, A Unified Model for Generating Geometry Diagrams, Problems and Problem Solutions.☆19Jun 12, 2025Updated 8 months ago
- A fully differentiable set autoencoder☆17Apr 3, 2024Updated last year
- Code and data for AI-assisted coding experiments☆14Jul 5, 2025Updated 7 months ago
- A PyTorch implementation of Generative Flows with Matrix Exponential.☆12Sep 22, 2024Updated last year
- TTDS coursework 1&2.☆11Nov 17, 2019Updated 6 years ago