☆33Jan 16, 2025Updated last year
Alternatives and similar repositories for QLM
Users that are interested in QLM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆92Oct 17, 2025Updated last year
- ☆21Jun 9, 2025Updated last year
- Efficient Interactive LLM Serving with Proxy Model-based Sequence Length Prediction | A tiny BERT model can tell you the verbosity of an …☆53Jun 1, 2024Updated 2 years ago
- Proteus: A High-Throughput Inference-Serving System with Accuracy Scaling☆14Mar 7, 2024Updated 2 years ago
- Official code for the paper "HEXA-MoE: Efficient and Heterogeneous-Aware MoE Acceleration with Zero Computation Redundancy"☆16Mar 6, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 🧠Plan-and-Budget: Training-free test-time reasoning framework for adaptive token allocation in large language models (ICLR 2026).☆20Mar 2, 2026Updated 8 months ago
- Research prototype of PRISM — a cost-efficient multi-LLM serving system with flexible time- and space-based GPU sharing.☆77Mar 17, 2026Updated 7 months ago
- ☆52Jun 7, 2024Updated 2 years ago
- Stateful LLM Serving☆110Mar 11, 2025Updated last year
- The official repo for the paper "Optimizing LLM Inference Throughput via Memory-aware and SLA-constrained Dynamic Batching"☆17Mar 17, 2025Updated last year
- TokenSim is a tool for simulating the behavior of large language models (LLMs) in a distributed environment.☆46Updated this week
- [NeurIPS 2024] Efficient LLM Scheduling by Learning to Rank☆85Nov 4, 2024Updated 2 years ago
- PyTorch implementation of paper "Response Length Perception and Sequence Scheduling: An LLM-Empowered LLM Inference Pipeline".☆94May 23, 2023Updated 3 years ago
- Shared Memory-contention-aware Concurrent DNN Execution for Diversely Heterogeneous System-on-Chips☆11Jan 4, 2024Updated 2 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Resource Multiplexing in Tuning and Serving Large Language Models (USENIX ATC 2025)☆10Apr 21, 2026Updated 6 months ago
- (COLING2025) SEED: Accelerating Reasoning Tree Construction via Scheduled Speculative Decoding☆10Dec 18, 2024Updated last year
- A low-latency & high-throughput serving engine for LLMs☆535Jan 8, 2026Updated 9 months ago
- ☆13Jan 5, 2026Updated 9 months ago
- A language for video analytics☆12Jan 26, 2023Updated 3 years ago
- ☆32May 24, 2025Updated last year
- ☆13Feb 11, 2025Updated last year
- Deploy FUSE filesystem for LXC☆13Oct 26, 2026Updated last week
- LLM serving cluster simulator☆170Apr 25, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Engine-Agnostic Model Hot-Swapping for Cost-Effective LLM Inference☆15Nov 13, 2025Updated 11 months ago
- A minimal open-source on-policy-distillation implementation☆13May 21, 2026Updated 5 months ago
- ☆14Dec 22, 2024Updated last year
- 中文字号的号数制及字体度量单位 Chinese size system (hào-system) and type-related measurements units☆13Sep 19, 2026Updated last month
- BlitzScale Router - Distributed LLM Inference Router (Rust)☆17May 25, 2026Updated 5 months ago
- ☆17Apr 16, 2026Updated 6 months ago
- 大学做过的各种作业项目等。☆14Dec 20, 2018Updated 7 years ago
- ☆11Dec 4, 2022Updated 3 years ago
- High resolution polar orbiting environmental satellite recording and decoding software☆13May 25, 2013Updated 13 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- [ICML‘25] Official code for paper "Occult: Optimizing Collaborative Communication across Experts for Accelerated Parallel MoE Training an…☆14Apr 17, 2025Updated last year
- CUDA MoE kernels.☆12Sep 21, 2024Updated 2 years ago
- A Physics-Augmented Agentic Workflow that orchestrates multiple LLMs to reason through conjunction events☆14Jan 26, 2026Updated 9 months ago
- ☆49Jun 27, 2024Updated 2 years ago
- A low-latency, billion-scale, and updatable graph-based vector store on SSD.☆15Jul 1, 2025Updated last year
- An Efficient and Versatile Inference Engine for Distributed LLM Serving☆74Updated this week
- 🗃️ plugin for integrating a Obsidian vault with Docusaurus☆16Apr 19, 2026Updated 6 months ago