☆34Jun 22, 2024Updated 2 years ago
Alternatives and similar repositories for InferCept
Users that are interested in InferCept are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Resource Multiplexing in Tuning and Serving Large Language Models (USENIX ATC 2025)☆10Apr 21, 2026Updated 6 months ago
- OSWorld-Human: Benchmarking the Efficiency of Computer-Use Agents☆29May 17, 2026Updated 5 months ago
- Stateful LLM Serving☆109Mar 11, 2025Updated last year
- Paper-reading notes for Berkeley OS prelim exam.☆14Aug 28, 2024Updated 2 years ago
- Artifact for "Apparate: Rethinking Early Exits to Tame Latency-Throughput Tensions in ML Serving" [SOSP '24]☆25Nov 21, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- APEX+ is an LLM Serving Simulator☆51Jun 16, 2025Updated last year
- 上海交通大学软件学院课程操作系统(SE3357)笔记☆11Nov 13, 2022Updated 3 years ago
- QuantumDNA is an open-source Python package for simulating exciton and charge transfer in DNA using quantum mechanical methods. Designed …☆13Sep 23, 2026Updated last month
- ☆19May 4, 2023Updated 3 years ago
- ☆137Nov 11, 2024Updated last year
- ☆28Jun 1, 2021Updated 5 years ago
- NVIDIA Linux open GPU with P2P support☆12Aug 2, 2026Updated 2 months ago
- [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable☆228Oct 14, 2026Updated 2 weeks ago
- An LLM inference engine, written in C++☆20Mar 30, 2026Updated 6 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆11Oct 16, 2022Updated 4 years ago
- PoC for "SpecReason: Fast and Accurate Inference-Time Compute via Speculative Reasoning" [NeurIPS '25]☆76Oct 2, 2025Updated last year
- Serverless Paper Reading and Discussion☆37Jan 9, 2023Updated 3 years ago
- ☆15Jun 26, 2024Updated 2 years ago
- A benchmark suite for Graph Machine Learning☆18Oct 8, 2024Updated 2 years ago
- Reading seminar in Harvard Cloud Networking and Systems Group☆16Aug 29, 2022Updated 4 years ago
- ☆17May 10, 2024Updated 2 years ago
- SpotServe: Serving Generative Large Language Models on Preemptible Instances☆138Feb 22, 2024Updated 2 years ago
- Code for MLSys 2024 Paper "SiDA-MoE: Sparsity-Inspired Data-Aware Serving for Efficient and Scalable Large Mixture-of-Experts Models"☆23Apr 13, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- EuroSys '24: "Trinity: A Fast Compressed Multi-attribute Data Store"☆18Mar 8, 2025Updated last year
- [ASPLOS'26] Taming the Long-Tail: Efficient Reasoning RL Training with Adaptive Drafter☆186Feb 27, 2026Updated 8 months ago
- ☆11Nov 14, 2023Updated 2 years ago
- Official Repo for paper "VLCache: Computing 2% Vision Tokens and Reusing 98% for Vision-Language Inference"☆16Mar 28, 2026Updated 7 months ago
- Aalo: Efficient Non-Clairvoyant Coflow Scheduler☆13Nov 22, 2015Updated 10 years ago
- A universal workflow system for exactly-once DAGs☆23Jun 1, 2023Updated 3 years ago
- Github repo backing website for the CS Assistant Professor Handbook☆28Aug 28, 2024Updated 2 years ago
- Code repository for the SOSP'25 paper DCP: Addressing Input Dynamism In Long-Context Training via Dynamic Context Parallelism.☆23Nov 28, 2025Updated 11 months ago
- [ECCV 2026] VideoScience-Bench: Benchmarking Scientific Reasoning in Video Generations☆12Feb 13, 2026Updated 8 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆14Jan 15, 2026Updated 9 months ago
- ☆13Feb 22, 2023Updated 3 years ago
- ☆69Dec 3, 2024Updated last year
- Efficient and easy multi-instance LLM serving☆561Mar 12, 2026Updated 7 months ago
- ☆20Dec 4, 2025Updated 10 months ago
- Daily Arxiv Papers on LLM Systems☆84Updated this week
- SwiftRDMA -- Exposing RDMA NIC Resources for Software-Defined RDMA Scheduling☆55Jun 9, 2026Updated 4 months ago