☆34Jun 22, 2024Updated 2 years ago
Alternatives and similar repositories for InferCept
Users that are interested in InferCept are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Resource Multiplexing in Tuning and Serving Large Language Models (USENIX ATC 2025)☆10Apr 21, 2026Updated 6 months ago
- OSWorld-Human: Benchmarking the Efficiency of Computer-Use Agents☆33May 17, 2026Updated 6 months ago
- Stateful LLM Serving☆111Mar 11, 2025Updated last year
- Multi-Faceted AI Agent and Workflow Autotuning. Automatically optimizes LangChain, LangGraph, DSPy programs for better quality, lower exe…☆279May 16, 2025Updated last year
- Paper-reading notes for Berkeley OS prelim exam.☆14Aug 28, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Artifact for "Apparate: Rethinking Early Exits to Tame Latency-Throughput Tensions in ML Serving" [SOSP '24]☆25Nov 21, 2024Updated last year
- APEX+ is an LLM Serving Simulator☆51Jun 16, 2025Updated last year
- 上海交通大学软件学院课程操作系统(SE3357)笔记☆11Nov 13, 2022Updated 4 years ago
- QuantumDNA is an open-source Python package for simulating exciton and charge transfer in DNA using quantum mechanical methods. Designed …☆13Sep 23, 2026Updated last month
- ☆19May 4, 2023Updated 3 years ago
- ☆136Nov 11, 2024Updated 2 years ago
- ☆28Jun 1, 2021Updated 5 years ago
- NVIDIA Linux open GPU with P2P support☆12Aug 2, 2026Updated 3 months ago
- An LLM inference engine, written in C++☆20Mar 30, 2026Updated 7 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable☆228Oct 14, 2026Updated last month
- ☆11Oct 16, 2022Updated 4 years ago
- ☆10Oct 17, 2021Updated 5 years ago
- The official implementation for the paper 'mmSampler: Efficient Frame Sampler for Multimodal Video Retrieval'.☆11Aug 23, 2022Updated 4 years ago
- Serverless Paper Reading and Discussion☆37Jan 9, 2023Updated 3 years ago
- ☆15Jun 26, 2024Updated 2 years ago
- A benchmark suite for Graph Machine Learning☆18Oct 8, 2024Updated 2 years ago
- Official PyTorch implementation of "Q-Palette: Fractional-Bit Quantizers Toward Optimal Bit Allocation for Efficient LLM Deployment" (Neu…☆12Jan 22, 2026Updated 9 months ago
- Reading seminar in Harvard Cloud Networking and Systems Group☆16Aug 29, 2022Updated 4 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- PoC for "SpecReason: Fast and Accurate Inference-Time Compute via Speculative Reasoning" [NeurIPS '25]☆77Oct 2, 2025Updated last year
- ☆17May 10, 2024Updated 2 years ago
- SpotServe: Serving Generative Large Language Models on Preemptible Instances☆140Feb 22, 2024Updated 2 years ago
- EuroSys '24: "Trinity: A Fast Compressed Multi-attribute Data Store"☆18Mar 8, 2025Updated last year
- [ASPLOS'26] Taming the Long-Tail: Efficient Reasoning RL Training with Adaptive Drafter☆187Feb 27, 2026Updated 8 months ago
- Code for MLSys 2024 Paper "SiDA-MoE: Sparsity-Inspired Data-Aware Serving for Efficient and Scalable Large Mixture-of-Experts Models"☆23Apr 13, 2024Updated 2 years ago
- Official Repo for paper "VLCache: Computing 2% Vision Tokens and Reusing 98% for Vision-Language Inference"☆16Mar 28, 2026Updated 7 months ago
- Aalo: Efficient Non-Clairvoyant Coflow Scheduler☆13Nov 22, 2015Updated 10 years ago
- ☆11Nov 14, 2023Updated 3 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- xRouter: Training Cost-Aware LLMs Orchestration System via Reinforcement Learning☆35Jun 2, 2026Updated 5 months ago
- AlpaServe: Statistical Multiplexing with Model Parallelism for Deep Learning Serving (OSDI 23)☆94Jul 14, 2023Updated 3 years ago
- A universal workflow system for exactly-once DAGs☆23Jun 1, 2023Updated 3 years ago
- This is the user space repo for famfs, the fabric-attached memory file system☆12Nov 11, 2026Updated last week
- JellyBean prototype☆10Sep 28, 2022Updated 4 years ago
- Transferable learning of reaction pathways☆10Sep 9, 2025Updated last year
- Official Repo for "SplitQuant / LLM-PQ: Resource-Efficient LLM Offline Serving on Heterogeneous GPUs via Phase-Aware Model Partition and …☆41Aug 29, 2025Updated last year
Are these results useful?