☆24Mar 3, 2026Updated 7 months ago
Alternatives and similar repositories for JITServe
Users that are interested in JITServe are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- BlitzScale Router - Distributed LLM Inference Router (Rust)☆17May 25, 2026Updated 5 months ago
- Service-aware KV-cache compression for bandwidth-efficient disaggregated LLM serving.☆32Updated this week
- [EuroSys27] TokenCake: A KV-Cache-centric Serving Framework for LLM-based Multi-Agent Applications☆14Oct 14, 2026Updated last week
- A scheduling framework for multitasking over diverse XPUs, including GPUs, NPUs, ASICs, and FPGAs☆14Jun 17, 2026Updated 4 months ago
- ☆27May 31, 2023Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- THC: Accelerating Distributed Deep Learning Using Tensor Homomorphic Compression☆20Jul 30, 2024Updated 2 years ago
- ☆21May 11, 2026Updated 5 months ago
- Compression for Foundation Models☆40Jul 21, 2025Updated last year
- Encrypted Traffic Classification at Line Rate in Programmable Switches with Machine Learning☆22Feb 2, 2026Updated 8 months ago
- Learn matrix-matrix multiplication optimization in C++ through progressively optimized DGEMM implementations, from naïve algorithms to AV…☆25Jan 15, 2025Updated last year
- Artifact evaluation repo for EuroSys'24.☆30Nov 7, 2023Updated 2 years ago
- ☆42Nov 5, 2023Updated 2 years ago
- Official repository for the paper DynaPipe: Optimizing Multi-task Training through Dynamic Pipelines☆19Dec 8, 2023Updated 2 years ago
- Open-source implementation for "Helix: Serving Large Language Models over Heterogeneous GPUs and Network via Max-Flow"☆98Oct 15, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Dirigent: Lightweight Serverless Orchestration☆46Aug 26, 2025Updated last year
- Official Repo for paper "VLCache: Computing 2% Vision Tokens and Reusing 98% for Vision-Language Inference"☆16Mar 28, 2026Updated 6 months ago
- ☆19Jun 14, 2026Updated 4 months ago
- Artifact for "Apparate: Rethinking Early Exits to Tame Latency-Throughput Tensions in ML Serving" [SOSP '24]☆25Nov 21, 2024Updated last year
- Breakable CUDA graph capture for PyTorch - capture compatible regions as CUDA graphs while running incompatible operations eagerly betwee…☆29Oct 8, 2026Updated 2 weeks ago
- Preview Code for Continuum Paper☆112Aug 13, 2026Updated 2 months ago
- COSE: Configuring Serverless Functions using Statistical Learning☆10Jun 28, 2023Updated 3 years ago
- Source code for the Information Sciences paper "Rumor Detection on Social Media through Mining the Social Circles with High Homogeneity"☆22Jun 10, 2023Updated 3 years ago
- official code for GliDe with a CaPE☆21Aug 13, 2024Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆19Sep 26, 2026Updated last month
- [ICML 2026] Official implementation of "FOCUS: DLLMs Know How to Tame Their Compute Bound".☆19Aug 2, 2026Updated 2 months ago
- ☆10Nov 20, 2024Updated last year
- Reduce the training time of CNNs by leveraging the power of multiple GPUs in 2 approaches, Multi-workers & Parameter Sever Training using…☆12Sep 26, 2022Updated 4 years ago
- ☆18Feb 24, 2026Updated 8 months ago
- PaperHelper: Knowledge-Based LLM QA Paper Reading Assistant with Reliable References☆22Jun 13, 2024Updated 2 years ago
- Accelerating Large-Scale Reasoning Model Inference with Sparse Self-Speculative Decoding☆122Dec 2, 2025Updated 10 months ago
- A Distributed Analysis and Benchmarking Framework for Apache OpenWhisk Serverless Platform☆12Dec 11, 2018Updated 7 years ago
- This artifact accompanies the paper 'Pronghorn: Effective Checkpoint Orchestration for Serverless Hot-Starts,' which has been accepted fo…☆22Nov 8, 2023Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- TradeTrust Electronic Bill of Lading (eBL) Smart Contracts☆14Jun 21, 2024Updated 2 years ago
- ☆12May 19, 2025Updated last year
- NS3 Network routing simulation. SJTU CS339 Project☆11Dec 7, 2018Updated 7 years ago
- [ICLR2025] Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding☆161Dec 4, 2024Updated last year
- Surrogate-based Hyperparameter Tuning System☆30Jun 29, 2023Updated 3 years ago
- Code for MLSys 2024 Paper "SiDA-MoE: Sparsity-Inspired Data-Aware Serving for Efficient and Scalable Large Mixture-of-Experts Models"☆23Apr 13, 2024Updated 2 years ago
- ☆45Nov 15, 2022Updated 3 years ago