[ACM MM 2025 Oral] TinyServe: Query-Aware Page Allocation Optimization
☆11Oct 26, 2026Updated last week
Alternatives and similar repositories for tinyserve-vllm
Users that are interested in tinyserve-vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A Collection for Distributed Reinforcement Learning Papers☆18Sep 24, 2025Updated last year
- FastCache: Fast Caching for Diffusion Transformer Through Learnable Linear Approximation [Efficient ML Model]☆53Aug 2, 2026Updated 3 months ago
- PiKV: KV Cache Management System for Mixture of Experts [Efficient ML System]☆66Oct 21, 2026Updated 2 weeks ago
- A Serving System for Distributed and Parallel LLM Quantization [Efficient ML System]☆26Jun 18, 2025Updated last year
- GraphSnapShot: Caching Local Structure for Fast Graph Learning [Efficient ML System]☆41Apr 5, 2026Updated 7 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- [FPGA'26 Best Paper Nomination] CXL-SpecKV: A Disaggregated FPGA Speculative KV-Cache for Datacenter LLM Serving☆45Aug 7, 2026Updated 3 months ago
- DuoDecoding: Hardware-aware Heterogeneous Speculative Decoding with Dynamic Multi-Sequence Drafting☆20Mar 4, 2025Updated last year
- Adaptive Topology Reconstruction for Robust Graph Representation Learning [Efficient ML Model]☆10Feb 11, 2025Updated last year
- Accelerating Multitask Training Trough Adaptive Transition [Efficient ML Model]☆12May 23, 2025Updated last year
- Topology-based Particle Tracking for fast and high resolution 3D motion tracking☆12Jan 31, 2023Updated 3 years ago
- Source code for "Latent Plan Transformer for Trajectory Abstraction: Planning as Latent Space Inference." In NeurIPS 2024☆22Dec 1, 2024Updated last year
- AVPipe :-)☆12Jul 16, 2021Updated 5 years ago
- tmp DPI☆14Dec 18, 2024Updated last year
- ☆11Jul 28, 2021Updated 5 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Efficient Foundation Model Design: A Perspective From Model and System Co-Design [Efficient ML System & Model]☆31Feb 23, 2025Updated last year
- [ICML 2025] Reward-guided Speculative Decoding (RSD) for efficiency and effectiveness.☆58May 2, 2025Updated last year
- A basic deep learning library, comparable to a very minimal version of PyTorch.☆21Mar 1, 2023Updated 3 years ago
- LLM-Aided FPGA Design for Signal Processing Applications☆35Jun 4, 2025Updated last year
- ☆48Mar 3, 2024Updated 2 years ago
- PNG encoder, implemented in VHDL☆24Mar 30, 2024Updated 2 years ago
- [CVPR 2025] PVC: Progressive Visual Token Compression for Unified Image and Video Processing in Large Vision-Language Models☆54Jun 12, 2025Updated last year
- Pytorch implementation of our paper accepted by ICML 2024 -- CaM: Cache Merging for Memory-efficient LLMs Inference☆51Jun 19, 2024Updated 2 years ago
- The official implementation of paper: SimLayerKV: A Simple Framework for Layer-Level KV Cache Reduction.☆55Oct 18, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- 3D motion planning for drones using A* search.☆84Apr 21, 2021Updated 5 years ago
- Easy control for Key-Value Constrained Generative LLM Inference(https://arxiv.org/abs/2402.06262)☆62Feb 13, 2024Updated 2 years ago
- Explorations into some recent techniques surrounding speculative decoding☆308Dec 22, 2024Updated last year
- ☆10Nov 9, 2023Updated 2 years ago
- ☆11Nov 16, 2024Updated last year
- Mixture-of-Basis-Experts for Compressing MoE-based LLMs☆41Dec 24, 2025Updated 10 months ago
- Official implementation of the paper "Harnessing the Spatial-Temporal Attention of Diffusion Models for High-Fidelity Text-to-Image Synth…☆94Oct 2, 2023Updated 3 years ago
- Linear-Speed Vertex Cache Optimization☆64Oct 17, 2017Updated 9 years ago
- Official code repository for the paper: Removing Structured Noise using Diffusion Models☆26Mar 23, 2025Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Implementation of Speculative Sampling as described in "Accelerating Large Language Model Decoding with Speculative Sampling" by Deepmind☆111Feb 29, 2024Updated 2 years ago
- Quantization of LLMs and benchmarking.☆10Apr 3, 2024Updated 2 years ago
- ☆11Jul 27, 2025Updated last year
- Wholebody teleoperation system using PiPER and RANGER MINI 3.0☆12Feb 3, 2026Updated 9 months ago
- ☆12May 15, 2023Updated 3 years ago
- [ACM MM25] MCA-LLaVA: Manhattan Causal Attention for Reducing Hallucination in Large Vision-Language Models☆14Aug 8, 2025Updated last year
- Experimental adapter for fine-tuning Qwen3-VL as a Vision-Language-Action (VLA) model☆15Dec 21, 2025Updated 10 months ago