Dynamic Context Selection for Efficient Long-Context LLMs
☆56May 20, 2025Updated 9 months ago
Alternatives and similar repositories for OmniKV
Users that are interested in OmniKV are comparing it to the libraries listed below
Sorting:
- ArkVale: Efficient Generative LLM Inference with Recallable Key-Value Eviction (NIPS'24)☆53Dec 17, 2024Updated last year
- [NeurIPS 2025 Spotlight] A Token is Worth over 1,000 Tokens: Efficient Knowledge Distillation through Low-Rank Clone.☆46Oct 29, 2025Updated 4 months ago
- Intepretability method to find what navigation agents learn☆19Jun 16, 2022Updated 3 years ago
- ☆20Jun 9, 2025Updated 9 months ago
- Code for the preprint "Cache Me If You Can: How Many KVs Do You Need for Effective Long-Context LMs?"☆48Jul 29, 2025Updated 7 months ago
- [ACL 2025] Squeezed Attention: Accelerating Long Prompt LLM Inference☆57Nov 20, 2024Updated last year
- logboard: Monitor and Compare Logs on Browser/Terminal.☆21Sep 19, 2019Updated 6 years ago
- ☆19Sep 24, 2025Updated 5 months ago
- ☆47Nov 25, 2024Updated last year
- Quiz code of debugging a badly-implemented neural network☆22Dec 19, 2018Updated 7 years ago
- ☆19Feb 6, 2019Updated 7 years ago
- ☆47Jun 27, 2024Updated last year
- Getting Starting with NIMBUS-CORE☆10Dec 16, 2023Updated 2 years ago
- Dataset for Visually Indicated Sound Generation by Perceptually Optimized Classification☆22Apr 6, 2020Updated 5 years ago
- A simple but well-performing "single-hop" visual attention model for the GQA dataset☆20Aug 8, 2019Updated 6 years ago
- Distributed Bayesian Optimization☆23Jun 29, 2020Updated 5 years ago
- Artifact for "Apparate: Rethinking Early Exits to Tame Latency-Throughput Tensions in ML Serving" [SOSP '24]☆24Nov 21, 2024Updated last year
- InfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache Management (OSDI'24)☆179Jul 10, 2024Updated last year
- quick playground to animate pippin☆15Nov 11, 2024Updated last year
- [ICML 2025] |TokenSwift: Lossless Acceleration of Ultra Long Sequence Generation☆122May 19, 2025Updated 9 months ago
- A framework for building large-scale, deterministic, interactive workflows with a fault-tolerant, conversational UX☆45Feb 28, 2026Updated last week
- Comparison of Variational Autoencoders with Bayesian Neural Networks. Accuracy, Latent space, Reconstruction and White Noise filtering.☆28Feb 16, 2018Updated 8 years ago
- [DAC'25] Official implement of "HybriMoE: Hybrid CPU-GPU Scheduling and Cache Management for Efficient MoE Inference"☆102Dec 15, 2025Updated 2 months ago
- Official Repository: A Comprehensive Benchmark for Logical Reasoning in MLLMs☆45Jun 17, 2025Updated 8 months ago
- Supporting code for ReCEval paper☆31Sep 14, 2024Updated last year
- This is the implementation for the paper "LARGE LANGUAGE MODEL CASCADES WITH MIX- TURE OF THOUGHT REPRESENTATIONS FOR COST- EFFICIENT REA…☆31Jun 1, 2024Updated last year
- Next-Toggle is just a simple plug and use, theme toggle button with multiple light and dark themes.☆11May 9, 2024Updated last year
- ☆83Oct 9, 2024Updated last year
- [SIGMOD 2025] PQCache: Product Quantization-based KVCache for Long Context LLM Inference☆83Dec 7, 2025Updated 3 months ago
- Referring Expression Object Segmentation with Caption-Aware Consistency, BMVC 2019☆31Apr 21, 2021Updated 4 years ago
- Code for CVPR'18 "Grounding Referring Expressions in Images by Variational Context"☆30Jul 4, 2018Updated 7 years ago
- commandline epub reader using python/curses☆29Aug 26, 2020Updated 5 years ago
- ☆150Oct 9, 2024Updated last year
- ☆13Jan 28, 2026Updated last month
- Official Implementation for [ICLR26] DefensiveKV: Taming the Fragility of KV Cache Eviction in LLM Inference☆22Feb 9, 2026Updated last month
- [ICLR 2026] ParallelBench: Understanding the Tradeoffs of Parallel Decoding in Diffusion LLMs☆42Updated this week
- ☆33Oct 8, 2020Updated 5 years ago
- BISON: Binary Image SelectiON☆49Sep 15, 2021Updated 4 years ago
- This is the official training code of OmniSVG☆30Jan 19, 2026Updated last month