[EMNLP 2025π₯] UNComp: Can Matrix Entropy Uncover Sparsity? -- A Compressor Design from an Uncertainty-Aware Perspective
β20Jan 7, 2026Updated 6 months ago
Alternatives and similar repositories for UNComp
Users that are interested in UNComp are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ICLR2026π₯Oral] SwingArena: Competitive Programming Arena for Long-context GitHub Issue Solvingβ15Feb 26, 2026Updated 4 months ago
- β13Jun 26, 2024Updated 2 years ago
- [ICML 2025π₯] ParallelComp: Parallel Long-Context Compressor for Length Extrapolationβ30Jun 16, 2025Updated last year
- β11May 18, 2025Updated last year
- [EMNLP 2025 Findings] Familiarity-aware Evidence Compression for Retrieval Augmented Generationβ15Aug 20, 2025Updated 11 months ago
- Open source password manager - Proton Pass β’ AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- [NAACL 2025π₯] MEDA: Dynamic KV Cache Allocation for Efficient Multimodal Long-Context Inferenceβ22Jun 19, 2025Updated last year
- Source code of paper ''KVSharer: Efficient Inference via Layer-Wise Dissimilar KV Cache Sharing''β31Oct 24, 2024Updated last year
- [ICLR 2025] Official implementation of paper "Dynamic Low-Rank Sparse Adaptation for Large Language Models".β25Mar 16, 2025Updated last year
- Algorithm-System Co-design: accurate and efficient 2-bit KV cache quantization for LLM Inference.β17May 20, 2026Updated 2 months ago
- Code for Paper 'DelTA: Discriminative Token Credit Assignment for Reinforcement Learning from Verifiable Rewards'β17May 21, 2026Updated 2 months ago
- AdaSkip: Adaptive Sublayer Skipping for Accelerating Long-Context LLM Inferenceβ21Jan 24, 2025Updated last year
- Code for ICML21 paper "Learning Self-Modulating Attention in Continuous Time Space with Applications to Sequential Recommendation"β12Feb 8, 2023Updated 3 years ago
- My Implementation of Q-Sparse: All Large Language Models can be Fully Sparsely-Activatedβ37Aug 14, 2024Updated last year
- Video Summarization Transformer: Implementation in PyTorch of the Transformer model for video summarisationβ10Oct 27, 2020Updated 5 years ago
- Managed Kubernetes at scale on DigitalOcean β’ AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- [ICLR 2025π₯] D2O: Dynamic Discriminative Operations for Efficient Long-Context Inference of Large Language Modelsβ27Jul 7, 2025Updated last year
- [ACL 2026 Main] Official Repo for Paper "Which Reasoning Trajectories Teach Students to Reason Better? A Simple Metric of Informative Aliβ¦β17Jul 1, 2026Updated 2 weeks ago
- Official repository of paper "Parameters vs. Context: Fine-Grained Control of Knowledge Reliance in Language Models"β26May 27, 2025Updated last year
- Self-Distribution BNNβ10Mar 8, 2022Updated 4 years ago
- β19Nov 3, 2025Updated 8 months ago
- β15Oct 7, 2024Updated last year
- Code for NeurIPS 2019 paper "Screening Sinkhorn Algorithm for Regularized Optimal Transport"β10Feb 10, 2020Updated 6 years ago
- A transformer model that should be able to solve a simple NER taskβ11Mar 7, 2019Updated 7 years ago
- [ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)β164Jul 8, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer β’ AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- β13Dec 10, 2018Updated 7 years ago
- [ICML'25] Our study systematically investigates massive values in LLMs' attention mechanisms. First, we observe massive values are concenβ¦β87Jun 20, 2025Updated last year
- Unleashing Reasoning in Medical Large Language Modelsβ12Mar 19, 2025Updated last year
- The official code implementation for paper "PM-KVQ: Progressive Mixed-precision KV Cache Quantization for Long-CoT LLMs"β29May 24, 2025Updated last year
- The original Shared Recurrent Memory Transformer implementationβ36Jul 11, 2025Updated last year
- [ICLR 2025] Large (Vision) Language Models are Unsupervised In-Context Learnersβ22Jun 6, 2025Updated last year
- This repository presents the source code for the paper "MILLION: Mastering Long-Context LLM Inference Via Outlier-Immunized KV Product Quβ¦β25Apr 2, 2025Updated last year
- Adaptive Topology Reconstruction for Robust Graph Representation Learning [Efficient ML Model]β10Feb 11, 2025Updated last year
- [ICLR25] Official Implementation of "Decoupling Angles and Strength in Low-rank Adaptation"β15Dec 12, 2025Updated 7 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer β’ AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Official python implementation for ICML 2024: "Learning Solution-Aware Transformers for Efficiently Solving Quadratic Assignment Problem"β17Jul 1, 2024Updated 2 years ago
- [CIKM-21] Pytorch implementation of LiteGT: Efficient and Lightweight Graph Transformersβ12Nov 16, 2021Updated 4 years ago
- Implementation of EMNLP Oral Paper: InfoGain-RAG: Boosting Retrieval-Augmented Generation through Document Information Gain-based Rerankiβ¦β18Sep 17, 2025Updated 10 months ago
- β15Apr 12, 2024Updated 2 years ago
- ReDiffuser: Reliable Decision-Making Using a Diffuser with Confidence Estimationβ15Jun 2, 2024Updated 2 years ago
- β17Oct 22, 2020Updated 5 years ago
- β35Jun 3, 2025Updated last year