NUS-HPC-AI-Lab / Helen
The official implementation of "Helen: Optimizing CTR Prediction Models with Frequency-wise Hessian Eigenvalue Regularization"
☆16Updated last year
Alternatives and similar repositories for Helen:
Users that are interested in Helen are comparing it to the libraries listed below
- [NeurIPS 2024] Official code of $\beta$-DPO: Direct Preference Optimization with Dynamic $\beta$☆41Updated 5 months ago
- ThinK: Thinner Key Cache by Query-Driven Pruning☆18Updated last month
- Less is More: Task-aware Layer-wise Distillation for Language Model Compression (ICML2023)☆34Updated last year
- This package implements THOR: Transformer with Stochastic Experts.☆62Updated 3 years ago
- ☆125Updated 8 months ago
- ☆36Updated 7 months ago
- [NeurIPS 2023] Model-enhanced Vector Index☆25Updated 10 months ago
- [AAAI 2024] Fluctuation-based Adaptive Structured Pruning for Large Language Models☆45Updated last year
- The Official Implementation of Ada-KV: Optimizing KV Cache Eviction by Adaptive Budget Allocation for Efficient LLM Inference☆68Updated 2 months ago
- SepLLM: Accelerate Large Language Models by Compressing One Segment into One Separator☆64Updated 3 months ago
- ☆17Updated last month
- [NeurIPS 2022] DreamShard: Generalizable Embedding Table Placement for Recommender Systems☆29Updated 2 years ago
- [ICLR 2024 Spotlight] Code for the paper "Merge, Then Compress: Demystify Efficient SMoE with Hints from Its Routing Policy"☆77Updated 9 months ago
- Accepted LLM Papers in NeurIPS 2024☆34Updated 5 months ago
- This pytorch package implements PLATON: Pruning Large Transformer Models with Upper Confidence Bound of Weight Importance (ICML 2022).☆43Updated 2 years ago
- [NeurIPS 2024] The implementation of paper "On Softmax Direct Preference Optimization for Recommendation"☆65Updated 4 months ago
- ☆50Updated 10 months ago
- ☆18Updated 5 months ago
- The source code of "Merging Experts into One: Improving Computational Efficiency of Mixture of Experts (EMNLP 2023)":☆36Updated 11 months ago
- LongSpec: Long-Context Speculative Decoding with Efficient Drafting and Verification☆42Updated last month
- ☆61Updated 4 months ago
- ☆30Updated 6 months ago
- ☆22Updated 8 months ago
- ☆73Updated 2 weeks ago
- [ICLR 2025] PEARL: Parallel Speculative Decoding with Adaptive Draft Length☆67Updated 3 weeks ago
- Official implementation for Yuan & Liu & Zhong et al., KV Cache Compression, But What Must We Give in Return? A Comprehensive Benchmark o…☆69Updated last month
- PyTorch implementation of paper "Response Length Perception and Sequence Scheduling: An LLM-Empowered LLM Inference Pipeline".☆85Updated last year
- ☆50Updated last year
- The official repository of "Improving Large Language Models via Fine-grained Reinforcement Learning with Minimum Editing Constraint"☆37Updated last year
- [NAACL 2025] A Closer Look into Mixture-of-Experts in Large Language Models☆46Updated last month