sail-sg / LightTrans
The official implementation of "LightTransfer: Your Long-Context LLM is Secretly a Hybrid Model with Effortless Adaptation"
☆17Updated last month
Alternatives and similar repositories for LightTrans:
Users that are interested in LightTrans are comparing it to the libraries listed below
- ☆11Updated this week
- [ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)☆64Updated 6 months ago
- Code for "A Sober Look at Progress in Language Model Reasoning" paper☆33Updated this week
- Codebase for decoding compressed trust.☆23Updated 11 months ago
- V1: Toward Multimodal Reasoning by Designing Auxiliary Task☆31Updated last week
- (ICLR2025 Spotlight) DEEM: Official implementation of Diffusion models serve as the eyes of large language models for image perception.☆27Updated last month
- [ICLR 2025] Cheating Automatic LLM Benchmarks: Null Models Achieve High Win Rates (Oral)☆76Updated 5 months ago
- Code for ICLR 2025 Paper "What is Wrong with Perplexity for Long-context Language Modeling?"☆51Updated 3 weeks ago
- The repository of the paper "REEF: Representation Encoding Fingerprints for Large Language Models," aims to protect the IP of open-source…☆41Updated 3 months ago
- An official implementation of "Catastrophic Failure of LLM Unlearning via Quantization" (ICLR 2025)☆26Updated last month
- The official repository of 'Unnatural Language Are Not Bugs but Features for LLMs'☆15Updated last month
- CoT-Valve: Length-Compressible Chain-of-Thought Tuning☆65Updated 2 months ago
- [ICML 2024] Unveiling and Harnessing Hidden Attention Sinks: Enhancing Large Language Models without Training through Attention Calibrati…☆36Updated 9 months ago
- LongSpec: Long-Context Speculative Decoding with Efficient Drafting and Verification☆45Updated last month
- [NAACL 2025 Oral] Multimodal Needle in a Haystack (MMNeedle): Benchmarking Long-Context Capability of Multimodal Large Language Models☆41Updated last month
- SLED: Self Logits Evolution Decoding for Improving Factuality in Large Language Model https://arxiv.org/pdf/2411.02433☆26Updated 4 months ago
- ☆74Updated last month
- ☆39Updated last month
- ☆20Updated last month
- Official code for SEAL: Steerable Reasoning Calibration of Large Language Models for Free☆14Updated 2 weeks ago
- [NeurIPS 2024 Spotlight] EMR-Merging: Tuning-Free High-Performance Model Merging☆56Updated last month
- ☆75Updated this week
- SIFT: Grounding LLM Reasoning in Contexts via Stickers☆56Updated last month
- 🚀 LLaMA-MoE v2: Exploring Sparsity of LLaMA from Perspective of Mixture-of-Experts with Post-Training☆80Updated 4 months ago
- ☆17Updated 3 months ago
- ☆22Updated 9 months ago
- NoisyRollout: Reinforcing Visual Reasoning with Data Augmentation☆27Updated this week
- This is the official repo of "QuickLLaMA: Query-aware Inference Acceleration for Large Language Models"☆48Updated 9 months ago
- ☆18Updated 2 weeks ago
- ☆18Updated 6 months ago