sail-sg / LightTransLinks
The official implementation of "LightTransfer: Your Long-Context LLM is Secretly a Hybrid Model with Effortless Adaptation"
☆20Updated last month
Alternatives and similar repositories for LightTrans
Users that are interested in LightTrans are comparing it to the libraries listed below
Sorting:
- ☆15Updated last month
- CoT-Valve: Length-Compressible Chain-of-Thought Tuning☆69Updated 3 months ago
- ☆83Updated last month
- ☆47Updated 2 months ago
- A Sober Look at Language Model Reasoning☆63Updated last week
- Optimizing Anytime Reasoning via Budget Relative Policy Optimization☆36Updated last week
- Code for ICLR 2025 Paper "What is Wrong with Perplexity for Long-context Language Modeling?"☆81Updated 3 weeks ago
- [ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)☆85Updated 7 months ago
- ☆95Updated 2 weeks ago
- The official repo of SynLogic: Synthesizing Verifiable Reasoning Data at Scale for Learning Logical Reasoning and Beyond☆102Updated this week
- LongSpec: Long-Context Speculative Decoding with Efficient Drafting and Verification☆54Updated 3 months ago
- ☆24Updated 2 months ago
- The official implementation for Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Free☆40Updated 3 weeks ago
- This is the official repo of "QuickLLaMA: Query-aware Inference Acceleration for Large Language Models"☆51Updated 10 months ago
- Fira: Can We Achieve Full-rank Training of LLMs Under Low-rank Constraint?☆107Updated 7 months ago
- V1: Toward Multimodal Reasoning by Designing Auxiliary Task☆34Updated last month
- Long Context Extension and Generalization in LLMs☆56Updated 8 months ago
- TokenSkip: Controllable Chain-of-Thought Compression in LLMs☆147Updated 2 months ago
- SLED: Self Logits Evolution Decoding for Improving Factuality in Large Language Model https://arxiv.org/pdf/2411.02433☆25Updated 6 months ago
- The official implementation of paper: SimLayerKV: A Simple Framework for Layer-Level KV Cache Reduction.☆46Updated 7 months ago
- ACL'2025: SoftCoT: Soft Chain-of-Thought for Efficient Reasoning with LLMs. and preprint: SoftCoT++: Test-Time Scaling with Soft Chain-of…☆21Updated last week
- Code for "Everybody Prune Now: Structured Pruning of LLMs with only Forward Passes"☆28Updated last year
- ☆107Updated 2 weeks ago
- Open-Pandora: On-the-fly Control Video Generation☆34Updated 6 months ago
- ☆89Updated last week
- [NAACL 2025] A Closer Look into Mixture-of-Experts in Large Language Models☆52Updated 3 months ago
- The Entropy Mechanism of Reinforcement Learning for Large Language Model Reasoning.☆103Updated this week
- paper list, tutorial, and nano code snippet for Diffusion Large Language Models.☆51Updated this week
- Laser: Learn to Reason Efficiently with Adaptive Length-based Reward Shaping☆41Updated 2 weeks ago
- ☆19Updated 3 months ago