Alternatives and similar repositories for LightTrans

Users that are interested in LightTrans are comparing it to the libraries listed below

• sail-sg / ActivePRM
  ☆15Updated 3 weeks ago
• OpenSparseLLMs / Linearization
  ☆39Updated last month
• OpenSparseLLMs / MoM
  ☆78Updated 3 weeks ago
• horseee / CoT-Valve
  CoT-Valve: Length-Compressible Chain-of-Thought Tuning
  ☆67Updated 2 months ago
• sail-sg / SimLayerKV
  The official implementation of paper: SimLayerKV: A Simple Framework for Layer-Level KV Cache Reduction.
  ☆45Updated 6 months ago
• sail-sg / Cheating-LLM-Benchmarks
  [ICLR 2025] Cheating Automatic LLM Benchmarks: Null Models Achieve High Win Rates (Oral)
  ☆77Updated 6 months ago
• JayZhang42 / SLED
  SLED: Self Logits Evolution Decoding for Improving Factuality in Large Language Model https://arxiv.org/pdf/2411.02433
  ☆25Updated 5 months ago
• John-AI-Lab / Unnatural_Language
  The official repository of 'Unnatural Language Are Not Bugs but Features for LLMs'
  ☆17Updated 2 months ago
• decoding-comp-trust / comp-trust
  Codebase for decoding compressed trust.
  ☆23Updated last year
• OpenSparseLLMs / Linear-MoE
  ☆82Updated this week
• sail-sg / LongSpec
  LongSpec: Long-Context Speculative Decoding with Efficient Drafting and Verification
  ☆52Updated 2 months ago
• Zanette-Labs / SpeculativeRejection
  [NeurIPS 2024] Fast Best-of-N Decoding via Speculative Rejection
  ☆44Updated 6 months ago
• uservan / ThinkPO
  ☆20Updated 2 months ago
• GeniusHTX / TALE
  ☆99Updated last week
• mathllm / Step-Controlled_DPO
  ☆22Updated 10 months ago
• uservan / speculative_thinking
  ☆16Updated last month
• SempraETY / Pruning-via-Merging
  ☆18Updated 5 months ago
• zzwjames / FailureLLMUnlearning
  An official implementation of "Catastrophic Failure of LLM Unlearning via Quantization" (ICLR 2025)
  ☆26Updated 2 months ago
• MikaStars39 / StableMask
  PyTorch implementation of StableMask (ICML'24)
  ☆12Updated 10 months ago
• sail-sg / Attention-Sink
  [ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)
  ☆72Updated 6 months ago
• bethgelab / sober-reasoning
  Code for "A Sober Look at Progress in Language Model Reasoning" paper
  ☆45Updated this week
• Shwai-He / MEO
  The source code of "Merging Experts into One: Improving Computational Efficiency of Mixture of Experts (EMNLP 2023)":
  ☆37Updated last year
• ArminAzizi98 / LaMDA
  ☆15Updated 6 months ago
• hemingkx / TokenSkip
  TokenSkip: Controllable Chain-of-Thought Compression in LLMs
  ☆138Updated last month
• Infini-AI-Lab / S2FT
  ☆17Updated 4 months ago
• KbsdJames / omni-math-rule
  The rule-based evaluation subset and code implementation of Omni-MATH
  ☆21Updated 4 months ago
• ShiZhengyan / InstructionModelling
  [NeurIPS 2024 Main Track] Code for the paper titled "Instruction Tuning With Loss Over Instructions"
  ☆36Updated 11 months ago
• Raibows / CREAM
  Code for "CREAM: Consistency Regularized Self-Rewarding Language Models", ICLR 2025.
  ☆21Updated 2 months ago
• haonan3 / V1
  V1: Toward Multimodal Reasoning by Designing Auxiliary Task
  ☆34Updated 3 weeks ago
• GATECH-EIC / ACT
  [ICML 2024] Unveiling and Harnessing Hidden Attention Sinks: Enhancing Large Language Models without Training through Attention Calibrati…
  ☆37Updated 10 months ago