Alternatives and similar repositories for LightTrans:

Users that are interested in LightTrans are comparing it to the libraries listed below

• sail-sg / Attention-Sink
  [ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)
  ☆54Updated 5 months ago
• sail-sg / Cheating-LLM-Benchmarks
  [ICLR 2025] Cheating Automatic LLM Benchmarks: Null Models Achieve High Win Rates (Oral)
  ☆74Updated 5 months ago
• zzwjames / FailureLLMUnlearning
  An official implementation of "Catastrophic Failure of LLM Unlearning via Quantization" (ICLR 2025)
  ☆26Updated last month
• horseee / CoT-Valve
  CoT-Valve: Length-Compressible Chain-of-Thought Tuning
  ☆55Updated last month
• PKU-ML / LongPPL
  Code for ICLR 2025 Paper "What is Wrong with Perplexity for Long-context Language Modeling?"
  ☆44Updated last month
• Wang-ML-Lab / multimodal-needle-in-a-haystack
  [NAACL 2025 Oral] Multimodal Needle in a Haystack (MMNeedle): Benchmarking Long-Context Capability of Multimodal Large Language Models
  ☆40Updated 2 weeks ago
• decoding-comp-trust / comp-trust
  Codebase for decoding compressed trust.
  ☆23Updated 10 months ago
• RainBowLuoCS / DEEM
  (ICLR2025 Spotlight) DEEM: Official implementation of Diffusion models serve as the eyes of large language models for image perception.
  ☆26Updated 2 weeks ago
• MikaStars39 / StableMask
  PyTorch implementation of StableMask (ICML'24)
  ☆12Updated 9 months ago
• JayZhang42 / SLED
  SLED: Self Logits Evolution Decoding for Improving Factuality in Large Language Model https://arxiv.org/pdf/2411.02433
  ☆24Updated 3 months ago
• hemingkx / TokenSkip
  TokenSkip: Controllable Chain-of-Thought Compression in LLMs
  ☆98Updated 2 weeks ago
• sail-sg / LongSpec
  LongSpec: Long-Context Speculative Decoding with Efficient Drafting and Verification
  ☆42Updated 3 weeks ago
• uservan / ThinkPO
  ☆16Updated last month
• GeniusHTX / TALE
  ☆79Updated last week
• Infini-AI-Lab / S2FT
  ☆16Updated 2 months ago
• OpenSparseLLMs / Linearization
  ☆36Updated last week
• SempraETY / Pruning-via-Merging
  ☆17Updated 4 months ago
• VITA-Group / LoCoCo
  [ICML‘2024] "LoCoCo: Dropping In Convolutions for Long Context Compression", Ruisi Cai, Yuandong Tian, Zhangyang Wang, Beidi Chen
  ☆16Updated 6 months ago
• VITA-Group / Junk_DNA_Hypothesis
  [ICML 2024] Junk DNA Hypothesis: A Task-Centric Angle of LLM Pre-trained Weights through Sparsity; Lu Yin*, Ajay Jaiswal*, Shiwei Liu, So…
  ☆16Updated 9 months ago
• yihedeng9 / DuoGuard
  DuoGuard: A Two-Player RL-Driven Framework for Multilingual LLM Guardrails
  ☆16Updated last month
• luka-group / vlm-knowledge-conflict
  Code for paper "Unraveling Cross-Modality Knowledge Conflicts in Large Vision-Language Models."
  ☆42Updated 5 months ago
• GATECH-EIC / ACT
  [ICML 2024] Unveiling and Harnessing Hidden Attention Sinks: Enhancing Large Language Models without Training through Attention Calibrati…
  ☆33Updated 8 months ago
• sail-sg / dice
  Official implementation of Bootstrapping Language Models via DPO Implicit Rewards
  ☆43Updated 7 months ago
• John-AI-Lab / Unnatural_Language
  The official repository of 'Unnatural Language Are Not Bugs but Features for LLMs'
  ☆13Updated 3 weeks ago
• OpenSparseLLMs / Linear-MoE
  ☆70Updated 2 weeks ago
• ShuheSH / A-Survey-of-the-Reasoning-Abilities-of-LLMs
  ☆19Updated 3 weeks ago
• OpenSparseLLMs / MoM
  ☆71Updated last week
• OpenSparseLLMs / Open-Pandora
  Open-Pandora: On-the-fly Control Video Generation
  ☆32Updated 3 months ago
• alessiodevoto / l2compress
  Code for the EMNLP24 paper "A simple and effective L2 norm based method for KV Cache compression."
  ☆11Updated 3 months ago
• MJ-Bench / MJ-Bench
  Official implementation for "MJ-Bench: Is Your Multimodal Reward Model Really a Good Judge for Text-to-Image Generation?"
  ☆44Updated last month