Alternatives and similar repositories for LightTrans

Users that are interested in LightTrans are comparing it to the libraries listed below

• sail-sg / ActivePRM
  ☆15Updated 3 months ago
• sail-sg / AnytimeReasoner
  Optimizing Anytime Reasoning via Budget Relative Policy Optimization
  ☆42Updated this week
• DAMO-NLP-SG / LongPO
  [ICLR 2025] LongPO: Long Context Self-Evolution of Large Language Models through Short-to-Long Preference Optimization
  ☆38Updated 4 months ago
• PKU-ML / LongPPL
  Code for ICLR 2025 Paper "What is Wrong with Perplexity for Long-context Language Modeling?"
  ☆91Updated 2 months ago
• xichen-fy / Fira
  Fira: Can We Achieve Full-rank Training of LLMs Under Low-rank Constraint?
  ☆112Updated 8 months ago
• OpenSparseLLMs / Linearization
  ☆51Updated last week
• horseee / CoT-Valve
  CoT-Valve: Length-Compressible Chain-of-Thought Tuning
  ☆77Updated 5 months ago
• kamanphoebe / Look-into-MoEs
  [NAACL 2025] A Closer Look into Mixture-of-Experts in Large Language Models
  ☆52Updated 5 months ago
• sail-sg / Attention-Sink
  [ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)
  ☆99Updated last week
• mathllm / Step-Controlled_DPO
  ☆22Updated last year
• zzwjames / FailureLLMUnlearning
  An official implementation of "Catastrophic Failure of LLM Unlearning via Quantization" (ICLR 2025)
  ☆27Updated 4 months ago
• uservan / ThinkPO
  ☆18Updated 4 months ago
• sail-sg / SimLayerKV
  The official implementation of paper: SimLayerKV: A Simple Framework for Layer-Level KV Cache Reduction.
  ☆46Updated 9 months ago
• Infini-AI-Lab / S2FT
  ☆18Updated 6 months ago
• JayZhang42 / SLED
  SLED: Self Logits Evolution Decoding for Improving Factuality in Large Language Model https://arxiv.org/pdf/2411.02433
  ☆26Updated 7 months ago
• tongxuluo / prts
  Code and Model for NeurIPS 2024 Spotlight Paper "Stacking Your Transformers: A Closer Look at Model Growth for Efficient LLM Pre-Training…
  ☆42Updated 9 months ago
• OpenSparseLLMs / MoM
  ☆91Updated 2 months ago
• hemingkx / SWIFT
  [ICLR 2025] SWIFT: On-the-Fly Self-Speculative Decoding for LLM Inference Acceleration
  ☆52Updated 4 months ago
• Infini-AI-Lab / Multiverse
  ☆75Updated last week
• MikaStars39 / StableMask
  PyTorch implementation of StableMask (ICML'24)
  ☆13Updated last year
• sail-sg / LongSpec
  LongSpec: Long-Context Lossless Speculative Decoding with Efficient Drafting and Verification
  ☆60Updated this week
• zhijie-group / SIFT
  SIFT: Grounding LLM Reasoning in Contexts via Stickers
  ☆57Updated 4 months ago
• Wang-ML-Lab / multimodal-needle-in-a-haystack
  [NAACL 2025 Oral] Multimodal Needle in a Haystack (MMNeedle): Benchmarking Long-Context Capability of Multimodal Large Language Models
  ☆47Updated 2 months ago
• inclusionAI / Ring
  Ring is a reasoning MoE LLM provided and open-sourced by InclusionAI, derived from Ling.
  ☆87Updated last month
• OpenSparseLLMs / Linear-MoE
  ☆110Updated last month
• yczhou001 / Awesome-Diffusion-LLM
  paper list, tutorial, and nano code snippet for Diffusion Large Language Models.
  ☆85Updated 3 weeks ago
• dvlab-research / Q-LLM
  This is the official repo of "QuickLLaMA: Query-aware Inference Acceleration for Large Language Models"
  ☆53Updated last year
• ShiZhengyan / InstructionModelling
  [NeurIPS 2024 Main Track] Code for the paper titled "Instruction Tuning With Loss Over Instructions"
  ☆38Updated last year
• ltzheng / SimpleTIR
  End-to-End Reinforcement Learning for Multi-Turn Tool-Integrated Reasoning
  ☆127Updated this week
• GeniusHTX / TALE
  ☆125Updated last month