Alternatives and similar repositories for BiPE:

Users that are interested in BiPE are comparing it to the libraries listed below

• chuanyang-Zheng / DAPE
  The this is the official implementation of "DAPE: Data-Adaptive Positional Encoding for Length Extrapolation"
  ☆37Updated 6 months ago
• yule-BUAA / MergeLLM
  Codes for Merging Large Language Models
  ☆29Updated 8 months ago
• thu-ml / Noise-Contrastive-Alignment
  Code accompanying the paper "Noise Contrastive Alignment of Language Models with Explicit Rewards" (NeurIPS 2024)
  ☆51Updated 5 months ago
• ECNU-ICALK / MELO
  [AAAI 2024] MELO: Enhancing Model Editing with Neuron-indexed Dynamic LoRA
  ☆25Updated last year
• VITA-Group / Random-MoE-as-Dropout
  [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal…
  ☆49Updated 2 years ago
• GATECH-EIC / ACT
  [ICML 2024] Unveiling and Harnessing Hidden Attention Sinks: Enhancing Large Language Models without Training through Attention Calibrati…
  ☆36Updated 9 months ago
• hkust-nlp / mstar
  M-STAR (Multimodal Self-Evolving TrAining for Reasoning) Project. Diving into Self-Evolving Training for Multimodal Reasoning
  ☆56Updated 3 months ago
• kiaia / GIRAFFE
  Extending context length of visual language models
  ☆11Updated 3 months ago
• yegcjs / DiffusionLLM
  Code for paper "Diffusion Language Models Can Perform Many Tasks with Scaling and Instruction-Finetuning"
  ☆76Updated last year
• horseee / CoT-Valve
  CoT-Valve: Length-Compressible Chain-of-Thought Tuning
  ☆62Updated 2 months ago
• RUCAIBox / JiuZhang3.0
  The code and data for the paper JiuZhang3.0
  ☆43Updated 10 months ago
• guyuntian / CoT_benchmark
  Code for "Towards Revealing the Mystery behind Chain of Thought: a Theoretical Perspective"
  ☆20Updated last year
• OpenSparseLLMs / MoM
  ☆74Updated 3 weeks ago
• Shwai-He / MEO
  The source code of "Merging Experts into One: Improving Computational Efficiency of Mixture of Experts (EMNLP 2023)":
  ☆36Updated last year
• ShadeCloak / ADORA
  ☆37Updated last week
• YujieLu10 / Seeker
  ☆10Updated 10 months ago
• bethgelab / sober-reasoning
  ☆16Updated this week
• yikangshen / MoA
  Mixture of Attention Heads
  ☆44Updated 2 years ago
• BaohaoLiao / mefts
  [NeurIPS 2023] Make Your Pre-trained Model Reversible: From Parameter to Memory Efficient Fine-Tuning
  ☆31Updated last year
• r-three / smear
  ☆28Updated last year
• OpenSparseLLMs / LLaMA-MoE-v2
  🚀 LLaMA-MoE v2: Exploring Sparsity of LLaMA from Perspective of Mixture-of-Experts with Post-Training
  ☆80Updated 4 months ago
• VITA-Group / Ms-PoE
  "Found in the Middle: How Language Models Use Long Contexts Better via Plug-and-Play Positional Encoding" Zhenyu Zhang, Runjin Chen, Shiw…
  ☆29Updated 11 months ago
• sail-sg / Attention-Sink
  [ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)
  ☆62Updated 5 months ago
• Alpha-Innovator / GeoX
  [ICLR'25] Geometric Problem Solving Through Unified Formalized Vision-Language Pre-training
  ☆29Updated 2 months ago
• sail-sg / scaling-with-vocab
  [NeurIPS-2024] 📈 Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies https://arxiv.org/abs/2407.13623
  ☆82Updated 6 months ago
• cliang1453 / task-aware-distillation
  Less is More: Task-aware Layer-wise Distillation for Language Model Compression (ICML2023)
  ☆34Updated last year
• MikaStars39 / StableMask
  PyTorch implementation of StableMask (ICML'24)
  ☆12Updated 9 months ago
• uservan / ThinkPO
  ☆20Updated last month
• SalesforceAIResearch / ThinK
  ThinK: Thinner Key Cache by Query-Driven Pruning
  ☆18Updated 2 months ago
• DavidFanzz / SCMoE
  ☆21Updated 10 months ago