Alternatives and similar repositories for Lingual-SMoE

Users that are interested in Lingual-SMoE are comparing it to the libraries listed below

• xuyige / SoftCoT
  ACL'2025: SoftCoT: Soft Chain-of-Thought for Efficient Reasoning with LLMs. and preprint: SoftCoT++: Test-Time Scaling with Soft Chain-of…
  ☆35Updated last month
• chuanyang-Zheng / DAPE
  The this is the official implementation of "DAPE: Data-Adaptive Positional Encoding for Length Extrapolation"
  ☆38Updated 9 months ago
• Clin0212 / HydraLoRA
  [NeurIPS'24 Oral] HydraLoRA: An Asymmetric LoRA Architecture for Efficient Fine-Tuning
  ☆216Updated 7 months ago
• GATECH-EIC / ACT
  [ICML 2024] Unveiling and Harnessing Hidden Attention Sinks: Enhancing Large Language Models without Training through Attention Calibrati…
  ☆40Updated last year
• RUCBM / DeepCritic
  Official repository for paper "DeepCritic: Deliberate Critique with Large Language Models"
  ☆32Updated 3 weeks ago
• OpenSparseLLMs / MoM
  ☆91Updated 2 months ago
• zefang-liu / AdaMoLE
  AdaMoLE: Adaptive Mixture of LoRA Experts
  ☆34Updated 9 months ago
• DavidFanzz / SCMoE
  ☆26Updated last year
• TUDB-Labs / MoE-PEFT
  An Efficient LLM Fine-Tuning Factory Optimized for MoE PEFT
  ☆106Updated 4 months ago
• ML-GSAI / RADD
  Official PyTorch implementation for "Your Absorbing Discrete Diffusion Secretly Models the Conditional Distributions of Clean Data" (ICLR…
  ☆55Updated last month
• WillDreamer / Awesome-MLLM-Reasoning
  Recent Advances on MLLM's Reasoning Ability
  ☆24Updated 3 months ago
• HKUNLP / diffusion-of-thoughts
  [NeurIPS 2024] Code for the paper "Diffusion of Thoughts: Chain-of-Thought Reasoning in Diffusion Language Models"
  ☆169Updated 4 months ago
• Chaos96 / fourierft
  ☆147Updated 10 months ago
• haonan3 / AnchorContext
  AnchorAttention: Improved attention for LLMs long-context training
  ☆211Updated 6 months ago
• yczhou001 / Awesome-Diffusion-LLM
  paper list, tutorial, and nano code snippet for Diffusion Large Language Models.
  ☆85Updated 3 weeks ago
• harveyhuang18 / EMR_Merging
  [NeurIPS 2024 Spotlight] EMR-Merging: Tuning-Free High-Performance Model Merging
  ☆59Updated 4 months ago
• ML-GSAI / LLaDA-V
  ☆174Updated 3 weeks ago
• TUDB-Labs / MixLoRA
  State-of-the-art Parameter-Efficient MoE Fine-tuning Method
  ☆169Updated 10 months ago
• LiangrunFlora / Slow-Fast-Sampling
  Official PyTorch implementation of the paper "Accelerating Diffusion Large Language Models with SlowFast Sampling: The Three Golden Princ…
  ☆23Updated last week
• haonan3 / V1
  V1: Toward Multimodal Reasoning by Designing Auxiliary Task
  ☆34Updated 3 months ago
• Z1zs / MMNeuron
  Official implementation of "MMNeuron: Discovering Neuron-Level Domain-Specific Interpretation in Multimodal Large Language Model". Our co…
  ☆19Updated 7 months ago
• LINs-lab / DynMoE
  [ICLR 2025] Dynamic Mixture of Experts: An Auto-Tuning Approach for Efficient Transformer Models
  ☆118Updated last week
• sail-sg / Attention-Sink
  [ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)
  ☆99Updated last week
• ML-GSAI / Diffusion-LLM-Papers
  A Collection of Papers on Diffusion Language Models
  ☆90Updated 2 weeks ago
• justinlovelace / latent-diffusion-for-language
  ☆137Updated last year
• HKUNLP / DiffuLLaMA
  [ICLR2025] DiffuGPT and DiffuLLaMA: Scaling Diffusion Language Models via Adaptation from Autoregressive Models
  ☆242Updated last month
• OpenSparseLLMs / LLaMA-MoE-v2
  🚀 LLaMA-MoE v2: Exploring Sparsity of LLaMA from Perspective of Mixture-of-Experts with Post-Training
  ☆86Updated 7 months ago
• Bumble666 / Hyper_MoE
  ☆31Updated 6 months ago
• MingyuJ666 / Rope_with_LLM
  [ICML'25] Our study systematically investigates massive values in LLMs' attention mechanisms. First, we observe massive values are concen…
  ☆74Updated 3 weeks ago
• TsinghuaC3I / SoRA
  [EMNLP 2023, Main Conference] Sparse Low-rank Adaptation of Pre-trained Language Models
  ☆79Updated last year