Alternatives and similar repositories for Lingual-SMoE:

Users that are interested in Lingual-SMoE are comparing it to the libraries listed below

• chuanyang-Zheng / DAPE
  The this is the official implementation of "DAPE: Data-Adaptive Positional Encoding for Length Extrapolation"
  ☆37Updated 5 months ago
• yushuiwx / Mixture-of-LoRA-Experts
  ☆27Updated 4 months ago
• hychaochao / EMMA
  The official repository for the paper "Can MLLMs Reason in Multimodality? EMMA: An Enhanced MultiModal ReAsoning Benchmark"
  ☆47Updated this week
• Clin0212 / HydraLoRA
  [NeurIPS'24 Oral] HydraLoRA: An Asymmetric LoRA Architecture for Efficient Fine-Tuning
  ☆177Updated 3 months ago
• DAMO-NLP-SG / CMM
  ✨✨The Curse of Multi-Modalities (CMM): Evaluating Hallucinations of Large Multimodal Models across Language, Visual, and Audio
  ☆44Updated 5 months ago
• Shwai-He / SparseAdapter
  Source code of EMNLP 2022 Findings paper "SparseAdapter: An Easy Approach for Improving the Parameter-Efficiency of Adapters"
  ☆18Updated 11 months ago
• GCYZSL / MoLA
  ☆131Updated 8 months ago
• GATECH-EIC / ACT
  [ICML 2024] Unveiling and Harnessing Hidden Attention Sinks: Enhancing Large Language Models without Training through Attention Calibrati…
  ☆33Updated 9 months ago
• Nardien / KARD
  Official Code Repository for the paper "Knowledge-Augmented Reasoning Distillation for Small Language Models in Knowledge-intensive Tasks…
  ☆37Updated 4 months ago
• gyhdog99 / MoCLE
  MoCLE (First MLLM with MoE for instruction customization and generalization!) (https://arxiv.org/abs/2312.12379)
  ☆34Updated 11 months ago
• zefang-liu / AdaMoLE
  AdaMoLE: Adaptive Mixture of LoRA Experts
  ☆23Updated 5 months ago
• LightChen233 / M3CoT
  ☆64Updated 9 months ago
• ZhengxiangShi / DePT
  [ICLR 2024] This is the repository for the paper titled "DePT: Decomposed Prompt Tuning for Parameter-Efficient Fine-tuning"
  ☆96Updated 11 months ago
• zhaochen0110 / Timo
  Code and data for "Timo: Towards Better Temporal Reasoning for Language Models" (COLM 2024)
  ☆20Updated 5 months ago
• DavidFanzz / SCMoE
  ☆20Updated 10 months ago
• OpenSparseLLMs / LLaMA-MoE-v2
  🚀LLaMA-MoE v2: Exploring Sparsity of LLaMA from Perspective of Mixture-of-Experts with Post-Training
  ☆75Updated 3 months ago
• Bumble666 / Hyper_MoE
  ☆25Updated 2 months ago
• hemingkx / TokenSkip
  TokenSkip: Controllable Chain-of-Thought Compression in LLMs
  ☆103Updated 2 weeks ago
• yule-BUAA / MergeLLM
  Codes for Merging Large Language Models
  ☆28Updated 7 months ago
• harveyhuang18 / EMR_Merging
  [NeurIPS 2024 Spotlight] EMR-Merging: Tuning-Free High-Performance Model Merging
  ☆53Updated last month
• luka-group / mDPO
  [EMNLP 2024] mDPO: Conditional Preference Optimization for Multimodal Large Language Models.
  ☆70Updated 4 months ago
• Osilly / dynamic_llava
  [ICLR 2025] The official pytorch implement of "Dynamic-LLaVA: Efficient Multimodal Large Language Models via Dynamic Vision-language Cont…
  ☆26Updated 4 months ago
• hkust-nlp / mstar
  M-STAR (Multimodal Self-Evolving TrAining for Reasoning) Project. Diving into Self-Evolving Training for Multimodal Reasoning
  ☆56Updated 3 months ago
• hkust-nlp / PEM_composition
  [NeurIPS 2023] Github repository for "Composing Parameter-Efficient Modules with Arithmetic Operations"
  ☆60Updated last year
• ssmisya / PRMBench
  The official code repository for PRMBench.
  ☆68Updated last month
• zhaochen0110 / Cotempqa
  Code and data for "Living in the Moment: Can Large Language Models Grasp Co-Temporal Reasoning?" (ACL 2024)
  ☆32Updated 8 months ago
• yuezih / less-is-more
  Less is More: Mitigating Multimodal Hallucination from an EOS Decision Perspective (ACL 2024)
  ☆45Updated 5 months ago
• ChasonShi / MELoRA
  code for ACL24 "MELoRA: Mini-Ensemble Low-Rank Adapter for Parameter-Efficient Fine-Tuning"
  ☆19Updated last month
• r-three / smear
  ☆27Updated last year
• zipzou / hf-multitask-trainer
  The trainer for HF to record losses of different tasks and objectives.
  ☆37Updated 3 weeks ago