Alternatives and similar repositories for CAMEx

Users that are interested in CAMEx are comparing it to the libraries listed below

• Fsoft-AIC / LibMoE
  LibMoE: A LIBRARY FOR COMPREHENSIVE BENCHMARKING MIXTURE OF EXPERTS IN LARGE LANGUAGE MODELS
  ☆46Updated 3 weeks ago
• Adamdad / rational_kat_cu
  ☆79Updated 11 months ago
• TianjinYellow / SPAM-Optimizer
  ☆36Updated 10 months ago
• jongwooko / distillm-2
  Official PyTorch implementation of DistiLLM-2: A Contrastive Approach Boosts the Distillation of LLMs (ICML 2025 Oral)
  ☆55Updated 7 months ago
• ml-jku / EVA
  One Initialization to Rule them All: Fine-tuning via Explained Variance Adaptation
  ☆46Updated 3 months ago
• fangyuan-ksgk / selective-attention-transformer
  Unofficial Implementation of Selective Attention Transformer
  ☆20Updated last year
• HuyNguyen-hust / flash-attn-101
  ☆21Updated last year
• yu-rp / KANbeFair
  A More Fair and Comprehensive Comparison between KAN and MLP
  ☆178Updated last year
• arpita8 / Awesome-Mixture-of-Experts-Papers
  Survey: A collection of AWESOME papers and resources on the latest research in Mixture of Experts.
  ☆141Updated last year
• piotrpiekos / MoSA
  User-friendly implementation of the Mixture-of-Sparse-Attention (MoSA). MoSA selects distinct tokens for each head with expert choice rou…
  ☆28Updated 8 months ago
• jaisidhsingh / pytorch-mixtures
  One-stop solutions for Mixture of Experts and Mixture of Depth modules in PyTorch.
  ☆26Updated 8 months ago
• Chaos96 / fourierft
  ☆152Updated last year
• jacobmarks / awesome-neurips-2023
  Conference schedule, top papers, and analysis of the data for NeurIPS 2023!
  ☆120Updated 2 years ago
• hqsiswiliam / hira
  The repo for HiRA paper
  ☆36Updated 3 weeks ago
• g-luo / vlm_cross_modal_reps
  Official PyTorch Implementation for Vision-Language Models Create Cross-Modal Task Representations, ICML 2025
  ☆31Updated 9 months ago
• tum-ai / number-token-loss
  A regression-alike loss to improve numerical reasoning in language models - ICML 2025
  ☆27Updated 5 months ago
• mlbio-epfl / joint-inference
  [ICLR 2025] Large (Vision) Language Models are Unsupervised In-Context Learners
  ☆22Updated 7 months ago
• OscarXZQ / weight-selection
  ☆191Updated last year
• AmeenAli / HiddenMambaAttn
  Official PyTorch Implementation of "The Hidden Attention of Mamba Models"
  ☆231Updated 3 months ago
• YuanheZ / LoRA-One
  LoRA-One: One-Step Full Gradient Could Suffice for Fine-Tuning Large Language Models, Provably and Efficiently (ICML2025 Oral)
  ☆28Updated 3 months ago
• chuanyang-Zheng / DAPE
  The this is the official implementation of "DAPE: Data-Adaptive Positional Encoding for Length Extrapolation"
  ☆40Updated last year
• krafton-ai / mambaformer-icl
  MambaFormer in-context learning experiments and implementation for https://arxiv.org/abs/2402.04248
  ☆58Updated last year
• sail-sg / Precision-RL
  Defeating the Training-Inference Mismatch via FP16
  ☆180Updated 2 months ago
• ablghtianyi / ICL_Modular_Arithmetic
  ☆19Updated 10 months ago
• epfml / schedules-and-scaling
  Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"
  ☆88Updated last year
• pilancilab / Riemannian_Preconditioned_LoRA
  source code for paper "Riemannian Preconditioned LoRA for Fine-Tuning Foundation Models"
  ☆33Updated last year
• nbasyl / DoRA
  Official implementation of "DoRA: Weight-Decomposed Low-Rank Adaptation"
  ☆124Updated last year
• sail-sg / scaling-with-vocab
  [NeurIPS-2024] 📈 Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies https://arxiv.org/abs/2407.13623
  ☆89Updated last year
• facebookresearch / MobileLLM-R1
  MobileLLM-R1
  ☆75Updated 4 months ago
• MarkXCloud / CSpD
  The official repo of continuous speculative decoding
  ☆31Updated 10 months ago