Alternatives and similar repositories for moeut:

Users that are interested in moeut are comparing it to the libraries listed below

• JacobPfau / fillerTokens
  ☆59Updated 9 months ago
• ScalingIntelligence / large_language_monkeys
  ☆80Updated 4 months ago
• katiekang1998 / reasoning_generalization
  ☆24Updated 3 weeks ago
• VITA-Group / WeLore
  From GaLore to WeLore: How Low-Rank Weights Non-uniformly Emerge from Low-Rank Gradients. Ajay Jaiswal, Lu Yin, Zhenyu Zhang, Shiwei Liu,…
  ☆42Updated 6 months ago
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆53Updated 4 months ago
• kyleliang919 / Online-Subspace-Descent
  This repo is based on https://github.com/jiaweizzhao/GaLore
  ☆23Updated 4 months ago
• epfml / schedules-and-scaling
  Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"
  ☆67Updated 2 months ago
• allenai / easy-to-hard-generalization
  Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"
  ☆46Updated last year
• SalesforceAIResearch / LaTRO
  ☆98Updated this week
• Infini-AI-Lab / S2FT
  ☆12Updated 3 weeks ago
• EvolvingLMMs-Lab / multimodal-sae
  Auto Interpretation Pipeline and many other functionalities for Multimodal SAE Analysis.
  ☆100Updated this week
• wang-kee / LiNeS
  Official repository of "LiNeS: Post-training Layer Scaling Prevents Forgetting and Enhances Model Merging"
  ☆23Updated 2 months ago
• lucidrains / coconut-pytorch
  Implementation of 🥥 Coconut, Chain of Continuous Thought, in Pytorch
  ☆150Updated 3 weeks ago
• berlino / seq_icl
  ☆51Updated 8 months ago
• RobertCsordas / moe
  Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"
  ☆36Updated last year
• TRI-ML / linear_open_lm
  A repository for research on medium sized language models.
  ☆76Updated 8 months ago
• yidingjiang / ado
  The repository contains code for Adaptive Data Optimization
  ☆20Updated last month
• EleutherAI / nanoGPT-mup
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆91Updated 2 months ago
• Dereck0602 / Awesome_Test_Time_LLMs
  ☆56Updated 2 weeks ago
• RobertCsordas / moe_attention
  Official repository for the paper "SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention"
  ☆96Updated 3 months ago
• foundation-model-stack / bamba
  Train, tune, and infer Bamba model
  ☆80Updated last week
• sanyalsunny111 / LLM-Inheritune
  This is the official repository for Inheritune.
  ☆109Updated 3 months ago
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆47Updated 5 months ago
• Zyphra / Zyda_processing
  ☆31Updated 7 months ago
• thepowerfuldeez / OLMo
  My fork os allen AI's OLMo for educational purposes.
  ☆30Updated last month
• shenao-zhang / SELM
  The official implementation of Self-Exploring Language Models (SELM)
  ☆61Updated 7 months ago
• john-hewitt / implicit-ins
  Codebase for Instruction Following without Instruction Tuning
  ☆33Updated 4 months ago
• architsharma97 / dpo-rlaif
  ☆94Updated 7 months ago
• hughbzhang / o1_inference_scaling_laws
  Replicating O1 inference-time scaling laws
  ☆73Updated last month