Alternatives and similar repositories for pythia-mlkv

Users that are interested in pythia-mlkv are comparing it to the libraries listed below

• kiddyboots216 / lottery-ticket-adaptation
  Lottery Ticket Adaptation
  ☆39Updated last year
• TIGER-AI-Lab / One-Shot-CFT
  The official repo for “Unleashing the Reasoning Potential of Pre-trained LLMs by Critique Fine-Tuning on One Problem” [EMNLP25]
  ☆33Updated 4 months ago
• TRI-ML / linear_open_lm
  A repository for research on medium sized language models.
  ☆77Updated last year
• The-Inscrutable-X / TACQ
  Official Repository for Task-Circuit Quantization
  ☆24Updated 8 months ago
• lucidrains / mind-evolution
  Implementation of Mind Evolution, Evolving Deeper LLM Thinking, from Deepmind
  ☆59Updated 8 months ago
• frankxwang / dpo-prefix-sharing
  DPO, but faster 🚀
  ☆46Updated last year
• ZihanWang314 / coeCheck
  ☆19Updated 10 months ago
• LLM360 / crystalcoder-data-prep
  Data preparation code for CrystalCoder 7B LLM
  ☆45Updated last year
• RiddleHe / llm-interp
  A collection of lightweight interpretability scripts to understand how LLMs think
  ☆89Updated last week
• OpenNLPLab / LASP
  Linear Attention Sequence Parallelism (LASP)
  ☆88Updated last year
• LLM360 / k2-data-prep
  ☆21Updated last year
• charlesjin / emergent-semantics
  ☆41Updated last year
• du-nlp-lab / MLR-Copilot
  ☆67Updated 10 months ago
• rsshyam / GRPO
  ☆70Updated last year
• tanaymeh / mamba-train
  A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIM
  ☆61Updated last year
• kyegomez / OpenStrawberry
  An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO
  ☆29Updated last week
• kyleliang919 / Super_Muon
  ☆66Updated 10 months ago
• nanowell / Q-Sparse-LLM
  My Implementation of Q-Sparse: All Large Language Models can be Fully Sparsely-Activated
  ☆33Updated last year
• Jellyfish042 / RWKV_Othello
  A specialized RWKV-7 model for Othello(a.k.a. Reversi) that predicts legal moves, evaluates positions, and performs in-context search. It…
  ☆43Updated last year
• kyegomez / Infini-attention
  Implementation of the paper: "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" from Google in pyTO…
  ☆58Updated last week
• s-sahoo / Eso-LMs
  Esoteric Language Models
  ☆109Updated 2 months ago
• shangshang-wang / Resa
  Resa: Transparent Reasoning Models via SAEs
  ☆47Updated 4 months ago
• RodkinIvan / associative-recurrent-memory-transformer
  [ICML 24 NGSM workshop] Associative Recurrent Memory Transformer implementation and scripts for training and evaluation
  ☆61Updated 2 weeks ago
• xverse-ai / XVERSE-MoE-A36B
  XVERSE-MoE-A36B: A multilingual large language model developed by XVERSE Technology Inc.
  ☆38Updated last year
• foundation-model-stack / bamba
  Train, tune, and infer Bamba model
  ☆138Updated 7 months ago
• Infini-AI-Lab / gsm_infinite
  ☆63Updated 7 months ago
• zhaochenyang20 / Prompt2Model-Self-Guide
  SELF-GUIDE: Better Task-Specific Instruction Following via Self-Synthetic Finetuning. COLM 2024 Accepted Paper
  ☆32Updated last year
• RobertCsordas / moe_attention
  Official repository for the paper "SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention"
  ☆102Updated last year
• bespokelabsai / verifiers
  Verifiers for LLM Reinforcement Learning
  ☆80Updated 9 months ago
• woct0rdho / transformers-qwen3-moe-fused
  Fused Qwen3 MoE layer for faster training, compatible with Transformers, LoRA, bnb 4-bit quant, Unsloth. Also possible to train LoRA over…
  ☆229Updated this week