Alternatives and similar repositories for pythia-mlkv

Users that are interested in pythia-mlkv are comparing it to the libraries listed below

• kiddyboots216 / lottery-ticket-adaptation
  Lottery Ticket Adaptation
  ☆39Updated 6 months ago
• facebookresearch / adaptive_scheduling
  Experimental scripts for researching data adaptive learning rate scheduling.
  ☆23Updated last year
• TRI-ML / linear_open_lm
  A repository for research on medium sized language models.
  ☆76Updated last year
• cmu-l3 / neurips2024-inference-tutorial-code
  NeurIPS 2024 tutorial on LLM Inference
  ☆45Updated 5 months ago
• Gen-Verse / CURE
  Open-Source LLM Coders with Co-Evolving Reinforcement Learning
  ☆40Updated this week
• lucidrains / mind-evolution
  Implementation of Mind Evolution, Evolving Deeper LLM Thinking, from Deepmind
  ☆51Updated last week
• ZihanWang314 / coeCheck
  ☆16Updated 3 months ago
• frankxwang / dpo-prefix-sharing
  DPO, but faster 🚀
  ☆42Updated 6 months ago
• LLM360 / crystalcoder-data-prep
  Data preparation code for CrystalCoder 7B LLM
  ☆44Updated last year
• VITA-Group / WeLore
  From GaLore to WeLore: How Low-Rank Weights Non-uniformly Emerge from Low-Rank Gradients. Ajay Jaiswal, Lu Yin, Zhenyu Zhang, Shiwei Liu,…
  ☆47Updated last month
• FreedomIntelligence / FastLLM
  Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];
  ☆37Updated last year
• Infini-AI-Lab / gsm_infinite
  ☆45Updated 3 months ago
• McGill-NLP / agent-reward-bench
  AgentRewardBench: Evaluating Automatic Evaluations of Web Agent Trajectories
  ☆15Updated 3 weeks ago
• Tufalabs / BeyondNextTokenPrediction
  ☆19Updated 2 months ago
• shreyansh26 / Attention-Mask-Patterns
  Using FlexAttention to compute attention with different masking patterns
  ☆43Updated 8 months ago
• ElleLeonne / Lightning-ReLoRA
  A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.
  ☆33Updated last year
• RobertCsordas / moe
  Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"
  ☆37Updated last year
• kyleliang919 / Online-Subspace-Descent
  This repo is based on https://github.com/jiaweizzhao/GaLore
  ☆28Updated 8 months ago
• thunlp / APB
  Official Implementation of APB (ACL 2025 main)
  ☆28Updated 3 months ago
• lucasjinreal / ImageTokenizer
  imagetokenizer is a python package, helps you encoder visuals and generate visuals token ids from codebook, supports both image and video…
  ☆34Updated 11 months ago
• YuchenJin / llm.c
  LLM training in simple, raw C/CUDA
  ☆14Updated 6 months ago
• penfever / wildchat-50m
  Code, results and other artifacts from the paper introducing the WildChat-50m dataset and the Re-Wild model family.
  ☆29Updated 2 months ago
• menhguin / minp_paper
  Code Implementation, Evaluations, Documentation, Links and Resources for Min P paper
  ☆35Updated 2 months ago
• NathanGodey / qfilters
  Repository for the Q-Filters method (https://arxiv.org/pdf/2503.02812)
  ☆32Updated 3 months ago
• graphcore-research / jax-scalify
  JAX Scalify: end-to-end scaled arithmetics
  ☆16Updated 7 months ago
• jiwonsong-dev / ReasoningPathCompression
  Official implementation of "Reasoning Path Compression: Compressing Generation Trajectories for Efficient LLM Reasoning"
  ☆15Updated last week
• xhan77 / in-context-alignment
  In-Context Alignment: Chat with Vanilla Language Models Before Fine-Tuning
  ☆35Updated last year
• OpenNLPLab / LASP
  Linear Attention Sequence Parallelism (LASP)
  ☆83Updated last year
• sail-sg / SkyLadder
  The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling
  ☆32Updated 2 months ago
• mmhamdy / open-language-models
  A list of language models with permissive licenses such as MIT or Apache 2.0
  ☆24Updated 3 months ago