Alternatives and similar repositories for pythia-mlkv:

Users that are interested in pythia-mlkv are comparing it to the libraries listed below

• kiddyboots216 / lottery-ticket-adaptation
  Lottery Ticket Adaptation
  ☆39Updated 5 months ago
• FreedomIntelligence / FastLLM
  Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];
  ☆37Updated last year
• frankxwang / dpo-prefix-sharing
  DPO, but faster 🚀
  ☆41Updated 4 months ago
• LLM360 / crystalcoder-data-prep
  Data preparation code for CrystalCoder 7B LLM
  ☆44Updated 11 months ago
• lucidrains / mind-evolution
  Implementation of Mind Evolution, Evolving Deeper LLM Thinking, from Deepmind
  ☆48Updated 2 months ago
• shreyansh26 / Attention-Mask-Patterns
  Using FlexAttention to compute attention with different masking patterns
  ☆43Updated 7 months ago
• kyegomez / Infini-attention
  Implementation of the paper: "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" from Google in pyTO…
  ☆55Updated this week
• kyegomez / TinyGPTV
  Simple Implementation of TinyGPTV in super simple Zeta lego blocks
  ☆16Updated 5 months ago
• LLM360 / k2-data-prep
  ☆20Updated 10 months ago
• VITA-Group / WeLore
  From GaLore to WeLore: How Low-Rank Weights Non-uniformly Emerge from Low-Rank Gradients. Ajay Jaiswal, Lu Yin, Zhenyu Zhang, Shiwei Liu,…
  ☆44Updated last week
• foundation-model-stack / bamba
  Train, tune, and infer Bamba model
  ☆88Updated this week
• NathanGodey / qfilters
  Repository for the Q-Filters method (https://arxiv.org/pdf/2503.02812)
  ☆30Updated last month
• shangshang-wang / Tina
  Tina: Tiny Reasoning Models via LoRA
  ☆55Updated this week
• samchaineau / llm_slerp_generation
  Repo hosting codes and materials related to speeding LLMs' inference using token merging.
  ☆36Updated 11 months ago
• menhguin / minp_paper
  Code Implementation, Evaluations, Documentation, Links and Resources for Min P paper
  ☆32Updated last month
• ryokamoi / llm-self-correction-papers
  List of papers on Self-Correction of LLMs.
  ☆72Updated 4 months ago
• lucidrains / transformer-lm-gan
  Explorations into adversarial losses on top of autoregressive loss for language modeling
  ☆35Updated 2 months ago
• kyleliang919 / Online-Subspace-Descent
  This repo is based on https://github.com/jiaweizzhao/GaLore
  ☆26Updated 7 months ago
• TRI-ML / linear_open_lm
  A repository for research on medium sized language models.
  ☆76Updated 11 months ago
• tanaymeh / mamba-train
  A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIM
  ☆54Updated last year
• NolanoOrg / SpectraSuite
  ☆46Updated 9 months ago
• Infini-AI-Lab / gsm_infinite
  ☆43Updated 2 months ago
• du-nlp-lab / MLR-Copilot
  ☆62Updated 3 weeks ago
• ZihanWang314 / coeCheck
  ☆16Updated last month
• zhaochenyang20 / Prompt2Model-Self-Guide
  SELF-GUIDE: Better Task-Specific Instruction Following via Self-Synthetic Finetuning. COLM 2024 Accepted Paper
  ☆32Updated 10 months ago
• RobertCsordas / moe
  Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"
  ☆37Updated last year
• kyleliang919 / Super_Muon
  ☆53Updated last month
• Qichuzyy / POA
  Official implementation of ECCV24 paper: POA
  ☆24Updated 8 months ago
• Zyphra / Zyda_processing
  ☆33Updated 10 months ago
• GreenBitAI / green-bit-llm
  A toolkit for fine-tuning, inferencing, and evaluating GreenBitAI's LLMs.
  ☆82Updated last month