Alternatives and similar repositories for pythia-mlkv

Users that are interested in pythia-mlkv are comparing it to the libraries listed below

• kiddyboots216 / lottery-ticket-adaptation
  Lottery Ticket Adaptation
  ☆39Updated 5 months ago
• ZihanWang314 / coeCheck
  ☆16Updated 2 months ago
• thunlp / APB
  ☆27Updated 2 months ago
• lucidrains / mind-evolution
  Implementation of Mind Evolution, Evolving Deeper LLM Thinking, from Deepmind
  ☆50Updated 3 months ago
• Scientific-Computing-Lab / MPI-rigen
  MPI Code Generation through Domain-Specific Language Models
  ☆14Updated 5 months ago
• menhguin / minp_paper
  Code Implementation, Evaluations, Documentation, Links and Resources for Min P paper
  ☆33Updated 2 months ago
• cmu-l3 / neurips2024-inference-tutorial-code
  NeurIPS 2024 tutorial on LLM Inference
  ☆43Updated 5 months ago
• RobertCsordas / moe
  Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"
  ☆37Updated last year
• McGill-NLP / agent-reward-bench
  AgentRewardBench: Evaluating Automatic Evaluations of Web Agent Trajectories
  ☆12Updated this week
• FreedomIntelligence / FastLLM
  Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];
  ☆37Updated last year
• zenrran4nlp / Awesome-LLM-Inference-Serving
  ☆27Updated 2 weeks ago
• TRI-ML / linear_open_lm
  A repository for research on medium sized language models.
  ☆76Updated 11 months ago
• facebookresearch / coocmap
  code for paper "Accessing higher dimensions for unsupervised word translation"
  ☆21Updated last year
• benpry / why-think-step-by-step
  Code and data for the paper "Why think step by step? Reasoning emerges from the locality of experience"
  ☆60Updated last month
• sail-sg / SkyLadder
  The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling
  ☆32Updated last month
• facebookresearch / dualformer
  implementation of dualformer
  ☆17Updated 2 months ago
• catid / lllm
  Latent Large Language Models
  ☆18Updated 8 months ago
• Infini-AI-Lab / S2FT
  ☆17Updated 4 months ago
• xhan77 / in-context-alignment
  In-Context Alignment: Chat with Vanilla Language Models Before Fine-Tuning
  ☆34Updated last year
• codezakh / DataEnvGym
  A testbed for agents and environments that can automatically improve models through data generation.
  ☆24Updated 2 months ago
• lucidrains / transformer-lm-gan
  Explorations into adversarial losses on top of autoregressive loss for language modeling
  ☆36Updated 2 months ago
• shreyansh26 / Attention-Mask-Patterns
  Using FlexAttention to compute attention with different masking patterns
  ☆43Updated 7 months ago
• Gabesarch / ICAL
  ☆38Updated last week
• likenneth / q_probe
  Q-Probe: A Lightweight Approach to Reward Maximization for Language Models
  ☆41Updated 11 months ago
• chr26195 / PENCIL
  This is the official implementation for paper "PENCIL: Long Thoughts with Short Memory".
  ☆20Updated last week
• VITA-Group / WeLore
  From GaLore to WeLore: How Low-Rank Weights Non-uniformly Emerge from Low-Rank Gradients. Ajay Jaiswal, Lu Yin, Zhenyu Zhang, Shiwei Liu,…
  ☆47Updated 3 weeks ago
• facebookresearch / adaptive_scheduling
  Experimental scripts for researching data adaptive learning rate scheduling.
  ☆23Updated last year
• dangxingyu / rnn-icrag
  Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"
  ☆27Updated last year
• RWKV / RWKV-LM
  RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best…
  ☆44Updated 2 months ago
• frankxwang / dpo-prefix-sharing
  DPO, but faster 🚀
  ☆42Updated 5 months ago