Alternatives and similar repositories for GPT3:

Users that are interested in GPT3 are comparing it to the libraries listed below

• kyegomez / GPT4
  The open source implementation of the base model behind GPT-4 from OPENAI [Language + Multi-Modal]
  ☆11Updated last year
• KindXiaoming / physics_of_skill_learning
  We study toy models of skill learning.
  ☆24Updated 2 months ago
• TergelMunkhbat / concise-reasoning
  Code for paper called Self-Training Elicits Concise Reasoning in Large Language Models
  ☆18Updated 3 weeks ago
• RobertCsordas / moe_attention
  Official repository for the paper "SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention"
  ☆97Updated 6 months ago
• wang-kee / LiNeS
  Official repository of "LiNeS: Post-training Layer Scaling Prevents Forgetting and Enhances Model Merging"
  ☆24Updated 4 months ago
• TRI-ML / linear_open_lm
  A repository for research on medium sized language models.
  ☆76Updated 10 months ago
• kyegomez / MultiQueryAttention
  This is a simple torch implementation of the high performance Multi-Query Attention
  ☆16Updated last year
• tanaymeh / mamba-train
  A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIM
  ☆54Updated 11 months ago
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆83Updated last month
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆47Updated 7 months ago
• fangyuan-ksgk / Evolutionary-Model-Merge
  Unofficial Implementation of Evolutionary Model Merging
  ☆37Updated last year
• melisa-writer / short-transformers
  Prune transformer layers
  ☆68Updated 10 months ago
• LegallyCoder / mamba-hf
  Implementation of the Mamba SSM with hf_integration.
  ☆56Updated 7 months ago
• LLM360 / k2-train
  ☆50Updated 9 months ago
• gauss5930 / iDUS
  An unofficial implementation of SOLAR-10.7B model and the newly proposed interlocked-DUS(iDUS) implementation and experiment details.
  ☆12Updated last year
• snu-mllab / Context-Memory
  Pytorch implementation for "Compressed Context Memory For Online Language Model Interaction" (ICLR'24)
  ☆55Updated 11 months ago
• Weixin-Liang / Mixture-of-Mamba
  ☆40Updated 2 months ago
• assafbk / DeciMamba
  DeciMamba: Exploring the Length Extrapolation Potential of Mamba (ICLR 2025)
  ☆25Updated 8 months ago
• thepowerfuldeez / OLMo
  My fork os allen AI's OLMo for educational purposes.
  ☆30Updated 3 months ago
• foundation-model-stack / bamba
  Train, tune, and infer Bamba model
  ☆87Updated 2 months ago
• lucidrains / mixture-of-attention
  Some personal experiments around routing tokens to different autoregressive attention, akin to mixture-of-experts
  ☆118Updated 5 months ago
• kyegomez / TTL
  Pytorch Implementation of the paper: "Learning to (Learn at Test Time): RNNs with Expressive Hidden States"
  ☆24Updated 2 weeks ago
• adihaviv / nopos
  ☆21Updated last year
• thomasgauthier / LLM-self-play
  Minimal implementation of the Self-Play Fine-Tuning Converts Weak Language Models to Strong Language Models paper (ArXiv 20232401.01335)
  ☆29Updated last year
• cloneofsimo / fim-llama-deepspeed
  ☆31Updated last year
• Upaya07 / NeurIPS-llm-efficiency-challenge
  Code for NeurIPS LLM Efficiency Challenge
  ☆57Updated 11 months ago
• fal-ai-community / nano-mdm
  Tiny re-implementation of MDM in style of LLaDA and nano-gpt speedrun
  ☆44Updated 3 weeks ago
• lucidrains / infini-transformer-pytorch
  Implementation of Infini-Transformer in Pytorch
  ☆110Updated 2 months ago
• katiekang1998 / reasoning_generalization
  ☆31Updated 2 months ago
• lucidrains / llama-qrlhf
  Implementation of the Llama architecture with RLHF + Q-learning
  ☆163Updated 2 months ago