luchris429 / DiscoPOP

Related projects ⓘ

Alternatives and complementary repositories for DiscoPOP

• kyegomez / EvoVLM-JP
  Plug in & Play Pytorch Implementation of the paper: "Evolutionary Optimization of Model Merging Recipes" by Sakana AI
  ☆26Updated last week
• borjanG / 2023-transformers-rotf
  Codes for the paper "A mathematical perspective on Transformers".
  ☆32Updated 4 months ago
• google-deepmind / asyncdiloco
  ☆39Updated 10 months ago
• jdeschena / sdtt
  SDTT: a simple and effective distillation method for discrete diffusion models
  ☆16Updated last week
• SakanaAI / DiscoPOP
  Code for Discovering Preference Optimization Algorithms with and for Large Language Models
  ☆166Updated 5 months ago
• RobertCsordas / moe
  Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"
  ☆36Updated last year
• arcee-ai / DAM
  ☆41Updated 2 weeks ago
• SakanaAI / evo-memory
  Code to train and evaluate Neural Attention Memory Models to obtain universally-applicable memory systems for transformers.
  ☆11Updated last month
• shenao-zhang / SELM
  The official implementation of Self-Exploring Language Models (SELM)
  ☆55Updated 5 months ago
• flowersteam / LLM-Culture
  Code for the "Cultural evolution in populations of Large Language Models" paper
  ☆28Updated 3 weeks ago
• abdulhaim / LMRL-Gym
  ☆73Updated 4 months ago
• smearle / autoverse
  Generative cellular automaton-like learning environments for RL.
  ☆19Updated last month
• RobertCsordas / moeut
  ☆62Updated 3 months ago
• codezakh / DataEnvGym
  A testbed for agents and environments that can automatically improve models through data generation.
  ☆12Updated last week
• recursal / GoldFinch-paper
  GoldFinch and other hybrid transformer components
  ☆39Updated 4 months ago
• kotoba-tech / kotomamba
  Mamba training library developed by kotoba technologies
  ☆68Updated 9 months ago
• fangyuan-ksgk / Evolutionary-Model-Merge
  Unofficial Implementation of Evolutionary Model Merging
  ☆33Updated 7 months ago
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆67Updated this week
• likenneth / q_probe
  Q-Probe: A Lightweight Approach to Reward Maximization for Language Models
  ☆37Updated 5 months ago
• facebookresearch / MemoryMosaics
  Memory Mosaics are networks of associative memories working in concert to achieve a prediction task.
  ☆34Updated last month
• kyegomez / SelfExtend
  Implementation of SelfExtend from the paper "LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning" from Pytorch and Zeta
  ☆13Updated last week
• amirzandieh / HyperAttention
  Triton Implementation of HyperAttention Algorithm
  ☆46Updated 11 months ago
• radarFudan / mamba-minimal-jax
  ☆29Updated 2 months ago
• Aratako / Task-Vector-Merge-Optimzier
  ☆14Updated 7 months ago
• Nicolas-Yax / PhyloLM
  Genetics for Language Models
  ☆12Updated 4 months ago
• TRI-ML / linear_open_lm
  A repository for research on medium sized language models.
  ☆74Updated 5 months ago
• architsharma97 / dpo-rlaif
  ☆90Updated 4 months ago
• conglu1997 / intelligent-go-explore
  Intelligent Go-Explore: Standing on the Shoulders of Giant Foundation Models
  ☆45Updated 5 months ago
• vmicheli / delta-iris
  Efficient World Models with Context-Aware Tokenization. ICML 2024
  ☆84Updated 2 months ago