luchris429 / DiscoPOP

Related projects ⓘ

Alternatives and complementary repositories for DiscoPOP

• kyegomez / EvoVLM-JP
  Plug in & Play Pytorch Implementation of the paper: "Evolutionary Optimization of Model Merging Recipes" by Sakana AI
  ☆26Updated this week
• flowersteam / LLM-Culture
  Code for the "Cultural evolution in populations of Large Language Models" paper
  ☆28Updated last week
• borjanG / 2023-transformers-rotf
  Codes for the paper "A mathematical perspective on Transformers".
  ☆32Updated 4 months ago
• google-deepmind / asyncdiloco
  ☆39Updated 9 months ago
• RobertCsordas / moe
  Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"
  ☆36Updated 11 months ago
• scottlogic-alex / prm800k-denorm
  Script for processing OpenAI's PRM800K process supervision dataset into an Alpaca-style instruction-response format
  ☆25Updated last year
• arcee-ai / DAM
  ☆40Updated this week
• TRI-ML / linear_open_lm
  A repository for research on medium sized language models.
  ☆74Updated 5 months ago
• Qualcomm-AI-research / codeit
  ☆21Updated 5 months ago
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆66Updated last week
• SakanaAI / DiscoPOP
  Code for Discovering Preference Optimization Algorithms with and for Large Language Models
  ☆165Updated 4 months ago
• conglu1997 / intelligent-go-explore
  Intelligent Go-Explore: Standing on the Shoulders of Giant Foundation Models
  ☆45Updated 5 months ago
• jdeschena / sdtt
  SDTT: a simple and effective distillation method for discrete diffusion models
  ☆15Updated 2 weeks ago
• SakanaAI / evo-memory
  Code to train and evaluate Neural Attention Memory Models to obtain universally-applicable memory systems for transformers.
  ☆11Updated 3 weeks ago
• kotoba-tech / kotomamba
  Mamba training library developed by kotoba technologies
  ☆67Updated 9 months ago
• martin-wey / CodeUltraFeedback
  CodeUltraFeedback: aligning large language models to coding preferences
  ☆65Updated 4 months ago
• Aratako / Task-Vector-Merge-Optimzier
  ☆14Updated 7 months ago
• epfml / DenseFormer
  ☆76Updated 6 months ago
• vmicheli / delta-iris
  Efficient World Models with Context-Aware Tokenization. ICML 2024
  ☆84Updated last month
• likenneth / q_probe
  Q-Probe: A Lightweight Approach to Reward Maximization for Language Models
  ☆37Updated 5 months ago
• OpenMOSE / RWKV-Infer
  A large-scale RWKV v6 inference with FLA . Capable of inference by combining multiple states(Pseudo MoE). Easy to deploy on docker. Suppo…
  ☆16Updated this week
• cyzus / thoughtsculpt
  ☆11Updated 3 weeks ago
• abdulhaim / LMRL-Gym
  ☆73Updated 4 months ago
• GreenBitAI / gbx-lm
  Run GreenBitAI's Quantized LLMs on Apple Devices with MLX
  ☆15Updated last week
• recursal / GoldFinch-paper
  GoldFinch and other hybrid transformer components
  ☆39Updated 3 months ago
• smearle / autoverse
  Generative cellular automaton-like learning environments for RL.
  ☆19Updated last month
• CarperAI / treasure_trove
  ☆22Updated last year
• allenai / easy-to-hard-generalization
  Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"
  ☆44Updated 9 months ago
• abaheti95 / LoL-RL
  Advantage Leftover Lunch Reinforcement Learning (A-LoL RL): Improving Language Models with Advantage-based Offline Policy Gradients
  ☆24Updated 2 months ago
• amirzandieh / HyperAttention
  Triton Implementation of HyperAttention Algorithm
  ☆46Updated 11 months ago