Alternatives and similar repositories for SAE-Reasoning:

Users that are interested in SAE-Reasoning are comparing it to the libraries listed below

• Leiay / looped_transformer
  ☆24Updated last year
• FusionBrainLab / LLM-Microscope
  ☆71Updated 7 months ago
• epfml / schedules-and-scaling
  Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"
  ☆71Updated 5 months ago
• fal-ai-community / nano-mdm
  Tiny re-implementation of MDM in style of LLaDA and nano-gpt speedrun
  ☆44Updated 3 weeks ago
• RobertCsordas / moeut
  ☆74Updated 7 months ago
• SynthLabsAI / big-math
  A Large-Scale, High-Quality Math Dataset for Reinforcement Learning in Language Models
  ☆44Updated last month
• dmis-lab / Monet
  [ICLR 2025] Monet: Mixture of Monosemantic Experts for Transformers
  ☆60Updated 2 months ago
• sail-sg / dice
  Official implementation of Bootstrapping Language Models via DPO Implicit Rewards
  ☆43Updated 8 months ago
• liziniu / cold_start_rl
  Code for Blog Post: Can Better Cold-Start Strategies Improve RL Training for LLMs?
  ☆16Updated 3 weeks ago
• architsharma97 / dpo-rlaif
  ☆96Updated 9 months ago
• ahans30 / goldfish-loss
  [NeurIPS 2024] Goldfish Loss: Mitigating Memorization in Generative LLMs
  ☆84Updated 4 months ago
• NathanGodey / qfilters
  Repository for the Q-Filters method (https://arxiv.org/pdf/2503.02812)
  ☆26Updated 3 weeks ago
• dangxingyu / rnn-icrag
  Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"
  ☆26Updated 11 months ago
• melisa-writer / short-transformers
  Prune transformer layers
  ☆68Updated 10 months ago
• frankxwang / dpo-prefix-sharing
  DPO, but faster 🚀
  ☆40Updated 3 months ago
• mlfoundations / scaling
  Language models scale reliably with over-training and on downstream tasks
  ☆96Updated last year
• hamishivi / automated-instruction-selection
  Exploration of automated dataset selection approaches at large scales.
  ☆34Updated 3 weeks ago
• sail-sg / SkyLadder
  The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling
  ☆28Updated last week
• hkust-nlp / PreSelect
  ☆41Updated 3 weeks ago
• shenao-zhang / SELM
  The official implementation of Self-Exploring Language Models (SELM)
  ☆62Updated 9 months ago
• AIRI-Institute / LLM-Microscope
  ☆32Updated 3 weeks ago
• Nix07 / finetuning
  This repository contains the code used for the experiments in the paper "Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity…
  ☆25Updated last year
• wang-kee / LiNeS
  Official repository of "LiNeS: Post-training Layer Scaling Prevents Forgetting and Enhances Model Merging"
  ☆24Updated 4 months ago
• ryoungj / BoLT
  Code for "Reasoning to Learn from Latent Thoughts"
  ☆77Updated this week
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆47Updated 7 months ago
• activatedgeek / calibration-tuning
  ☆49Updated 7 months ago
• sjelassi / transformers_ssm_copy
  ☆30Updated last year
• PKU-ML / LongPPL
  Code for ICLR 2025 Paper "What is Wrong with Perplexity for Long-context Language Modeling?"
  ☆44Updated this week
• Infini-AI-Lab / S2FT
  ☆16Updated 2 months ago
• open-compass / GPassK
  Official Repository of Are Your LLMs Capable of Stable Reasoning?
  ☆23Updated 2 weeks ago