Alternatives and similar repositories for sdtt

Users that are interested in sdtt are comparing it to the libraries listed below

• SakanaAI / CycleQD
  CycleQD is a framework for parameter space model merging.
  ☆40Updated 5 months ago
• iwiwi / epochraft
  Checkpointable dataset utilities for foundation model training
  ☆32Updated last year
• kotoba-tech / kotomamba
  Mamba training library developed by kotoba technologies
  ☆71Updated last year
• SakanaAI / TAID
  Official implementation of "TAID: Temporally Adaptive Interpolated Distillation for Efficient Knowledge Transfer in Language Models"
  ☆111Updated 5 months ago
• luchris429 / DiscoPOP
  Code for Discovering Preference Optimization Algorithms with and for Large Language Models
  ☆63Updated last year
• SakanaAI / Sudoku-Bench
  An AI benchmark for creative, human-like problem solving using Sudoku variants
  ☆77Updated 2 months ago
• fal-ai-community / nano-mdm
  Tiny re-implementation of MDM in style of LLaDA and nano-gpt speedrun
  ☆55Updated 4 months ago
• facebookresearch / MemoryMosaics
  Memory Mosaics are networks of associative memories working in concert to achieve a prediction task.
  ☆45Updated 5 months ago
• kuleshov-group / remdm
  Remasking Discrete Diffusion Models with Inference-Time Scaling
  ☆34Updated 4 months ago
• wang-kee / LiNeS
  Official repository of "LiNeS: Post-training Layer Scaling Prevents Forgetting and Enhances Model Merging"
  ☆29Updated 8 months ago
• smonsays / hypernetwork-attention
  Official code for the paper "Attention as a Hypernetwork"
  ☆40Updated last year
• dangxingyu / rnn-icrag
  Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"
  ☆27Updated last year
• zaydzuhri / softpick-attention
  Implementations of attention with the softpick function, naive and FlashAttention-2
  ☆80Updated 2 months ago
• goombalab / phi-mamba
  Official implementation of Phi-Mamba. A MOHAWK-distilled model (Transformers to SSMs: Distilling Quadratic Knowledge to Subquadratic Mode…
  ☆110Updated 10 months ago
• sustcsonglin / gated_linear_attention_layer
  ☆32Updated last year
• google-deepmind / spectral_ssm
  ☆32Updated last year
• RWKV / ZeroCoT
  https://x.com/BlinkDL_AI/status/1884768989743882276
  ☆28Updated 2 months ago
• zaydzuhri / flame
  Fork of Flame repo for training of some new stuff in development
  ☆14Updated last week
• RE-N-Y / sae
  ☆17Updated 7 months ago
• zhixuan-lin / forgetting-transformer
  [ICLR 2025] Official PyTorch implementation of "Forgetting Transformer: Softmax Attention with a Forget Gate"
  ☆116Updated last week
• graphcore-research / jax-scalify
  JAX Scalify: end-to-end scaled arithmetics
  ☆16Updated 8 months ago
• epfml / schedules-and-scaling
  Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"
  ☆75Updated 8 months ago
• yukara-ikemiya / modified-shortcut-models-pytorch
  PyTorch implementation of Shortcut Models [Frans, 2025] with little modification
  ☆41Updated this week
• sjelassi / transformers_ssm_copy
  ☆32Updated last year
• tobiaskatsch / GatedLinearRNN
  ☆28Updated last year
• nreHieW / minARImageGen
  Autoregressive Image Generation
  ☆32Updated last month
• TRI-ML / linear_open_lm
  A repository for research on medium sized language models.
  ☆77Updated last year
• TianjinYellow / SPAM-Optimizer
  ☆33Updated 4 months ago
• dvruette / gidd
  Code accompanying the paper "Generalized Interpolating Discrete Diffusion"
  ☆94Updated last month
• BlinkDL / LinearAttentionArena
  Here we will test various linear attention designs.
  ☆60Updated last year