Alternatives and similar repositories for sdtt

Users that are interested in sdtt are comparing it to the libraries listed below

• SakanaAI / CycleQD
  CycleQD is a framework for parameter space model merging.
  ☆40Updated 4 months ago
• iwiwi / epochraft
  Checkpointable dataset utilities for foundation model training
  ☆32Updated last year
• SakanaAI / TAID
  Official implementation of "TAID: Temporally Adaptive Interpolated Distillation for Efficient Knowledge Transfer in Language Models"
  ☆106Updated 4 months ago
• kotoba-tech / kotomamba
  Mamba training library developed by kotoba technologies
  ☆71Updated last year
• facebookresearch / MemoryMosaics
  Memory Mosaics are networks of associative memories working in concert to achieve a prediction task.
  ☆44Updated 4 months ago
• SakanaAI / Sudoku-Bench
  An AI benchmark for creative, human-like problem solving using Sudoku variants
  ☆70Updated last month
• Ino-Ichan / GIT-LLM
  ☆22Updated last year
• kuleshov-group / remdm
  Remasking Discrete Diffusion Models with Inference-Time Scaling
  ☆26Updated 3 months ago
• luchris429 / DiscoPOP
  Code for Discovering Preference Optimization Algorithms with and for Large Language Models
  ☆63Updated last year
• SakanaAI / ALE-Bench
  The official repository of ALE-Bench
  ☆78Updated last week
• dangxingyu / rnn-icrag
  Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"
  ☆27Updated last year
• kyegomez / EvoVLM-JP
  Plug in & Play Pytorch Implementation of the paper: "Evolutionary Optimization of Model Merging Recipes" by Sakana AI
  ☆30Updated 7 months ago
• kyleliang919 / Online-Subspace-Descent
  This repo is based on https://github.com/jiaweizzhao/GaLore
  ☆28Updated 9 months ago
• sjelassi / transformers_ssm_copy
  ☆32Updated last year
• Aratako / Task-Vector-Merge-Optimzier
  ☆14Updated last year
• TianjinYellow / SPAM-Optimizer
  ☆33Updated 3 months ago
• RobertCsordas / moeut
  ☆79Updated 10 months ago
• iwiwi / epochraft-hf-fsdp
  Example of using Epochraft to train HuggingFace transformers models with PyTorch FSDP
  ☆11Updated last year
• SerChirag / rs-imle
  RS-IMLE
  ☆40Updated 6 months ago
• ml-jku / EVA
  One Initialization to Rule them All: Fine-tuning via Explained Variance Adaptation
  ☆40Updated 8 months ago
• RobertCsordas / moe
  Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"
  ☆38Updated 2 weeks ago
• wang-kee / LiNeS
  Official repository of "LiNeS: Post-training Layer Scaling Prevents Forgetting and Enhances Model Merging"
  ☆29Updated 7 months ago
• turingmotors / vlm-recipes
  ☆16Updated 9 months ago
• shreyansh26 / Attention-Mask-Patterns
  Using FlexAttention to compute attention with different masking patterns
  ☆44Updated 9 months ago
• lsj2408 / URPE
  [NeurIPS 2022] Your Transformer May Not be as Powerful as You Expect (official implementation)
  ☆34Updated last year
• RE-N-Y / sae
  ☆17Updated 7 months ago
• bentherien / mu_learned_optimization
  [Oral; Neurips OPT2024 ] μLO: Compute-Efficient Meta-Generalization of Learned Optimizers
  ☆13Updated 3 months ago
• borjanG / 2023-transformers-rotf
  Codes for the paper "A mathematical perspective on Transformers".
  ☆37Updated 11 months ago
• turingmotors / One-D-Piece
  One-D-Piece: Image Tokenizer Meets Quality-Controllable Compression
  ☆55Updated this week
• IBM / ColPret
  Efficient Scaling laws and collaborative pretraining.
  ☆16Updated 4 months ago