Alternatives and similar repositories for Derf

Users that are interested in Derf are comparing it to the libraries listed below

• tokenbender / mHC-manifold-constrained-hyper-connections
  implementations and experimentation on mHC by deepseek - https://arxiv.org/abs/2512.24880
  ☆202Updated last week
• RWKV / RWKV-LM
  RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best…
  ☆59Updated 9 months ago
• galilai-group / llm-jepa
  ☆154Updated 3 months ago
• martin-marek / batch-size
  📄Small Batch Size Training for Language Models
  ☆79Updated 3 months ago
• HanGuo97 / log-linear-attention
  ☆263Updated 7 months ago
• jacobfa / fft
  ☆129Updated 5 months ago
• apple / ml-l3m
  Large multi-modal models (L3M) pre-training.
  ☆224Updated 3 months ago
• lucidrains / deep-cross-attention
  Implementation of the proposed DeepCrossAttention by Heddes et al at Google research, in Pytorch
  ☆96Updated 10 months ago
• JinjieNi / dlms-are-super-data-learners
  The official github repo for "Diffusion Language Models are Super Data Learners".
  ☆215Updated 2 months ago
• zhixuan-lin / forgetting-transformer
  [ICLR 2025 & COLM 2025] Official PyTorch implementation of the Forgetting Transformer and Adaptive Computation Pruning
  ☆134Updated 3 weeks ago
• zaydzuhri / softpick-attention
  Landing repository for the paper "Softpick: No Attention Sink, No Massive Activations with Rectified Softmax"
  ☆86Updated 4 months ago
• thinking-machines-lab / manifolds
  Supporting code for the blog post on modular manifolds.
  ☆111Updated 3 months ago
• facebookresearch / Mixture-of-Transformers
  Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Models. TMLR 2025.
  ☆134Updated 3 months ago
• apple / ml-sigmoid-attention
  ☆304Updated 8 months ago
• sayakpaul / nanoDiT
  Just another reasonably minimal repo for class-conditional training of pixel-space diffusion transformers.
  ☆142Updated 7 months ago
• s-sahoo / Eso-LMs
  Esoteric Language Models
  ☆108Updated last month
• riverstone496 / awesome-second-order-optimization
  ☆27Updated 3 months ago
• model-architectures / GRAPE
  Official implementation of GRAPE: Group Representational Position Encoding (https://arxiv.org/abs/2512.07805)
  ☆70Updated last week
• test-time-training / ttt-lm-kernels
  Inference Speed Benchmark for Learning to (Learn at Test Time): RNNs with Expressive Hidden States
  ☆78Updated last year
• amorehead / jvp_flash_attention
  Flash Attention Triton kernel with support for second-order derivatives
  ☆129Updated 3 weeks ago
• Zyphra / Zamba2
  PyTorch implementation of models from the Zamba2 series.
  ☆185Updated 11 months ago
• NX-AI / mlstm_kernels
  Tiled Flash Linear Attention library for fast and efficient mLSTM Kernels.
  ☆81Updated last month
• IST-DASLab / QuEST
  Work in progress.
  ☆76Updated last month
• ChenWu98 / algorithmic-creativity
  [ICML 2025] Roll the dice & look before you leap: Going beyond the creative limits of next-token prediction
  ☆82Updated 7 months ago
• declare-lab / EFLA
  Official Repo for Error-Free Linear Attention is a Free Lunch: Exact Solution from Continuous-Time Dynamics
  ☆69Updated 2 weeks ago
• sail-sg / Precision-RL
  Defeating the Training-Inference Mismatch via FP16
  ☆172Updated last month
• howard-hou / RWKV-X
  RWKV-X is a Linear Complexity Hybrid Language Model based on the RWKV architecture, integrating Sparse Attention to improve the model's l…
  ☆53Updated 5 months ago
• tanaymeh / mamba-train
  A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIM
  ☆61Updated last year
• ShangyuanTong / FreeFlow
  Official PyTorch Implementation of "Flow Map Distillation Without Data"
  ☆112Updated last month
• goombalab / hydra
  Official implementation of "Hydra: Bidirectional State Space Models Through Generalized Matrix Mixers"
  ☆170Updated 11 months ago