zlab-princeton / DerfLinks
Official Implementation of Dynamic erf (Derf).
☆100Updated last month
Alternatives and similar repositories for Derf
Users that are interested in Derf are comparing it to the libraries listed below
Sorting:
- implementations and experimentation on mHC by deepseek - https://arxiv.org/abs/2512.24880☆202Updated last week
- RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best…☆59Updated 9 months ago
- ☆154Updated 3 months ago
- 📄Small Batch Size Training for Language Models☆79Updated 3 months ago
- ☆263Updated 7 months ago
- ☆129Updated 5 months ago
- Large multi-modal models (L3M) pre-training.☆224Updated 3 months ago
- Implementation of the proposed DeepCrossAttention by Heddes et al at Google research, in Pytorch☆96Updated 10 months ago
- The official github repo for "Diffusion Language Models are Super Data Learners".☆215Updated 2 months ago
- [ICLR 2025 & COLM 2025] Official PyTorch implementation of the Forgetting Transformer and Adaptive Computation Pruning☆134Updated 3 weeks ago
- Landing repository for the paper "Softpick: No Attention Sink, No Massive Activations with Rectified Softmax"☆86Updated 4 months ago
- Supporting code for the blog post on modular manifolds.☆111Updated 3 months ago
- Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Models. TMLR 2025.☆134Updated 3 months ago
- ☆304Updated 8 months ago
- Just another reasonably minimal repo for class-conditional training of pixel-space diffusion transformers.☆142Updated 7 months ago
- Esoteric Language Models☆108Updated last month
- ☆27Updated 3 months ago
- Official implementation of GRAPE: Group Representational Position Encoding (https://arxiv.org/abs/2512.07805)☆70Updated last week
- Inference Speed Benchmark for Learning to (Learn at Test Time): RNNs with Expressive Hidden States☆78Updated last year
- Flash Attention Triton kernel with support for second-order derivatives☆129Updated 3 weeks ago
- PyTorch implementation of models from the Zamba2 series.☆185Updated 11 months ago
- Tiled Flash Linear Attention library for fast and efficient mLSTM Kernels.☆81Updated last month
- Work in progress.☆76Updated last month
- [ICML 2025] Roll the dice & look before you leap: Going beyond the creative limits of next-token prediction☆82Updated 7 months ago
- Official Repo for Error-Free Linear Attention is a Free Lunch: Exact Solution from Continuous-Time Dynamics☆69Updated 2 weeks ago
- Defeating the Training-Inference Mismatch via FP16☆172Updated last month
- RWKV-X is a Linear Complexity Hybrid Language Model based on the RWKV architecture, integrating Sparse Attention to improve the model's l…☆53Updated 5 months ago
- A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIM☆61Updated last year
- Official PyTorch Implementation of "Flow Map Distillation Without Data"☆112Updated last month
- Official implementation of "Hydra: Bidirectional State Space Models Through Generalized Matrix Mixers"☆170Updated 11 months ago