kelechi-c / dit_flowLinks
DiT (training + flow matching) in Jax
☆10Updated 11 months ago
Alternatives and similar repositories for dit_flow
Users that are interested in dit_flow are comparing it to the libraries listed below
Sorting:
- JAX Implementation of Black Forest Labs' Flux.1 family of models☆39Updated 3 weeks ago
- Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX☆92Updated last year
- Implementation of GateLoop Transformer in Pytorch and Jax☆91Updated last year
- ☆35Updated last year
- Implementation of numerous Vision Transformers in Google's JAX and Flax.☆22Updated 3 years ago
- A repo based on XiLin Li's PSGD repo that extends some of the experiments.☆14Updated last year
- Maximal Update Parametrization (μP) with Flax & Optax.☆16Updated last year
- Tiny re-implementation of MDM in style of LLaDA and nano-gpt speedrun☆56Updated 9 months ago
- ☆122Updated 6 months ago
- Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"☆103Updated 11 months ago
- supporting pytorch FSDP for optimizers☆84Updated last year
- ☆34Updated last year
- LoRA for arbitrary JAX models and functions☆143Updated last year
- Lightning-like training API for JAX with Flax☆44Updated last year
- Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.☆18Updated 4 months ago
- Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training☆132Updated last year
- A State-Space Model with Rational Transfer Function Representation.☆83Updated last year
- ☆82Updated last year
- Explorations into the recently proposed Taylor Series Linear Attention☆100Updated last year
- ☆53Updated last year
- Code for the paper "Function-Space Learning Rates"☆23Updated 6 months ago
- A flexible and efficient implementation of Flash Attention 2.0 for JAX, supporting multiple backends (GPU/TPU/CPU) and platforms (Triton/…☆32Updated 9 months ago
- ☆153Updated last month
- ☆28Updated last year
- Exploration into the proposed "Self Reasoning Tokens" by Felipe Bonetto☆57Updated last year
- Yet another random morning idea to be quickly tried and architecture shared if it works; to allow the transformer to pause for any amount…☆53Updated 2 years ago
- Minimal but scalable implementation of large language models in JAX☆35Updated 3 weeks ago
- Machine Learning eXperiment Utilities☆46Updated 4 months ago
- A simple library for scaling up JAX programs☆144Updated last month
- ☆38Updated last year