Francesco215 / autoregressive_diffusion
Video Diffusion Model. Autoregressive, long context, efficient training and inference
☆28Updated this week
Alternatives and similar repositories for autoregressive_diffusion
Users that are interested in autoregressive_diffusion are comparing it to the libraries listed below
Sorting:
- Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"☆99Updated 4 months ago
- ☆94Updated 3 months ago
- Focused on fast experimentation and simplicity☆72Updated 4 months ago
- σ-GPT: A New Approach to Autoregressive Models☆64Updated 9 months ago
- WIP☆93Updated 9 months ago
- Implementation of Gradient Agreement Filtering, from Chaubard et al. of Stanford, but for single machine microbatches, in Pytorch☆25Updated 3 months ago
- Implementation of the proposed Spline-Based Transformer from Disney Research☆88Updated 6 months ago
- My take on Flow Matching☆55Updated 4 months ago
- The boundary of neural network trainability is fractal☆198Updated last year
- Synthetic Alphabet Dataset☆18Updated last month
- ☆49Updated last year
- Code and weights for the paper "Cluster and Predict Latents Patches for Improved Masked Image Modeling"☆102Updated last month
- Latent Program Network (from the "Searching Latent Program Spaces" paper)☆82Updated 2 months ago
- LLMs represent numbers on a helix and manipulate that helix to do addition.☆24Updated 3 months ago
- JAX Implementation of Black Forest Labs' Flux.1 family of models☆32Updated 6 months ago
- ☆34Updated 4 months ago
- supporting pytorch FSDP for optimizers☆80Updated 5 months ago
- ☆36Updated 5 months ago
- $100K or 100 Days: Trade-offs when Pre-Training with Academic Resources☆139Updated 2 months ago
- FID computation in Jax/Flax.☆27Updated 10 months ago
- DeMo: Decoupled Momentum Optimization☆186Updated 5 months ago
- ☆27Updated 10 months ago
- ☆111Updated 4 months ago
- ☆43Updated 5 months ago
- Mixture of A Million Experts☆44Updated 9 months ago
- an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)☆98Updated 2 months ago
- Efficient World Models with Context-Aware Tokenization. ICML 2024☆98Updated 7 months ago
- ☆27Updated last year
- ☆33Updated 8 months ago
- Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training☆123Updated last year