vvvm23 / TchAIkovsky
Using JAX to generate piano music as MIDI
☆38Updated 11 months ago
Related projects ⓘ
Alternatives and complementary repositories for TchAIkovsky
- Collection of autoregressive model implementation☆67Updated this week
- Implementation of Perceiver AR, Deepmind's new long-context attention network based on Perceiver architecture, in Pytorch☆86Updated last year
- Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"☆85Updated 2 months ago
- ☆18Updated last month
- A JAX implementation of the continuous time formulation of Consistency Models☆83Updated last year
- supporting pytorch FSDP for optimizers☆35Updated this week
- Utilities for PyTorch distributed☆23Updated last year
- ☆19Updated 2 weeks ago
- Transformer with Mu-Parameterization, implemented in Jax/Flax. Supports FSDP on TPU pods.☆29Updated 3 weeks ago
- An implementation of the Llama architecture, to instruct and delight☆21Updated 3 months ago
- Implementation of a Light Recurrent Unit in Pytorch☆46Updated last month
- ☆48Updated last week
- Examples of apps built with Nendo, the AI Audio Tool Suite☆56Updated 8 months ago
- Latent Diffusion Language Models☆67Updated last year
- Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training☆113Updated 7 months ago
- σ-GPT: A New Approach to Autoregressive Models☆59Updated 3 months ago
- Audiocraft is a library for audio processing and generation with deep learning. It features the state-of-the-art EnCodec audio compressor…☆53Updated 7 months ago
- An implementation of PSGD Kron second-order optimizer for PyTorch☆16Updated this week
- Implementation of GateLoop Transformer in Pytorch and Jax☆86Updated 5 months ago
- A State-Space Model with Rational Transfer Function Representation.☆71Updated 6 months ago
- Implementation of the proposed Spline-Based Transformer from Disney Research☆77Updated 2 weeks ago
- Framework for writing deep learning training loops. Lightweight, and retaining full freedom to design as you see fits. It handles checkpo…☆103Updated 8 months ago
- Cerule - A Tiny Mighty Vision Model☆67Updated 2 months ago
- Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.☆35Updated 4 months ago
- ☆42Updated last month
- Train vision models using JAX and 🤗 transformers☆96Updated last month
- FID computation in Jax/Flax.☆24Updated 4 months ago
- Explorations into the recently proposed Taylor Series Linear Attention☆90Updated 3 months ago
- Minimal Implimentation of VCRec (2024) for collapse provention.☆16Updated 7 months ago