facebookresearch / spdl
Scalable and Performant Data Loading
☆44Updated this week
Related projects ⓘ
Alternatives and complementary repositories for spdl
- Framework for writing deep learning training loops. Lightweight, and retaining full freedom to design as you see fits. It handles checkpo…☆103Updated 7 months ago
- PyTorch video decoding☆77Updated this week
- Blazing fast data loading with HuggingFace Dataset and Ray Data☆15Updated 10 months ago
- My attempts at applying Soundstream design on learned tokenization of text and then applying hierarchical attention to text generation☆81Updated last month
- Implementation of a Light Recurrent Unit in Pytorch☆46Updated last month
- An implementation of the Llama architecture, to instruct and delight☆21Updated 2 months ago
- Exploration into the proposed "Self Reasoning Tokens" by Felipe Bonetto☆53Updated 5 months ago
- Implementation of the proposed Adam-atan2 from Google Deepmind in Pytorch☆94Updated 2 weeks ago
- Various transformers for FSDP research☆33Updated 2 years ago
- A home for audio ML in JAX. Has common features, learnable frontends, pretrained supervised and self-supervised models.☆62Updated 2 years ago
- ☆76Updated 5 months ago
- ☆52Updated 2 weeks ago
- ☆17Updated 2 weeks ago
- CUDA implementation of autoregressive linear attention, with all the latest research findings☆43Updated last year
- ☆31Updated 2 years ago
- A dashboard for exploring timm learning rate schedulers☆18Updated last year
- Efficient optimizers☆58Updated this week
- Implementation of the Kalman Filtering Attention proposed in "Kalman Filtering Attention for User Behavior Modeling in CTR Prediction"☆57Updated last year
- A library for unit scaling in PyTorch☆105Updated this week
- ☆84Updated 7 months ago
- Implementation of Acoustic BPE (Shen et al., 2024), extended for RVQ-based Neural Audio Codecs☆46Updated last month
- Experiment of using Tangent to autodiff triton☆71Updated 9 months ago
- Implementation of the proposed MaskBit from Bytedance AI☆58Updated 2 weeks ago
- Audio tokenization, in the fastest way possible!☆45Updated 2 months ago
- Residual Quantization with Implicit Neural Codebooks☆48Updated 3 months ago
- Just some miscellaneous utility functions / decorators / modules related to Pytorch and Accelerate to help speed up implementation of new…☆117Updated 3 months ago
- PyTorch implementation of Audio Flamingo: A Novel Audio Language Model with Few-Shot Learning and Dialogue Abilities.☆189Updated last month
- Transformer with Mu-Parameterization, implemented in Jax/Flax. Supports FSDP on TPU pods.☆29Updated last week
- Randomized Positional Encodings Boost Length Generalization of Transformers☆79Updated 7 months ago
- Transcribing Speech with Multinomial Diffusion, training code and models.☆75Updated last year