BlackHC / toma
Helps you write algorithms in PyTorch that adapt to the available (CUDA) memory
☆428Updated 2 months ago
Related projects ⓘ
Alternatives and complementary repositories for toma
- Named tensors with first-class dimensions for PyTorch☆322Updated last year
- A library to inspect and extract intermediate layers of PyTorch models.☆470Updated 2 years ago
- A library that contains a rich collection of performant PyTorch model metrics, a simple interface to create new metrics, a toolkit to fac…☆216Updated last week
- TensorDict is a pytorch dedicated tensor container.☆840Updated last week
- [Prototype] Tools for the concurrent manipulation of variably sized Tensors.☆253Updated 2 years ago
- functorch is JAX-like composable function transforms for PyTorch.☆1,396Updated this week
- Library for 8-bit optimizers and quantization routines.☆714Updated 2 years ago
- Helpful tools and examples for working with flex-attention☆469Updated 3 weeks ago
- Pytorch Lightning Distributed Accelerators using Ray☆211Updated last year
- Cockpit: A Practical Debugging Tool for Training Deep Neural Networks☆473Updated 2 years ago
- PyTorch dataset extended with map, cache etc. (tensorflow.data like)☆328Updated 2 years ago
- For optimization algorithm research and development.☆449Updated this week
- MLCommons Algorithmic Efficiency is a benchmark and competition measuring neural network training speedups due to algorithmic improvement…☆333Updated 3 weeks ago
- Implementation of a Transformer, but completely in Triton☆249Updated 2 years ago
- Recipes are a standard, well supported set of blueprints for machine learning engineers to rapidly train models using the latest research…☆294Updated this week
- Unofficial JAX implementations of deep learning research papers☆151Updated 2 years ago
- Implementation of the Adan (ADAptive Nesterov momentum algorithm) Optimizer in Pytorch☆247Updated 2 years ago
- Implementation of a memory efficient multi-head attention as proposed in the paper, "Self-attention Does Not Need O(n²) Memory"☆360Updated last year
- Configuration classes enabling type-safe PyTorch configuration for Hydra apps☆205Updated 2 years ago
- ML Collections is a library of Python Collections designed for ML use cases.☆896Updated this week
- Fast Block Sparse Matrices for Pytorch☆545Updated 3 years ago
- ☆328Updated this week
- Tensors, for human consumption☆1,113Updated 3 weeks ago
- Code release for "Dropout Reduces Underfitting"☆312Updated last year
- Course webpage for COMP 790, (Deep) Learning from Limited Labeled Data☆302Updated 4 years ago
- BackPACK - a backpropagation package built on top of PyTorch which efficiently computes quantities other than the gradient.☆561Updated this week
- A lightweight library designed to accelerate the process of training PyTorch models by providing a minimal, but extensible training loop …☆176Updated 6 months ago
- Code for our NeurIPS 2022 paper☆363Updated last year
- PIX is an image processing library in JAX, for JAX.☆389Updated last week
- Implementation of fused cosine similarity attention in the same style as Flash Attention☆207Updated last year