HomebrewNLP / revlib
Simple and efficient RevNet-Library for PyTorch with XLA and DeepSpeed support and parameter offload
☆124Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for revlib
- Named tensors with first-class dimensions for PyTorch☆322Updated last year
- Implementation of fused cosine similarity attention in the same style as Flash Attention☆207Updated last year
- Implementation of the Adan (ADAptive Nesterov momentum algorithm) Optimizer in Pytorch☆247Updated 2 years ago
- FFCV-SSL Fast Forward Computer Vision for Self-Supervised Learning.☆203Updated last year
- A case study of efficient training of large language models using commodity hardware.☆68Updated 2 years ago
- Drop-in replacement for any ResNet with a significantly reduced memory footprint and better representation capabilities☆208Updated 6 months ago
- Unofficial JAX implementations of deep learning research papers☆151Updated 2 years ago
- Contrastive Language-Image Pretraining☆143Updated 2 years ago
- Implementations and checkpoints for ResNet, Wide ResNet, ResNeXt, ResNet-D, and ResNeSt in JAX (Flax).☆104Updated 2 years ago
- ☆187Updated 2 years ago
- gpu tester detects broken and slow gpus in a cluster☆67Updated last year
- EfficientNet, MobileNetV3, MobileNetV2, MixNet, etc in JAX w/ Flax Linen and Objax☆126Updated 10 months ago
- Implementation of Nyström Self-attention, from the paper Nyströmformer☆122Updated 10 months ago
- TF/Keras code for DiffStride, a pooling layer with learnable strides.☆124Updated 2 years ago
- Pytorch implementation of preconditioned stochastic gradient descent (affine group preconditioner, low-rank approximation preconditioner …☆127Updated last month
- HomebrewNLP in JAX flavour for maintable TPU-Training☆46Updated 10 months ago
- A GPT, made only of MLPs, in Jax☆55Updated 3 years ago
- Differentiable Algorithms and Algorithmic Supervision.☆105Updated last year
- Image augmentation library for Jax☆37Updated 7 months ago
- Implementation of Feedback Transformer in Pytorch☆104Updated 3 years ago
- A Pytree Module system for Deep Learning in JAX☆214Updated last year
- LoRA for arbitrary JAX models and functions☆132Updated 8 months ago
- Learned Hyperparameter Optimizers☆58Updated 3 years ago
- JMP is a Mixed Precision library for JAX.☆187Updated 6 months ago
- Lightweight Cluster/Cloud VM Job Management 🚀☆41Updated 2 months ago
- Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways - in Jax (Equinox framework)☆185Updated 2 years ago
- Pretrained deep learning models for Jax/Flax: StyleGAN2, GPT2, VGG, ResNet, etc.☆238Updated last year
- Implementation of Hourglass Transformer, in Pytorch, from Google and OpenAI☆84Updated 2 years ago
- Easy-to-use AdaHessian optimizer (PyTorch)☆77Updated 4 years ago