lernapparat / torchhacks
Hacks for PyTorch
☆19Updated 2 years ago
Alternatives and similar repositories for torchhacks:
Users that are interested in torchhacks are comparing it to the libraries listed below
- CUDA implementation of autoregressive linear attention, with all the latest research findings☆44Updated last year
- Experiment of using Tangent to autodiff triton☆78Updated last year
- Triton Implementation of HyperAttention Algorithm☆47Updated last year
- ☆29Updated 2 years ago
- Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.☆45Updated 9 months ago
- A place to store reusable transformer components of my own creation or found on the interwebs☆49Updated last week
- ☆21Updated last month
- Make triton easier☆47Updated 10 months ago
- FID computation in Jax/Flax.☆27Updated 9 months ago
- Context Manager to profile the forward and backward times of PyTorch's nn.Module☆83Updated last year
- FlexAttention w/ FlashAttention3 Support☆26Updated 6 months ago
- An implementation of the Llama architecture, to instruct and delight☆21Updated 3 months ago
- Personal solutions to the Triton Puzzles☆18Updated 9 months ago
- A GPT, made only of MLPs, in Jax☆57Updated 3 years ago
- High performance pytorch modules☆18Updated 2 years ago
- Source-to-Source Debuggable Derivatives in Pure Python☆15Updated last year
- Contains my experiments with the `big_vision` repo to train ViTs on ImageNet-1k.☆22Updated 2 years ago
- Utilities for Training Very Large Models☆58Updated 7 months ago
- PyTorch centric eager mode debugger☆47Updated 4 months ago
- Experimental scripts for researching data adaptive learning rate scheduling.☆23Updated last year
- Utilities for PyTorch distributed☆24Updated last month
- Triton kernels for Flux☆20Updated 3 months ago
- JAX implementation of Learning to learn by gradient descent by gradient descent☆27Updated 6 months ago
- ImageNet-12k subset of ImageNet-21k (fall11)☆21Updated last year
- Parallel Associative Scan for Language Models☆18Updated last year
- An open source implementation of CLIP.☆32Updated 2 years ago
- This is a port of Mistral-7B model in JAX☆32Updated 9 months ago
- Memory-Efficient CUDA kernels for training ConvNets with PyTorch.☆40Updated 2 months ago
- Little article showing how to load pytorch's models with linear memory consumption☆34Updated 2 years ago
- A collection of optimizers, some arcane others well known, for Flax.☆29Updated 3 years ago