huggingface / pytorch_block_sparse
Fast Block Sparse Matrices for Pytorch
☆546Updated 3 years ago
Related projects: ⓘ
- Library for 8-bit optimizers and quantization routines.☆713Updated 2 years ago
- [Prototype] Tools for the concurrent manipulation of variably sized Tensors.☆252Updated last year
- Experimental ground for optimizing memory of pytorch models☆356Updated 6 years ago
- Long Range Arena for Benchmarking Efficient Transformers☆711Updated 9 months ago
- A GPU performance profiling tool for PyTorch models☆493Updated 3 years ago
- PyTorch layer-by-layer model profiler☆608Updated 3 years ago
- End-to-end training of sparse deep neural networks with little-to-no performance loss.☆315Updated last year
- Profiling and inspecting memory in pytorch☆1,013Updated last month
- functorch is JAX-like composable function transforms for PyTorch.☆1,389Updated this week
- Fast, general, and tested differentiable structured prediction in PyTorch☆1,105Updated 2 years ago
- Efficient, check-pointed data loading for deep learning with massive data sets.☆203Updated last year
- Helps you write algorithms in PyTorch that adapt to the available (CUDA) memory☆419Updated 3 weeks ago
- Understanding the Difficulty of Training Transformers☆325Updated 2 years ago
- Implementation of https://arxiv.org/abs/1904.00962☆366Updated 3 years ago
- ☆360Updated 11 months ago
- Implementation for the Lookahead Optimizer.☆236Updated 2 years ago
- PyTorch dataset extended with map, cache etc. (tensorflow.data like)☆328Updated 2 years ago
- Block-sparse primitives for PyTorch☆147Updated 3 years ago
- Cockpit: A Practical Debugging Tool for Training Deep Neural Networks☆474Updated 2 years ago
- Tutorial for building a custom CUDA function for Pytorch☆515Updated 5 years ago
- Library for faster pinned CPU <-> GPU transfer in Pytorch☆682Updated 4 years ago
- A repository in preparation for open-sourcing lottery ticket hypothesis code.☆625Updated 2 years ago
- Automatic differentiation with weighted finite-state transducers.☆453Updated 2 years ago
- Named tensors with first-class dimensions for PyTorch☆321Updated last year
- Sparse learning library and sparse momentum resources.☆377Updated 2 years ago
- Flexible components pairing 🤗 Transformers with Pytorch Lightning☆610Updated last year
- Prune a model while finetuning or training.☆392Updated 2 years ago
- Implementation of a Transformer, but completely in Triton☆242Updated 2 years ago
- FastFormers - highly efficient transformer models for NLU☆700Updated 8 months ago
- [ACL'20] HAT: Hardware-Aware Transformers for Efficient Natural Language Processing☆325Updated 2 months ago