huggingface / pytorch_block_sparse
Fast Block Sparse Matrices for Pytorch
☆545Updated 4 years ago
Alternatives and similar repositories for pytorch_block_sparse:
Users that are interested in pytorch_block_sparse are comparing it to the libraries listed below
- Library for 8-bit optimizers and quantization routines.☆716Updated 2 years ago
- End-to-end training of sparse deep neural networks with little-to-no performance loss.☆321Updated 2 years ago
- Long Range Arena for Benchmarking Efficient Transformers☆751Updated last year
- Block-sparse primitives for PyTorch☆155Updated 4 years ago
- [Prototype] Tools for the concurrent manipulation of variably sized Tensors.☆251Updated 2 years ago
- ☆376Updated last year
- PyTorch dataset extended with map, cache etc. (tensorflow.data like)☆329Updated 2 years ago
- functorch is JAX-like composable function transforms for PyTorch.☆1,424Updated this week
- Experimental ground for optimizing memory of pytorch models☆365Updated 7 years ago
- Implementation of https://arxiv.org/abs/1904.00962☆374Updated 4 years ago
- Slicing a PyTorch Tensor Into Parallel Shards☆298Updated 3 years ago
- Profiling and inspecting memory in pytorch☆1,056Updated 9 months ago
- PyTorch layer-by-layer model profiler☆607Updated 3 years ago
- Prune a model while finetuning or training.☆402Updated 2 years ago
- Fully featured implementation of Routing Transformer☆291Updated 3 years ago
- A GPU performance profiling tool for PyTorch models☆505Updated 3 years ago
- Understanding the Difficulty of Training Transformers☆329Updated 2 years ago
- Tutorial for building a custom CUDA function for Pytorch☆511Updated 6 years ago
- Gradient based Hyperparameter Tuning library in PyTorch☆289Updated 4 years ago
- Implementation for the Lookahead Optimizer.☆241Updated 3 years ago
- Fast, general, and tested differentiable structured prediction in PyTorch☆1,111Updated 3 years ago
- Sinkhorn Transformer - Practical implementation of Sparse Sinkhorn Attention☆262Updated 3 years ago
- Library for faster pinned CPU <-> GPU transfer in Pytorch☆685Updated 5 years ago
- [ACL'20] HAT: Hardware-Aware Transformers for Efficient Natural Language Processing☆333Updated 9 months ago
- Implicit MLE: Backpropagating Through Discrete Exponential Family Distributions☆258Updated last year
- Shape and dimension inference (Keras-like) for PyTorch layers and neural networks☆571Updated 2 years ago
- Named tensors with first-class dimensions for PyTorch☆320Updated last year
- Pytorch library for fast transformer implementations☆1,701Updated 2 years ago
- Flexible components pairing 🤗 Transformers with Pytorch Lightning☆608Updated 2 years ago
- Efficient, check-pointed data loading for deep learning with massive data sets.☆207Updated last year