tt-embedding / tt-embeddingsLinks
☆27Updated 5 years ago
Alternatives and similar repositories for tt-embeddings
Users that are interested in tt-embeddings are comparing it to the libraries listed below
Sorting:
- ☆60Updated 4 years ago
- Pytorch library for factorized L0-based pruning.☆45Updated last year
- Compression of NMT transformer model with tensor methods☆48Updated 5 years ago
- [ICLR 2022] Code for paper "Exploring Extreme Parameter Compression for Pre-trained Language Models"(https://arxiv.org/abs/2205.10036)☆22Updated 2 years ago
- ☆64Updated 4 years ago
- Block Sparse movement pruning☆79Updated 4 years ago
- ☆33Updated 4 years ago
- This package implements THOR: Transformer with Stochastic Experts.☆63Updated 3 years ago
- Differentiable Product Quantization for End-to-End Embedding Compression.☆62Updated 2 years ago
- u-MPS implementation and experimentation code used in the paper Tensor Networks for Probabilistic Sequence Modeling (https://arxiv.org/ab…☆19Updated 4 years ago
- A fully tensorized recurrent neural network using tensor-train decomposition☆25Updated 2 years ago
- A Kernel-Based View of Language Model Fine-Tuning https://arxiv.org/abs/2210.05643☆76Updated last year
- An implementation of various tensor-based decomposition for NN & RNN parameters☆18Updated 7 years ago
- ☆11Updated 3 years ago
- Code for "Training Neural Networks with Fixed Sparse Masks" (NeurIPS 2021).☆58Updated 3 years ago
- Structured matrices for compressing neural networks☆66Updated last year
- Tensor product decomposition network☆19Updated 4 years ago
- Code for the paper "BERT Loses Patience: Fast and Robust Inference with Early Exit".☆65Updated 3 years ago
- Block-sparse primitives for PyTorch☆155Updated 4 years ago
- This repository contains the code used for Ordered Memory paper☆30Updated 5 years ago
- Blog post☆17Updated last year
- Code for paper "SWALP: Stochastic Weight Averaging forLow-Precision Training".☆62Updated 6 years ago
- Source code for "Efficient Training of BERT by Progressively Stacking"☆112Updated 5 years ago
- Parameter Efficient Transfer Learning with Diff Pruning☆73Updated 4 years ago
- Factorized Neural Layers☆29Updated last year
- [NeurIPS 2020] "The Lottery Ticket Hypothesis for Pre-trained BERT Networks", Tianlong Chen, Jonathan Frankle, Shiyu Chang, Sijia Liu, Ya…☆140Updated 3 years ago
- Ancestral Gumbel-Top-k Sampling☆24Updated 5 years ago
- MLPruning, PyTorch, NLP, BERT, Structured Pruning☆20Updated 3 years ago
- Code for the paper "A Theoretical Analysis of the Repetition Problem in Text Generation" in AAAI 2021.☆54Updated 2 years ago
- A custom PyTorch layer that is capable of implementing extremely wide and sparse linear layers efficiently☆49Updated last year