tt-embedding / tt-embeddings
☆27Updated 5 years ago
Alternatives and similar repositories for tt-embeddings:
Users that are interested in tt-embeddings are comparing it to the libraries listed below
- Pytorch library for factorized L0-based pruning.☆44Updated last year
- ☆60Updated 4 years ago
- [ICLR 2022] Code for paper "Exploring Extreme Parameter Compression for Pre-trained Language Models"(https://arxiv.org/abs/2205.10036)☆22Updated last year
- ☆64Updated 4 years ago
- u-MPS implementation and experimentation code used in the paper Tensor Networks for Probabilistic Sequence Modeling (https://arxiv.org/ab…☆19Updated 4 years ago
- An implementation of various tensor-based decomposition for NN & RNN parameters☆18Updated 6 years ago
- Compression of NMT transformer model with tensor methods☆48Updated 5 years ago
- This package implements THOR: Transformer with Stochastic Experts.☆62Updated 3 years ago
- This repository contains the code used for Ordered Memory paper☆29Updated 5 years ago
- A fully tensorized recurrent neural network using tensor-train decomposition☆25Updated 2 years ago
- Differentiable Product Quantization for End-to-End Embedding Compression.☆60Updated 2 years ago
- ☆33Updated 3 years ago
- ☆11Updated 3 years ago
- Structured matrices for compressing neural networks☆66Updated last year
- Code for testing DCT plus Sparse (DCTpS) networks☆14Updated 3 years ago
- PyTorch implementation for PaLM: A Hybrid Parser and Language Model.☆10Updated 5 years ago
- A Kernel-Based View of Language Model Fine-Tuning https://arxiv.org/abs/2210.05643☆74Updated last year
- Code for "Training Neural Networks with Fixed Sparse Masks" (NeurIPS 2021).☆58Updated 3 years ago
- Code for the paper "BERT Loses Patience: Fast and Robust Inference with Early Exit".☆65Updated 3 years ago
- Block Sparse movement pruning☆79Updated 4 years ago
- Parameter Efficient Transfer Learning with Diff Pruning☆73Updated 4 years ago
- Tensor product decomposition network☆19Updated 4 years ago
- Official PyTorch (Lightning) implementation of the NeurIPS 2020 paper "Efficient Marginalization of Discrete and Structured Latent Variab…☆28Updated 3 years ago
- CUDA kernels for generalized matrix-multiplication in PyTorch☆79Updated 3 years ago
- Code accompanying our paper "Feature Learning in Infinite-Width Neural Networks" (https://arxiv.org/abs/2011.14522)☆61Updated 3 years ago
- Experiments with binary LSTM using gumbel-sigmoid☆30Updated 4 years ago
- ENGINE: Energy-Based Inference Networks for Non-Autoregressive Machine Translation☆25Updated 4 years ago
- Metamodeling, sensitivity analysis and visualization using the tensor train format☆22Updated 2 years ago
- Code for the paper: "Tensor Programs II: Neural Tangent Kernel for Any Architecture"☆105Updated 4 years ago
- Code for paper "SWALP: Stochastic Weight Averaging forLow-Precision Training".☆62Updated 5 years ago