tt-embedding / tt-embeddings
☆27Updated 5 years ago
Related projects ⓘ
Alternatives and complementary repositories for tt-embeddings
- ☆61Updated 4 years ago
- Pytorch library for factorized L0-based pruning.☆43Updated last year
- ☆62Updated 3 years ago
- [ICLR 2022] Code for paper "Exploring Extreme Parameter Compression for Pre-trained Language Models"(https://arxiv.org/abs/2205.10036)☆19Updated last year
- ☆11Updated 2 years ago
- Compression of NMT transformer model with tensor methods☆46Updated 5 years ago
- An implementation of various tensor-based decomposition for NN & RNN parameters☆18Updated 6 years ago
- Structured matrices for compressing neural networks☆67Updated last year
- A fully tensorized recurrent neural network using tensor-train decomposition☆25Updated last year
- STABILIZING GRADIENTS FOR DEEP NEURAL NETWORKS VIA EFFICIENT SVD PARAMETERIZATION☆16Updated 6 years ago
- u-MPS implementation and experimentation code used in the paper Tensor Networks for Probabilistic Sequence Modeling (https://arxiv.org/ab…☆19Updated 4 years ago
- This package implements THOR: Transformer with Stochastic Experts.☆61Updated 3 years ago
- ☆32Updated 3 years ago
- Tensor product decomposition network☆18Updated 3 years ago
- PyTorch implementation for PaLM: A Hybrid Parser and Language Model.☆10Updated 4 years ago
- Block Sparse movement pruning☆78Updated 3 years ago
- Blog post☆16Updated 8 months ago
- A Kernel-Based View of Language Model Fine-Tuning https://arxiv.org/abs/2210.05643☆69Updated last year
- Code for the paper "A Theoretical Analysis of the Repetition Problem in Text Generation" in AAAI 2021.☆51Updated 2 years ago
- Python implementation of paper "AntisymmetricRNN: A Dynamical System View on Recurrent Neural Networks"☆14Updated 5 years ago
- ☆42Updated 6 years ago
- Differentiable Product Quantization for End-to-End Embedding Compression.☆58Updated last year
- ☆15Updated 2 years ago
- Metamodeling, sensitivity analysis and visualization using the tensor train format☆23Updated 2 years ago
- This repository contains the code used for Ordered Memory paper☆29Updated 4 years ago
- A simple module consistently outperforms self-attention and Transformer model on main NMT datasets with SoTA performance.☆87Updated last year
- Recursive Bayesian Networks☆11Updated last month
- Code for Neural Execution Engines: Learning to Execute Subroutines☆16Updated 3 years ago
- This is a code repository for the ACL 2022 paper "ODE Transformer: An Ordinary Differential Equation-Inspired Model for Sequence Generati…☆29Updated 2 years ago
- Boolean Question Answering with multi-task learning and uses large LM embeddings like BERT, RoBERTa☆18Updated 5 years ago