tt-embedding / tt-embeddings
☆27Updated 5 years ago
Alternatives and similar repositories for tt-embeddings
Users that are interested in tt-embeddings are comparing it to the libraries listed below
Sorting:
- ☆60Updated 4 years ago
- [ICLR 2022] Code for paper "Exploring Extreme Parameter Compression for Pre-trained Language Models"(https://arxiv.org/abs/2205.10036)☆22Updated last year
- Pytorch library for factorized L0-based pruning.☆45Updated last year
- ☆11Updated 3 years ago
- u-MPS implementation and experimentation code used in the paper Tensor Networks for Probabilistic Sequence Modeling (https://arxiv.org/ab…☆19Updated 4 years ago
- Compression of NMT transformer model with tensor methods☆48Updated 5 years ago
- A fully tensorized recurrent neural network using tensor-train decomposition☆25Updated 2 years ago
- A Kernel-Based View of Language Model Fine-Tuning https://arxiv.org/abs/2210.05643☆76Updated last year
- STABILIZING GRADIENTS FOR DEEP NEURAL NETWORKS VIA EFFICIENT SVD PARAMETERIZATION☆16Updated 6 years ago
- ☆64Updated 4 years ago
- An implementation of various tensor-based decomposition for NN & RNN parameters☆18Updated 6 years ago
- Structured matrices for compressing neural networks☆66Updated last year
- This repository contains the code used for Ordered Memory paper☆30Updated 5 years ago
- This package implements THOR: Transformer with Stochastic Experts.☆62Updated 3 years ago
- Improving Neural Text Generation with Reinforcement Learning☆22Updated 4 years ago
- Differentiable Product Quantization for End-to-End Embedding Compression.☆62Updated 2 years ago
- Ancestral Gumbel-Top-k Sampling☆24Updated 5 years ago
- ☆33Updated 4 years ago
- Block Sparse movement pruning☆79Updated 4 years ago
- Tensor product decomposition network☆19Updated 4 years ago
- Code for Paper: Calibrated Language Model Fine-Tuning for In- and Out-of-Distribution Data☆35Updated 4 years ago
- Code for the PAPA paper☆27Updated 2 years ago
- The official repository for our paper "The Neural Data Router: Adaptive Control Flow in Transformers Improves Systematic Generalization".☆33Updated 3 years ago
- Recursive Bayesian Networks☆11Updated 5 months ago
- [ACL 2023]: Training Trajectories of Language Models Across Scales https://arxiv.org/pdf/2212.09803.pdf☆23Updated last year
- PyTorch implementation for PaLM: A Hybrid Parser and Language Model.☆10Updated 5 years ago
- [NeurIPS 2022]MorphTE: Injecting Morphology in Tensorized Embeddings☆17Updated 2 years ago
- Implementation of Stochastic Beam Search using Fairseq☆102Updated 6 years ago
- Code for gradient rollback, which explains predictions of neural matrix factorization models, as for example used for knowledge base comp…☆21Updated 4 years ago
- Code for ICML 2020 paper: Do RNN and LSTM have Long Memory?☆17Updated 4 years ago