Alternatives and similar repositories for tt-embeddings:

Users that are interested in tt-embeddings are comparing it to the libraries listed below

• KhrulkovV / tt-pytorch
  ☆60Updated 4 years ago
• asappresearch / flop
  Pytorch library for factorized L0-based pruning.
  ☆44Updated last year
• szhangtju / The-compression-of-Transformer
  ☆63Updated 4 years ago
• twinkle0331 / Xcompression
  [ICLR 2022] Code for paper "Exploring Extreme Parameter Compression for Pre-trained Language Models"(https://arxiv.org/abs/2205.10036)
  ☆22Updated last year
• Noahs-ARK / RFA
  ☆33Updated 3 years ago
• khakhulin / compressed-transformer
  Compression of NMT transformer model with tensor methods
  ☆48Updated 5 years ago
• androstj / tensor_rnn
  An implementation of various tensor-based decomposition for NN & RNN parameters
  ☆18Updated 6 years ago
• rballester / ttrecipes
  Metamodeling, sensitivity analysis and visualization using the tensor train format
  ☆22Updated 2 years ago
• onucharles / tensorized-rnn
  A fully tensorized recurrent neural network using tensor-train decomposition
  ☆25Updated 2 years ago
• jemisjoky / umps_code
  u-MPS implementation and experimentation code used in the paper Tensor Networks for Probabilistic Sequence Modeling (https://arxiv.org/ab…
  ☆19Updated 4 years ago
• microsoft / Stochastic-Mixture-of-Experts
  This package implements THOR: Transformer with Stochastic Experts.
  ☆62Updated 3 years ago
• chentingpc / dpq_embedding_compression
  Differentiable Product Quantization for End-to-End Embedding Compression.
  ☆59Updated 2 years ago
• huggingface / block_movement_pruning
  Block Sparse movement pruning
  ☆78Updated 4 years ago
• fuzihaofzh / repetition-problem-nlg
  Code for the paper "A Theoretical Analysis of the Repetition Problem in Text Generation" in AAAI 2021.
  ☆51Updated 2 years ago
• princeton-nlp / LM-Kernel-FT
  A Kernel-Based View of Language Model Fine-Tuning https://arxiv.org/abs/2210.05643
  ☆74Updated last year
• apd10 / universal_memory_allocation
  ☆15Updated 2 years ago
• IamHuijben / gumbel_softmax_sampling
  ☆11Updated 2 years ago
• ptillet / torch-blocksparse
  Block-sparse primitives for PyTorch
  ☆153Updated 3 years ago
• dguo98 / DiffPruning
  Parameter Efficient Transfer Learning with Diff Pruning
  ☆73Updated 4 years ago
• yaozhewei / MLPruning
  MLPruning, PyTorch, NLP, BERT, Structured Pruning
  ☆21Updated 3 years ago
• yaohungt / TransformerDissection
  [EMNLP'19] Summary for Transformer Understanding
  ☆53Updated 5 years ago
• JetRunner / PABEE
  Code for the paper "BERT Loses Patience: Fast and Robust Inference with Early Exit".
  ☆64Updated 3 years ago
• edwardjhu / TP4
  Code accompanying our paper "Feature Learning in Infinite-Width Neural Networks" (https://arxiv.org/abs/2011.14522)
  ☆59Updated 3 years ago
• cliang1453 / super-structured-lottery-tickets
  Super Tickets in Pre-Trained Language Models: From Model Compression to Improving Generalization (ACL 2021)
  ☆17Updated 3 years ago
• Andrew-Tierno / QuantizedTransformer
  Implementation of a Quantized Transformer Model
  ☆18Updated 5 years ago
• tommccoy1 / tpdn
  Tensor product decomposition network
  ☆19Updated 3 years ago
• Noahs-ARK / PaLM
  PyTorch implementation for PaLM: A Hybrid Parser and Language Model.
  ☆10Updated 5 years ago
• pkuzengqi / Skyformer
  Skyformer: Remodel Self-Attention with Gaussian Kernel and Nystr\"om Method (NeurIPS 2021)
  ☆60Updated 2 years ago
• stat-ml / TTDE
  ☆13Updated last year
• Aleph-Alpha / NeurIPS-WANT-submission-efficient-parallelization-layouts
  ☆22Updated last year