tt-embedding / tt-embeddings

Related projects ⓘ

Alternatives and complementary repositories for tt-embeddings

• KhrulkovV / tt-pytorch
  ☆61Updated 4 years ago
• asappresearch / flop
  Pytorch library for factorized L0-based pruning.
  ☆43Updated last year
• khakhulin / compressed-transformer
  Compression of NMT transformer model with tensor methods
  ☆48Updated 5 years ago
• jemisjoky / umps_code
  u-MPS implementation and experimentation code used in the paper Tensor Networks for Probabilistic Sequence Modeling (https://arxiv.org/ab…
  ☆19Updated 4 years ago
• twinkle0331 / Xcompression
  [ICLR 2022] Code for paper "Exploring Extreme Parameter Compression for Pre-trained Language Models"(https://arxiv.org/abs/2205.10036)
  ☆19Updated last year
• szhangtju / The-compression-of-Transformer
  ☆62Updated 3 years ago
• onucharles / tensorized-rnn
  A fully tensorized recurrent neural network using tensor-train decomposition
  ☆25Updated last year
• androstj / tensor_rnn
  An implementation of various tensor-based decomposition for NN & RNN parameters
  ☆18Updated 6 years ago
• HazyResearch / structured-nets
  Structured matrices for compressing neural networks
  ☆67Updated last year
• IamHuijben / gumbel_softmax_sampling
  ☆11Updated 2 years ago
• microsoft / Stochastic-Mixture-of-Experts
  This package implements THOR: Transformer with Stochastic Experts.
  ☆61Updated 3 years ago
• huggingface / block_movement_pruning
  Block Sparse movement pruning
  ☆78Updated 3 years ago
• ptillet / torch-blocksparse
  Block-sparse primitives for PyTorch
  ☆148Updated 3 years ago
• hyeon95y / SparseLinear
  A custom PyTorch layer that is capable of implementing extremely wide and sparse linear layers efficiently
  ☆48Updated 11 months ago
• apd10 / universal_memory_allocation
  ☆15Updated 2 years ago
• VITA-Group / BERT-Tickets
  [NeurIPS 2020] "The Lottery Ticket Hypothesis for Pre-trained BERT Networks", Tianlong Chen, Jonathan Frankle, Shiyu Chang, Sijia Liu, Ya…
  ☆138Updated 2 years ago
• Noahs-ARK / RFA
  ☆32Updated 3 years ago
• QingruZhang / PLATON
  This pytorch package implements PLATON: Pruning Large Transformer Models with Upper Confidence Bound of Weight Importance (ICML 2022).
  ☆41Updated 2 years ago
• Thrandis / EKFAC-pytorch
  Repository containing Pytorch code for EKFAC and K-FAC perconditioners.
  ☆140Updated last year
• camlsys / degree-quant
  ICLR 2021
  ☆44Updated 3 years ago
• harvardnlp / genbmm
  CUDA kernels for generalized matrix-multiplication in PyTorch
  ☆79Updated 3 years ago
• zhangjiong724 / spectral-RNN
  STABILIZING GRADIENTS FOR DEEP NEURAL NETWORKS VIA EFFICIENT SVD PARAMETERIZATION
  ☆16Updated 6 years ago
• zhuohan123 / macaron-net
  Codes for "Understanding and Improving Transformer From a Multi-Particle Dynamic System Point of View"
  ☆145Updated 5 years ago
• thegregyang / NTK4A
  Code for the paper: "Tensor Programs II: Neural Tangent Kernel for Any Architecture"
  ☆97Updated 4 years ago
• rballester / ttrecipes
  Metamodeling, sensitivity analysis and visualization using the tensor train format
  ☆23Updated 2 years ago
• gpauloski / kfac-pytorch
  Distributed K-FAC Preconditioner for PyTorch
  ☆80Updated this week
• yaozhewei / MLPruning
  MLPruning, PyTorch, NLP, BERT, Structured Pruning
  ☆21Updated 3 years ago
• spcl / substation
  Research and development for optimizing transformers
  ☆125Updated 3 years ago
• dodgejesse / show_your_work
  ☆10Updated 4 years ago
• RobertCsordas / ndr
  The official repository for our paper "The Neural Data Router: Adaptive Control Flow in Transformers Improves Systematic Generalization".
  ☆32Updated 3 years ago