Alternatives and similar repositories for Statistical-Properties-of-Dot-Product:

Users that are interested in Statistical-Properties-of-Dot-Product are comparing it to the libraries listed below

• HKUNLP / efficient-attention
  [EVA ICLR'23; LARA ICML'22] Efficient attention mechanisms via control variates, random features, and importance sampling
  ☆84Updated 2 years ago
• VITA-Group / Random-MoE-as-Dropout
  [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal…
  ☆51Updated 2 years ago
• microsoft / Stochastic-Mixture-of-Experts
  This package implements THOR: Transformer with Stochastic Experts.
  ☆61Updated 3 years ago
• ZhuiyiTechnology / GAU-alpha
  基于Gated Attention Unit的Transformer模型（尝鲜版）
  ☆97Updated 2 years ago
• lancopku / FedMNMT
  [Findings of ACL 2023] Communication Efficient Federated Learning for Multilingual Machine Translation with Adapter
  ☆12Updated last year
• hyp1231 / ICLR2023-OpenReviewData
  Crawl & visualize ICLR papers and reviews.
  ☆18Updated 2 years ago
• TobiasLee / Awesome-Efficient-PLM
  Must-read papers on improving efficiency for pre-trained language models.
  ☆103Updated 2 years ago
• OpenNLPLab / Transnormer
  [EMNLP 2022] Official implementation of Transnormer in our EMNLP 2022 paper - The Devil in Linear Transformer
  ☆60Updated last year
• yikangshen / MoA
  Mixture of Attention Heads
  ☆44Updated 2 years ago
• bojone / tiger
  A Tight-fisted Optimizer
  ☆47Updated 2 years ago
• Princeton-SysML / kNNLM_privacy
  Official implementation of Privacy Implications of Retrieval-Based Language Models (EMNLP 2023). https://arxiv.org/abs/2305.14888
  ☆35Updated 10 months ago
• RunxinXu / ContrastivePruning
  Source code for our AAAI'22 paper 《From Dense to Sparse: Contrastive Pruning for Better Pre-trained Language Model Compression》
  ☆23Updated 3 years ago
• VITA-Group / Data-Efficient-Scaling
  [ICML 2023] "Data Efficient Neural Scaling Law via Model Reusing" by Peihao Wang, Rameswar Panda, Zhangyang Wang
  ☆14Updated last year
• victorchen96 / Draw-Paper-Plot-Using-Seaborn
  some examples for drawing illustration plots for paper using seaborn package
  ☆15Updated 5 years ago
• Noahs-ARK / RFA
  ☆33Updated 4 years ago
• SimiaoZuo / MoEBERT
  This PyTorch package implements MoEBERT: from BERT to Mixture-of-Experts via Importance-Guided Adaptation (NAACL 2022).
  ☆103Updated 2 years ago
• pkunlp-icler / ChildTuning
  ☆33Updated 3 years ago
• Ahren09 / AgentReview
  Official Implementation for EMNLP 2024 (main) "AgentReview: Exploring Academic Peer Review with LLM Agent."
  ☆49Updated 5 months ago
• RUCAIBox / QuantizedEmpirical
  ☆14Updated last year
• Hunter-DDM / stablemoe
  Code for the ACL-2022 paper "StableMoE: Stable Routing Strategy for Mixture of Experts"
  ☆45Updated 2 years ago
• THUDM / SCR
  SCR: Training Graph Neural Networks with Consistency Regularization
  ☆37Updated 2 years ago
• lancopku / DynamicKD
  Code for EMNLP 2021 main conference paper "Dynamic Knowledge Distillation for Pre-trained Language Models"
  ☆40Updated 2 years ago
• RUCAIBox / JiuZhang3.0
  The code and data for the paper JiuZhang3.0
  ☆43Updated 11 months ago
• DRSY / EMO
  [ICLR 2024]EMO: Earth Mover Distance Optimization for Auto-Regressive Language Modeling(https://arxiv.org/abs/2310.04691)
  ☆121Updated last year
• aitsc / GLMKD
  Are Intermediate Layers and Labels Really Necessary? A General Language Model Distillation Method ; GKD: A General Knowledge Distillation…
  ☆32Updated last year
• swtheing / PF-PPO-RLHF
  ☆30Updated 7 months ago
• yegcjs / mixinglaws
  ☆98Updated 6 months ago
• MLNLP-World / Top-Conference-WeChat-Group
  ☆56Updated 2 years ago
• sail-sg / LongSpec
  LongSpec: Long-Context Speculative Decoding with Efficient Drafting and Verification
  ☆50Updated last month
• fxmeng / mixtral_spliter
  Converting Mixtral-8x7B to Mixtral-[1~7]x7B
  ☆22Updated last year