Alternatives and similar repositories for MoPQ

Users that are interested in MoPQ are comparing it to the libraries listed below

• microsoft / AutoMoE
  AutoMoE: Neural Architecture Search for Efficient Sparsely Activated Transformers
  ☆48Updated 3 years ago
• Harry-Chen / InfMoE
  Inference framework for MoE layers based on TensorRT with Python binding
  ☆41Updated 4 years ago
• microsoft / Stochastic-Mixture-of-Experts
  This package implements THOR: Transformer with Stochastic Experts.
  ☆65Updated 4 years ago
• bailuding / rails
  Retrieval with Learned Similarities (http://arxiv.org/abs/2407.15462, WWW'25 Oral)
  ☆52Updated 9 months ago
• TencentARC / BEBR
  Official code for "Binary embedding based retrieval at Tencent"
  ☆44Updated last year
• wlzhao22 / tsdg
  TSDG: An efficient index graph for graph-based nearest neighbor search
  ☆10Updated 3 years ago
• microsoft / AR2
  ☆70Updated 3 years ago
• hpcaitech / CachedEmbedding
  A memory efficient DLRM training solution using ColossalAI
  ☆105Updated 3 years ago
• yuzhenmao / IceFormer
  Implementation of IceFormer: Accelerated Inference with Long-Sequence Transformers on CPUs (ICLR 2024).
  ☆25Updated 6 months ago
• kssteven418 / LTP
  [KDD'22] Learned Token Pruning for Transformers
  ☆102Updated 2 years ago
• microsoft / GEM
  ☆25Updated 4 years ago
• rayleizhu / vllm-ra
  [ACL 2024] RelayAttention for Efficient Large Language Model Serving with Long System Prompts
  ☆40Updated last year
• microsoft / SparseMixer
  Sparse Backpropagation for Mixture-of-Expert Training
  ☆29Updated last year
• huggingface / block_movement_pruning
  Block Sparse movement pruning
  ☆83Updated 5 years ago
• microsoft / AMOS
  [ICLR 2022] Pretraining Text Encoders with Adversarial Mixture of Training Signal Generators
  ☆26Updated 2 years ago
• teelinsan / parallel-decoding
  Repository of the paper "Accelerating Transformer Inference for Translation via Parallel Decoding"
  ☆123Updated last year
• chentingpc / dpq_embedding_compression
  Differentiable Product Quantization for End-to-End Embedding Compression.
  ☆64Updated 3 years ago
• SimiaoZuo / MoEBERT
  This PyTorch package implements MoEBERT: from BERT to Mixture-of-Experts via Importance-Guided Adaptation (NAACL 2022).
  ☆113Updated 3 years ago
• OpenNLPLab / LASP
  Linear Attention Sequence Parallelism (LASP)
  ☆88Updated last year
• microsoft / glinthawk
  An LLM inference engine, written in C++
  ☆18Updated 2 weeks ago
• aitsc / GLMKD
  Are Intermediate Layers and Labels Really Necessary? A General Language Model Distillation Method ; GKD: A General Knowledge Distillation…
  ☆33Updated 2 years ago
• microsoft / Delayed-Compensation-Asynchronous-Stochastic-Gradient-Descent-for-Multiverso
  Asynchronous Stochastic Gradient Descent with Delay Compensation
  ☆22Updated 8 years ago
• Azure / MS-AMP-Examples
  Examples for MS-AMP package.
  ☆30Updated 6 months ago
• yegcjs / mixinglaws
  ☆109Updated 6 months ago
• microsoft / BANG
  BANG is a new pretraining model to Bridge the gap between Autoregressive (AR) and Non-autoregressive (NAR) Generation. AR and NAR generat…
  ☆28Updated 4 years ago
• infinigence / LVEval
  Repository of LV-Eval Benchmark
  ☆73Updated last year
• jzbjyb / ReAtt
  Retrieval as Attention
  ☆82Updated 3 years ago
• ziplab / QLLM
  [ICLR 2024] This is the official PyTorch implementation of "QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Mod…
  ☆31Updated last year
• ModelTC / awesome-lm-system
  Summary of system papers/frameworks/codes/tools on training or serving large model
  ☆57Updated 2 years ago
• locuslab / scaling_laws_data_filtering
  ☆64Updated last year