Alternatives and similar repositories for MoPQ

Users that are interested in MoPQ are comparing it to the libraries listed below

• bailuding / rails
  Retrieval with Learned Similarities (http://arxiv.org/abs/2407.15462, WWW'25 Oral)
  ☆51Updated 7 months ago
• Harry-Chen / InfMoE
  Inference framework for MoE layers based on TensorRT with Python binding
  ☆41Updated 4 years ago
• TencentARC / BEBR
  Official code for "Binary embedding based retrieval at Tencent"
  ☆44Updated last year
• microsoft / AutoMoE
  AutoMoE: Neural Architecture Search for Efficient Sparsely Activated Transformers
  ☆48Updated 3 years ago
• microsoft / Stochastic-Mixture-of-Experts
  This package implements THOR: Transformer with Stochastic Experts.
  ☆65Updated 4 years ago
• rayleizhu / vllm-ra
  [ACL 2024] RelayAttention for Efficient Large Language Model Serving with Long System Prompts
  ☆40Updated last year
• kssteven418 / LTP
  [KDD'22] Learned Token Pruning for Transformers
  ☆102Updated 2 years ago
• wangguojim / LargeScale
  ☆19Updated last year
• staoxiao / LibVQ
  ☆74Updated 2 years ago
• ModelTC / awesome-lm-system
  Summary of system papers/frameworks/codes/tools on training or serving large model
  ☆57Updated 2 years ago
• thunlp / Ouroboros
  Ouroboros: Speculative Decoding with Large Model Enhanced Drafting (EMNLP 2024 main)
  ☆112Updated 9 months ago
• princeton-pli / PruLong
  Code for the preprint "Cache Me If You Can: How Many KVs Do You Need for Effective Long-Context LMs?"
  ☆47Updated 4 months ago
• microsoft / glinthawk
  An LLM inference engine, written in C++
  ☆18Updated 6 months ago
• infinigence / LVEval
  Repository of LV-Eval Benchmark
  ☆72Updated last year
• mlpen / LookupFFN
  ☆21Updated last year
• feifeibear / Odysseus-Transformer
  Odysseus: Playground of LLM Sequence Parallelism
  ☆78Updated last year
• vllm-project / vllm-nccl
  Manages vllm-nccl dependency
  ☆17Updated last year
• microsoft / AMOS
  [ICLR 2022] Pretraining Text Encoders with Adversarial Mixture of Training Signal Generators
  ☆26Updated 2 years ago
• OpenNLPLab / LASP
  Linear Attention Sequence Parallelism (LASP)
  ☆88Updated last year
• linxihui / dkernel
  ☆21Updated 8 months ago
• bigai-nlco / LooGLE
  ACL 2024 | LooGLE: Long Context Evaluation for Long-Context Language Models
  ☆193Updated last year
• SimiaoZuo / MoEBERT
  This PyTorch package implements MoEBERT: from BERT to Mixture-of-Experts via Importance-Guided Adaptation (NAACL 2022).
  ☆112Updated 3 years ago
• huggingface / Megatron-LM
  Ongoing research training transformer models at scale
  ☆18Updated 2 years ago
• RyanLiGod / hnsw-python
  hnsw implemented by python
  ☆71Updated 6 years ago
• sail-sg / SimLayerKV
  The official implementation of paper: SimLayerKV: A Simple Framework for Layer-Level KV Cache Reduction.
  ☆52Updated last year
• thunlp / MoEfication
  ☆142Updated last year
• eedalong / Dpex
  Distributed DataLoader For Pytorch Based On Ray
  ☆24Updated 4 years ago
• Azure / MS-AMP-Examples
  Examples for MS-AMP package.
  ☆30Updated 5 months ago
• teelinsan / parallel-decoding
  Repository of the paper "Accelerating Transformer Inference for Translation via Parallel Decoding"
  ☆121Updated last year
• Andrew-Tierno / QuantizedTransformer
  Implementation of a Quantized Transformer Model
  ☆19Updated 6 years ago