Alternatives and similar repositories for MoPQ

Users that are interested in MoPQ are comparing it to the libraries listed below

• staoxiao / LibVQ
  ☆75Updated 2 years ago
• TencentARC / BEBR
  Official code for "Binary embedding based retrieval at Tencent"
  ☆43Updated last year
• bailuding / rails
  Retrieval with Learned Similarities (http://arxiv.org/abs/2407.15462, WWW'25 Oral)
  ☆46Updated 2 months ago
• microsoft / Stochastic-Mixture-of-Experts
  This package implements THOR: Transformer with Stochastic Experts.
  ☆65Updated 3 years ago
• Harry-Chen / InfMoE
  Inference framework for MoE layers based on TensorRT with Python binding
  ☆41Updated 4 years ago
• feifeibear / Odysseus-Transformer
  Odysseus: Playground of LLM Sequence Parallelism
  ☆70Updated last year
• princeton-pli / PruLong
  Code for the preprint "Cache Me If You Can: How Many KVs Do You Need for Effective Long-Context LMs?"
  ☆38Updated this week
• microsoft / SpeedyRec
  ☆24Updated last year
• kssteven418 / LTP
  [KDD'22] Learned Token Pruning for Transformers
  ☆98Updated 2 years ago
• mlpen / LookupFFN
  ☆20Updated last year
• ModelTC / awesome-lm-system
  Summary of system papers/frameworks/codes/tools on training or serving large model
  ☆57Updated last year
• thunlp / MoEfication
  ☆139Updated 11 months ago
• microsoft / BiDR
  Repo for WWW 2022 paper: Progressively Optimized Bi-Granular Document Representation for Scalable Embedding Based Retrieval
  ☆15Updated 3 years ago
• ziplab / QLLM
  [ICLR 2024] This is the official PyTorch implementation of "QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Mod…
  ☆27Updated last year
• DreamerGPT / DreamerGPT
  🌱 梦想家(DreamerGPT)：中文大语言模型指令精调
  ☆51Updated 2 years ago
• antgroup / OmniKV
  Dynamic Context Selection for Efficient Long-Context LLMs
  ☆35Updated last month
• rayleizhu / vllm-ra
  [ACL 2024] RelayAttention for Efficient Large Language Model Serving with Long System Prompts
  ☆40Updated last year
• infinigence / LVEval
  Repository of LV-Eval Benchmark
  ☆67Updated 10 months ago
• Dominic789654 / LongGenBench
  Source code for the paper "LongGenBench: Long-context Generation Benchmark"
  ☆20Updated 9 months ago
• sail-sg / SimLayerKV
  The official implementation of paper: SimLayerKV: A Simple Framework for Layer-Level KV Cache Reduction.
  ☆46Updated 9 months ago
• princeton-nlp / CEPE
  [ACL 2024] Long-Context Language Modeling with Parallel Encodings
  ☆156Updated last year
• mobiusml / low-rank-llama2
  Low-Rank Llama Custom Training
  ☆23Updated last year
• wangguojim / LargeScale
  ☆19Updated last year
• Andrew-Tierno / QuantizedTransformer
  Implementation of a Quantized Transformer Model
  ☆19Updated 6 years ago
• Furyton / GR-as-MVDR
  [SIGIR'24] Generative Retrieval as Multi-Vector Dense Retrieval
  ☆33Updated 8 months ago
• NormXU / Consistent-DynamicNTKRoPE
  An Experiment on Dynamic NTK Scaling RoPE
  ☆64Updated last year
• SimiaoZuo / MoEBERT
  This PyTorch package implements MoEBERT: from BERT to Mixture-of-Experts via Importance-Guided Adaptation (NAACL 2022).
  ☆108Updated 3 years ago
• huggingface / block_movement_pruning
  Block Sparse movement pruning
  ☆81Updated 4 years ago
• thu-coai / MiniPLM
  [ICLR 2025] MiniPLM: Knowledge Distillation for Pre-Training Language Models
  ☆50Updated 7 months ago
• teelinsan / parallel-decoding
  Repository of the paper "Accelerating Transformer Inference for Translation via Parallel Decoding"
  ☆118Updated last year