Alternatives and similar repositories for mbridge

Users that are interested in mbridge are comparing it to the libraries listed below

• hyx1999 / SAM-Decoding
  Official Implementation of SAM-Decoding: Speculative Decoding via Suffix Automaton
  ☆28Updated 4 months ago
• feifeibear / Odysseus-Transformer
  Odysseus: Playground of LLM Sequence Parallelism
  ☆70Updated last year
• li-plus / flash-preference
  Accelerate LLM preference tuning via prefix sharing with a single line of code
  ☆41Updated last month
• microsoft / chunk-attention
  ☆77Updated 2 months ago
• Zanette-Labs / SpeculativeRejection
  [NeurIPS 2024] Fast Best-of-N Decoding via Speculative Rejection
  ☆45Updated 7 months ago
• Jingyu6 / speculative_prefill
  ☆30Updated last month
• sail-sg / SimLayerKV
  The official implementation of paper: SimLayerKV: A Simple Framework for Layer-Level KV Cache Reduction.
  ☆46Updated 8 months ago
• Infini-AI-Lab / gsm_infinite
  ☆47Updated 2 weeks ago
• hao-ai-lab / vllm-ltr
  [NeurIPS 2024] Efficient LLM Scheduling by Learning to Rank
  ☆48Updated 7 months ago
• swtheing / PF-PPO-RLHF
  ☆33Updated 9 months ago
• microsoft / nanovppo
  Nano repo for RL training of LLMs
  ☆61Updated 2 weeks ago
• sail-sg / LongSpec
  LongSpec: Long-Context Lossless Speculative Decoding with Efficient Drafting and Verification
  ☆54Updated 3 months ago
• OpenSparseLLMs / Linear-MoE
  ☆104Updated 2 weeks ago
• smart-lty / ParallelSpeculativeDecoding
  [ICLR 2025] PEARL: Parallel Speculative Decoding with Adaptive Draft Length
  ☆90Updated 2 months ago
• yyht / openrlhf_async_pipline
  ☆53Updated last week
• rlite-project / RLite
  A lightweight reinforcement learning framework that integrates seamlessly into your codebase, empowering developers to focus on algorithm…
  ☆32Updated last month
• thunlp / Ouroboros
  Ouroboros: Speculative Decoding with Large Model Enhanced Drafting (EMNLP 2024 main)
  ☆106Updated 3 months ago
• feifeibear / DPSKV3MFU
  Estimate MFU for DeepSeekV3
  ☆24Updated 5 months ago
• Dao-AILab / grouped-latent-attention
  ☆114Updated 3 weeks ago
• agentica-project / verl-pipeline
  Async pipelined version of Verl
  ☆100Updated 2 months ago
• KaihuaTang / Qwen-Tokenizer-Pruner
  Due to the huge vocaburary size (151,936) of Qwen models, the Embedding and LM Head weights are excessively heavy. Therefore, this projec…
  ☆22Updated 10 months ago
• CalvinXKY / mfu_calculation
  A simple calculation for LLM MFU.
  ☆38Updated 3 months ago
• zankner / Hydra
  ☆45Updated last year
• sail-sg / VocabularyParallelism
  Vocabulary Parallelism
  ☆19Updated 3 months ago
• infinigence / LVEval
  Repository of LV-Eval Benchmark
  ☆67Updated 9 months ago
• modelscope / Trinity-RFT
  Trinity-RFT is a general-purpose, flexible and scalable framework designed for reinforcement fine-tuning (RFT) of large language models (…
  ☆127Updated this week
• DerrickYLJ / TidalDecode
  [ICLR 2025] TidalDecode: A Fast and Accurate LLM Decoding with Position Persistent Sparse Attention
  ☆39Updated 2 months ago
• SkyworkAI / skywork-o1-prm-inference
  ☆63Updated 7 months ago
• ServiceNow / PipelineRL
  A scalable asynchronous reinforcement learning implementation with in-flight weight updates.
  ☆125Updated this week
• princeton-nlp / ProLong
  Homepage for ProLong (Princeton long-context language models) and paper "How to Train Long-Context Language Models (Effectively)"
  ☆189Updated 3 months ago