Alternatives and similar repositories for pymultiworld

Users that are interested in pymultiworld are comparing it to the libraries listed below

• SymbioticLab / Oobleck
  A resilient distributed training framework
  ☆95Updated last year
• IST-DASLab / Sparse-Marlin
  Boosting 4-bit inference kernels with 2:4 Sparsity
  ☆76Updated 9 months ago
• cchan / tccl
  extensible collectives library in triton
  ☆87Updated 2 months ago
• Infini-AI-Lab / MagicDec
  [ICLR2025] Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding
  ☆116Updated 6 months ago
• Zyphra / tree_attention
  Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters
  ☆126Updated 6 months ago
• microsoft / ParrotServe
  [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable
  ☆158Updated 8 months ago
• ByteDance-Seed / ByteCheckpoint
  ByteCheckpoint: An Unified Checkpointing Library for LFMs
  ☆215Updated 2 months ago
• ScalingIntelligence / hydragen
  Hydragen: High-Throughput LLM Inference with Shared Prefixes
  ☆36Updated last year
• ademeure / DeeperGEMM
  DeeperGEMM: crazy optimized version
  ☆69Updated last month
• hpcaitech / TensorNVMe
  A Python library transfers PyTorch tensors between CPU and NVMe
  ☆116Updated 6 months ago
• simon-mo / vLLM-Benchmark
  ☆27Updated last month
• MDK8888 / vllmini
  A minimal implementation of vllm.
  ☆41Updated 10 months ago
• triton-lang / kernels
  ☆80Updated 6 months ago
• DS3Lab / DT-FM
  ☆94Updated 2 years ago
• shawntan / scattermoe
  Triton-based implementation of Sparse Mixture of Experts.
  ☆217Updated 6 months ago
• google-deepmind / asyncdiloco
  ☆44Updated last year
• AnswerDotAI / cold-compress
  Cold Compress is a hackable, lightweight, and open-source toolkit for creating and benchmarking cache compression methods built on top of…
  ☆134Updated 9 months ago
• SJTU-IPADS / Bamboo
  Bamboo-7B Large Language Model
  ☆93Updated last year
• RulinShao / LightSeq
  Official repository for DistFlashAttn: Distributed Memory-efficient Attention for Long-context LLMs Training
  ☆210Updated 9 months ago
• stanford-futuredata / stk
  ☆105Updated 9 months ago
• gpu-mode / ring-attention
  ring-attention experiments
  ☆143Updated 7 months ago
• huggingface / kernels
  Load compute kernels from the Hub
  ☆139Updated last week
• tyler-griggs / melange-release
  ☆46Updated 11 months ago
• Dao-AILab / grouped-latent-attention
  ☆93Updated last week
• DS3Lab / CocktailSGD
  ☆26Updated last year
• LMCache / lmcache-vllm
  The driver for LMCache core to run in vLLM
  ☆41Updated 4 months ago
• thunlp / Ouroboros
  Ouroboros: Speculative Decoding with Large Model Enhanced Drafting (EMNLP 2024 main)
  ☆106Updated 2 months ago
• PrimeIntellect-ai / pccl
  PCCL (Prime Collective Communications Library) implements fault tolerant collective communications over IP
  ☆88Updated 2 weeks ago
• hao-ai-lab / MuxServe
  ☆62Updated 11 months ago
• open-lm-engine / cute-kernels
  A bunch of kernels that might make stuff slower 😉
  ☆46Updated this week