Alternatives and similar repositories for pymultiworld:

Users that are interested in pymultiworld are comparing it to the libraries listed below

• stanford-futuredata / stk
  ☆101Updated 7 months ago
• cchan / tccl
  extensible collectives library in triton
  ☆84Updated 6 months ago
• microsoft / ParrotServe
  [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable
  ☆150Updated 6 months ago
• SymbioticLab / Oobleck
  A resilient distributed training framework
  ☆91Updated 11 months ago
• IST-DASLab / Sparse-Marlin
  Boosting 4-bit inference kernels with 2:4 Sparsity
  ☆71Updated 6 months ago
• pytorch-labs / float8_experimental
  This repository contains the experimental PyTorch native float8 training UX
  ☆222Updated 7 months ago
• AnswerDotAI / cold-compress
  Cold Compress is a hackable, lightweight, and open-source toolkit for creating and benchmarking cache compression methods built on top of…
  ☆122Updated 7 months ago
• deepspeedai / DeepSpeed-Kernels
  ☆62Updated last month
• project-etalon / etalon
  LLM Serving Performance Evaluation Harness
  ☆73Updated last month
• Zyphra / tree_attention
  Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters
  ☆125Updated 3 months ago
• CentML / DeepView.Profile
  🏙 Interactive performance profiling and debugging tool for PyTorch neural networks.
  ☆59Updated 2 months ago
• alibaba / easydist
  Automated Parallelization System and Infrastructure for Multiple Ecosystems
  ☆78Updated 4 months ago
• MDK8888 / vllmini
  A minimal implementation of vllm.
  ☆37Updated 8 months ago
• Azure / msccl
  Microsoft Collective Communication Library
  ☆60Updated 4 months ago
• shawntan / scattermoe
  Triton-based implementation of Sparse Mixture of Experts.
  ☆209Updated 4 months ago
• pytorch / torchsnapshot
  A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…
  ☆155Updated 3 months ago
• awslabs / slapo
  A schedule language for large model training
  ☆145Updated 9 months ago
• gpu-mode / ring-attention
  ring-attention experiments
  ☆128Updated 5 months ago
• triton-lang / kernels
  ☆73Updated 4 months ago
• snowflakedb / ArcticTraining
  ArcticTraining is a framework designed to simplify and accelerate the post-training process for large language models (LLMs)
  ☆52Updated this week
• zartbot / shallowsim
  DeepSeek-V3/R1 inference performance simulator
  ☆76Updated this week
• zinccat / Awesome-Triton-Kernels
  Collection of kernels written in Triton language
  ☆114Updated last month
• pytorch-labs / applied-ai
  Applied AI experiments and examples for PyTorch
  ☆250Updated last week
• ScalingIntelligence / KernelBench
  KernelBench: Can LLMs Write GPU Kernels? - Benchmark with Torch -> CUDA problems
  ☆237Updated last week
• HanGuo97 / flute
  Fast Matrix Multiplications for Lookup Table-Quantized LLMs
  ☆235Updated last month
• EfficientMoE / MoE-Infinity
  PyTorch library for cost-effective, fast and easy serving of MoE models.
  ☆151Updated this week
• Infini-AI-Lab / MagicDec
  [ICLR2025] Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding
  ☆111Updated 3 months ago
• pytorch-labs / tritonbench
  Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.
  ☆104Updated this week
• huggingface / kernels
  Load compute kernels from the Hub
  ☆99Updated this week
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆78Updated last year