Alternatives and similar repositories for pymultiworld

Users that are interested in pymultiworld are comparing it to the libraries listed below

• meta-pytorch / BackendBench
  How to ensure correctness and ship LLM generated kernels in PyTorch
  ☆66Updated this week
• cchan / tccl
  extensible collectives library in triton
  ☆88Updated 6 months ago
• CentML / DeepView.Profile
  🏙 Interactive performance profiling and debugging tool for PyTorch neural networks.
  ☆64Updated 8 months ago
• SymbioticLab / Oobleck
  A resilient distributed training framework
  ☆95Updated last year
• meta-pytorch / kraken
  Triton-based Symmetric Memory operators and examples
  ☆31Updated last week
• sgl-project / genai-bench
  Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serv…
  ☆215Updated this week
• shawntan / scattermoe
  Triton-based implementation of Sparse Mixture of Experts.
  ☆242Updated this week
• triton-lang / kernels
  ☆90Updated 11 months ago
• ByteDance-Seed / ByteCheckpoint
  ByteCheckpoint: An Unified Checkpointing Library for LFMs
  ☆249Updated 2 months ago
• gpu-mode / ring-attention
  ring-attention experiments
  ☆152Updated 11 months ago
• meta-pytorch / monarch
  PyTorch Single Controller
  ☆425Updated last week
• stanford-futuredata / stk
  ☆113Updated last year
• meta-pytorch / torchsnapshot
  A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…
  ☆161Updated 2 weeks ago
• DachengLi1 / AMP
  (NeurIPS 2022) Automatically finding good model-parallel strategies, especially for complex models and clusters.
  ☆41Updated 2 years ago
• sgl-project / sglang-jax
  JAX backend for SGL
  ☆65Updated last week
• pytorch / helion
  A Python-embedded DSL that makes it easy to write fast, scalable ML kernels with minimal boilerplate.
  ☆328Updated this week
• ScalingIntelligence / hydragen
  Hydragen: High-Throughput LLM Inference with Shared Prefixes
  ☆42Updated last year
• zinccat / Awesome-Triton-Kernels
  Collection of kernels written in Triton language
  ☆157Updated 6 months ago
• NVIDIA / compute-eval
  Evaluating Large Language Models for CUDA Code Generation ComputeEval is a framework designed to generate and evaluate CUDA code from Lar…
  ☆66Updated last week
• meta-pytorch / applied-ai
  Applied AI experiments and examples for PyTorch
  ☆296Updated last month
• microsoft / ParrotServe
  [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable
  ☆184Updated last year
• NVIDIA / jaxpp
  JaxPP is a library for JAX that enables flexible MPMD pipeline parallelism for large-scale LLM training
  ☆54Updated this week
• Azure / msccl
  Microsoft Collective Communication Library
  ☆66Updated 10 months ago
• tgale96 / grouped_gemm
  PyTorch bindings for CUTLASS grouped GEMM.
  ☆123Updated 4 months ago
• yanring / Megatron-MoE-ModelZoo
  Best practices for training DeepSeek, Mixtral, Qwen and other MoE models using Megatron Core.
  ☆102Updated 2 weeks ago
• fzyzcjy / torch_memory_saver
  Allow torch tensor memory to be released and resumed later
  ☆144Updated this week
• Deep-Learning-Profiling-Tools / triton-viz
  ☆242Updated this week
• samsja / pydantic_config
  Manage ML configuration with pydantic
  ☆16Updated 4 months ago
• foundation-model-stack / foundation-model-stack
  🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.
  ☆213Updated last week
• RulinShao / LightSeq
  Official repository for DistFlashAttn: Distributed Memory-efficient Attention for Long-context LLMs Training
  ☆215Updated last year