alpa-projects / tensorflow-alpa

Related projects ⓘ

Alternatives and complementary repositories for tensorflow-alpa

• parasailteam / coconet
  ☆73Updated last year
• Shigangli / Chimera
  Chimera: Efficiently Training Large-Scale Neural Networks with Bidirectional Pipelines.
  ☆46Updated 11 months ago
• ConnollyLeon / awesome-Auto-Parallelism
  A baseline repository of Auto-Parallelism in Training Neural Networks
  ☆141Updated 2 years ago
• AlibabaPAI / DAPPLE
  An Efficient Pipelined Data Parallel Approach for Training Large Model
  ☆70Updated 3 years ago
• thu-pacman / PET
  PET: Optimizing Tensor Programs with Partially Equivalent Transformations and Automated Corrections
  ☆114Updated 2 years ago
• zhuohan123 / terapipe
  ☆66Updated 3 years ago
• microsoft / SuperScaler
  An experimental parallel training platform
  ☆52Updated 7 months ago
• microsoft / msccl-tools
  Synthesizer for optimal collective communication algorithms
  ☆98Updated 7 months ago
• UofT-EcoSystem / hfta
  Boost hardware utilization for ML training workloads via Inter-model Horizontal Fusion
  ☆32Updated 6 months ago
• microsoft / mscclpp
  MSCCL++: A GPU-driven communication stack for scalable AI applications
  ☆250Updated this week
• openxla / shardy
  MLIR-based partitioning system
  ☆42Updated this week
• daadaada / turingas
  Assembler for NVIDIA Volta and Turing GPUs
  ☆202Updated 2 years ago
• iree-org / iree-experimental
  Experiments and prototypes associated with IREE or MLIR
  ☆49Updated 3 months ago
• tlc-pack / tenset
  ☆90Updated 2 years ago
• microsoft / nnscaler
  nnScaler: Compiling DNN models for Parallel Training
  ☆77Updated 3 weeks ago
• AlibabaResearch / mononn
  ☆19Updated 4 months ago
• triton-lang / kernels
  ☆45Updated 2 weeks ago
• microsoft / triton-shared
  Shared Middle-Layer for Triton Compilation
  ☆192Updated this week
• awslabs / raf
  ☆140Updated last year
• awslabs / slapo
  A schedule language for large model training
  ☆141Updated 5 months ago
• eniac / paella
  Paella: Low-latency Model Serving with Virtualized GPU Scheduling
  ☆57Updated 6 months ago
• apache / tvm-rfcs
  A home for the final text of all TVM RFCs.
  ☆101Updated 2 months ago
• daadaada / gas
  ☆40Updated 3 years ago
• alibaba / llm-scheduling-artifact
  Artifact of OSDI '24 paper, ”Llumnix: Dynamic Scheduling for Large Language Model Serving“
  ☆57Updated 5 months ago
• microsoft / msccl
  Microsoft Collective Communication Library
  ☆322Updated last year
• amirgholami / ai_and_memory_wall
  AI and Memory Wall
  ☆206Updated 8 months ago
• bytedance / flux
  A fast communication-overlapping library for tensor parallelism on GPUs.
  ☆226Updated 3 weeks ago
• mit-han-lab / inter-operator-scheduler
  [MLSys 2021] IOS: Inter-Operator Scheduler for CNN Acceleration
  ☆195Updated 2 years ago
• microsoft / NPKit
  NCCL Profiling Kit
  ☆113Updated 4 months ago
• Shigangli / Magicube
  Magicube is a high-performance library for quantized sparse matrix operations (SpMM and SDDMM) of deep learning on Tensor Cores.
  ☆81Updated 2 years ago