Alternatives and similar repositories for pytorch_distributed

Users that are interested in pytorch_distributed are comparing it to the libraries listed below

• L1aoXingyu / llm-infer-bench
  ☆11Updated last year
• megvii-research / basedet
  An object detection codebase based on MegEngine.
  ☆28Updated 2 years ago
• bojone / softtopk
  differentiable top-k operator
  ☆21Updated 4 months ago
• tile-ai / tvm
  Open deep learning compiler stack for cpu, gpu and specialized accelerators
  ☆18Updated last week
• megvii-research / IntLLaMA
  IntLLaMA: A fast and light quantization solution for LLaMA
  ☆18Updated last year
• lartpang / RunIt
  A simple program scheduler for your code on different devices.
  ☆11Updated 9 months ago
• BBuf / flash-rwkv
  ☆30Updated 11 months ago
• OpenGVLab / InternLMM
  ☆17Updated last year
• zms1999 / SmartMoE
  A MoE impl for PyTorch, [ATC'23] SmartMoE
  ☆62Updated last year
• microsoft / AttentionEngine
  ☆70Updated last week
• zxytim / arithmetic-encoding-compression
  ☆11Updated 2 years ago
• zhuzilin / pytorch-malloc
  An external memory allocator example for PyTorch.
  ☆14Updated 3 years ago
• HubHop / vit-attention-benchmark
  Benchmarking Attention Mechanism in Vision Transformers.
  ☆18Updated 2 years ago
• octoml / deformable-attention-kernel
  TVMScript kernel for deformable attention
  ☆25Updated 3 years ago
• Lyken17 / hf-torrent
  ☆38Updated last year
• TiledTensor / TiledBench
  Benchmark tests supporting the TiledCUDA library.
  ☆16Updated 5 months ago
• ModelTC / QLLM
  [ICLR 2024] This is the official PyTorch implementation of "QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Mod…
  ☆36Updated last year
• yester31 / Cutlass_EX
  study of cutlass
  ☆21Updated 6 months ago
• Ldpe2G / CodingForFun
  Codes For Sharing
  ☆38Updated 4 years ago
• pprp / Awesome-Efficient-MoE
  Efficient Mixture of Experts for LLM Paper List
  ☆65Updated 5 months ago
• li-plus / flash-preference
  Accelerate LLM preference tuning via prefix sharing with a single line of code
  ☆41Updated 2 weeks ago
• RangiLyu / llama.mmengine
  Training LLaMA language model with MMEngine! It supports LoRA fine-tuning!
  ☆40Updated 2 years ago
• Oneflow-Inc / vision
  Datasets, Transforms and Models specific to Computer Vision
  ☆84Updated last year
• MetaLearners / Solution-to-CVPR2021-NAS-competition-Track-1
  ☆13Updated 3 years ago
• sail-sg / TEC
  ☆16Updated 2 years ago
• OAID / TengineInferPipe
  ☆24Updated 2 years ago
• PaddlePaddle / PaDiff
  Paddle Automatically Diff Precision Toolkits.
  ☆49Updated last year
• Oneflow-Inc / OneFlow-Pruning
  [CVPR-2023] Towards Any Structural Pruning
  ☆16Updated 2 years ago
• BBuf / megatron-lm-parallel-group-playground
  ☆16Updated last year
• JieRen98 / SGEMM-SASS-Annotation
  ☆21Updated 4 years ago