Alternatives and similar repositories for Tutel

Users that are interested in Tutel are comparing it to the libraries listed below

• Azure / MS-AMP
  Microsoft Automatic Mixed Precision Library
  ☆635Updated last month
• pytorch / PiPPy
  Pipeline Parallelism for PyTorch
  ☆783Updated last year
• haoliuhl / ringattention
  Large Context Attention
  ☆762Updated 3 months ago
• zhuzilin / ring-flash-attention
  Ring attention implementation with flash attention
  ☆961Updated 4 months ago
• laekov / fastmoe
  A fast MoE impl for PyTorch
  ☆1,827Updated 11 months ago
• codecaution / Awesome-Mixture-of-Experts-Papers
  A curated reading list of research in Mixture-of-Experts(MoE).
  ☆658Updated last year
• mit-han-lab / smoothquant
  [ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models
  ☆1,585Updated last year
• google-research / vmoe
  ☆695Updated last month
• lucidrains / mixture-of-experts
  A Pytorch implementation of Sparsely-Gated Mixture of Experts, for massively increasing the parameter count of language models
  ☆840Updated 2 years ago
• sail-sg / zero-bubble-pipeline-parallelism
  Zero Bubble Pipeline Parallelism
  ☆445Updated 8 months ago
• feifeibear / long-context-attention
  USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference
  ☆626Updated this week
• IST-DASLab / sparsegpt
  Code for the ICML 2023 paper "SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot".
  ☆863Updated last year
• lucidrains / ring-attention-pytorch
  Implementation of 💍 Ring Attention, from Liu et al. at Berkeley AI, in Pytorch
  ☆549Updated 8 months ago
• bigscience-workshop / Megatron-DeepSpeed
  Ongoing research training transformer language models at scale, including: BERT & GPT-2
  ☆1,428Updated last year
• hao-ai-lab / LookaheadDecoding
  [ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding
  ☆1,314Updated 10 months ago
• meta-pytorch / attention-gym
  Helpful tools and examples for working with flex-attention
  ☆1,108Updated this week
• facebookresearch / LLM-QAT
  Code repo for the paper "LLM-QAT Data-Free Quantization Aware Training for Large Language Models"
  ☆322Updated 10 months ago
• deepspeedai / Megatron-DeepSpeed
  Ongoing research training transformer language models at scale, including: BERT & GPT-2
  ☆2,220Updated 5 months ago
• volcengine / veScale
  Byted PyTorch Distributed for Hyperscale Training of LLMs and RLs
  ☆917Updated last month
• FMInference / H2O
  [NeurIPS'23] H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models.
  ☆500Updated last year
• pytorch / kineto
  A CPU+GPU Profiling library that provides access to timeline traces and hardware performance counters.
  ☆914Updated this week
• cli99 / llm-analysis
  Latency and Memory Analysis of Transformer Models for Training and Inference
  ☆475Updated 8 months ago
• FMInference / DejaVu
  ☆352Updated last year
• feifeibear / LLMSpeculativeSampling
  Fast inference from large lauguage models via speculative decoding
  ☆880Updated last year
• RulinShao / LightSeq
  Official repository for DistFlashAttn: Distributed Memory-efficient Attention for Long-context LLMs Training
  ☆220Updated last year
• locuslab / wanda
  A simple and effective LLM pruning approach.
  ☆838Updated last year
• mit-han-lab / omniserve
  [MLSys'25] QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving; [MLSys'25] LServe: Efficient Long-sequence LLM Se…
  ☆802Updated 10 months ago
• BlackSamorez / tensor_parallel
  Automatically split your PyTorch models on multiple GPUs for training & inference
  ☆657Updated 2 years ago
• fanshiqing / grouped_gemm
  PyTorch bindings for CUTLASS grouped GEMM.
  ☆182Updated last month
• IST-DASLab / marlin
  FP16xINT4 LLM inference kernel that can achieve near-ideal ~4x speedups up to medium batchsizes of 16-32 tokens.
  ☆982Updated last year