Alternatives and similar repositories for ByteTransformer

Users that are interested in ByteTransformer are comparing it to the libraries listed below

• OpenPPL / ppl.nn.llm
  ☆141Updated last year
• OpenPPL / ppl.llm.serving
  ☆128Updated 8 months ago
• void-main / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆59Updated last year
• bytedance / effective_transformer
  Running BERT without Padding
  ☆475Updated 3 years ago
• FlagOpen / FlagGems
  FlagGems is an operator library for large language models implemented in the Triton Language.
  ☆673Updated this week
• Tencent / KsanaLLM
  ☆491Updated last month
• FlagOpen / FlagAttention
  A collection of memory efficient attention operators implemented in the Triton language.
  ☆277Updated last year
• alibaba / BladeDISC
  BladeDISC is an end-to-end DynamIc Shape Compiler project for machine learning workloads.
  ☆891Updated 8 months ago
• OpenPPL / ppl.llm.kernel.cuda
  ☆150Updated 8 months ago
• bytedance / ByteMLPerf
  AI Accelerator Benchmark focuses on evaluating AI Accelerators from a practical production perspective, including the ease of use and ver…
  ☆263Updated 3 weeks ago
• volcengine / veGiantModel
  ☆220Updated 2 years ago
• alibaba / rtp-llm
  RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.
  ☆847Updated last month
• sail-sg / zero-bubble-pipeline-parallelism
  Zero Bubble Pipeline Parallelism
  ☆424Updated 4 months ago
• antgroup / glake
  GLake: optimizing GPU memory management and IO transmission.
  ☆479Updated 5 months ago
• bytedance / byteir
  A model compilation solution for various hardware
  ☆446Updated 3 weeks ago
• OpenPPL / ppl.pmx
  ☆59Updated 9 months ago
• madsys-dev / deepseekv2-profile
  ☆147Updated 6 months ago
• Bruce-Lee-LY / flash_attention_inference
  Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.
  ☆40Updated 6 months ago
• Azure / MS-AMP
  Microsoft Automatic Mixed Precision Library
  ☆619Updated 11 months ago
• AyakaGEMM / Hands-on-GEMM
  ☆138Updated last year
• alibaba / EasyParallelLibrary
  Easy Parallel Library (EPL) is a general and efficient deep learning framework for distributed model training.
  ☆268Updated 2 years ago
• Ascend / AscendSpeed
  ☆79Updated last year
• fanshiqing / grouped_gemm
  PyTorch bindings for CUTLASS grouped GEMM.
  ☆145Updated 2 weeks ago
• mlc-ai / mlc-zh
  ☆616Updated last year
• Oneflow-Inc / libai
  LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training
  ☆408Updated last month
• openmlsys / openmlsys-cuda
  Tutorials for writing high-performance GPU operators in AI frameworks.
  ☆130Updated 2 years ago
• Oneflow-Inc / DLPerf
  DeepLearning Framework Performance Profiling Toolkit
  ☆288Updated 3 years ago
• mlc-ai / notebooks
  ☆209Updated 9 months ago
• Ascend / pytorch
  Ascend PyTorch adapter (torch_npu). Mirror of https://gitee.com/ascend/pytorch
  ☆426Updated this week
• MegEngine / MegCC
  MegCC是一个运行时超轻量，高效，移植简单的深度学习模型编译器
  ☆487Updated 10 months ago