mlc-ai / mlc-en

Related projects ⓘ

Alternatives and complementary repositories for mlc-en

• mlc-ai / notebooks
  ☆189Updated 2 months ago
• tlc-pack / relax
  ☆196Updated last year
• Shenggan / awesome-distributed-ml
  A curated list of awesome projects and papers for distributed training or inference
  ☆197Updated last month
• cli99 / llm-analysis
  Latency and Memory Analysis of Transformer Models for Training and Inference
  ☆355Updated last week
• pytorch-labs / applied-ai
  Applied AI experiments and examples for PyTorch
  ☆166Updated 3 weeks ago
• Azure / MS-AMP
  Microsoft Automatic Mixed Precision Library
  ☆525Updated last month
• ConnollyLeon / awesome-Auto-Parallelism
  A baseline repository of Auto-Parallelism in Training Neural Networks
  ☆142Updated 2 years ago
• facebookresearch / HolisticTraceAnalysis
  A library to analyze PyTorch traces.
  ☆307Updated this week
• bytedance / flux
  A fast communication-overlapping library for tensor parallelism on GPUs.
  ☆224Updated 3 weeks ago
• mlc-ai / mlc-zh
  ☆589Updated 5 months ago
• efeslab / Atom
  [MLSys'24] Atom: Low-bit Quantization for Efficient and Accurate LLM Serving
  ☆278Updated 4 months ago
• AmadeusChan / Awesome-LLM-System-Papers
  ☆502Updated 2 months ago
• hidet-org / hidet
  An open-source efficient deep learning framework/compiler, written in python.
  ☆652Updated last week
• IST-DASLab / marlin
  FP16xINT4 LLM inference kernel that can achieve near-ideal ~4x speedups up to medium batchsizes of 16-32 tokens.
  ☆624Updated 2 months ago
• fpgaminer / GPTQ-triton
  GPTQ inference Triton kernel
  ☆284Updated last year
• mit-han-lab / qserve
  QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving
  ☆443Updated last week
• microsoft / BitBLAS
  BitBLAS is a library to support mixed-precision matrix multiplications, especially for quantized LLM deployment.
  ☆420Updated this week
• microsoft / vidur
  A large-scale simulation framework for LLM inference
  ☆277Updated last month
• sail-sg / zero-bubble-pipeline-parallelism
  Zero Bubble Pipeline Parallelism
  ☆281Updated last week
• FlagOpen / FlagAttention
  A collection of memory efficient attention operators implemented in the Triton language.
  ☆219Updated 5 months ago
• FlagOpen / FlagGems
  FlagGems is an operator library for large language models implemented in Triton Language.
  ☆342Updated this week
• bytedance / byteir
  A model compilation solution for various hardware
  ☆378Updated last week
• d2l-ai / d2l-tvm
  Dive into Deep Learning Compiler
  ☆643Updated 2 years ago
• volcengine / veScale
  A PyTorch Native LLM Training Framework
  ☆665Updated 2 months ago
• awslabs / raf
  ☆140Updated last year
• BobMcDear / attorch
  A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.
  ☆483Updated 3 weeks ago
• usyd-fsalab / fp6_llm
  An efficient GPU support for LLM inference with x-bit quantization (e.g. FP6,FP5).
  ☆208Updated 3 weeks ago
• ColfaxResearch / cutlass-kernels
  ☆167Updated 4 months ago
• albanD / subclass_zoo
  ☆148Updated 5 months ago
• mirage-project / mirage
  Mirage: Automatically Generating Fast GPU Kernels without Programming in Triton/CUDA
  ☆636Updated this week