Alternatives and similar repositories for hw1

Users that are interested in hw1 are comparing it to the libraries listed below

• dlsyscourse / hw0
  ☆34Updated last year
• kwai / Megatron-Kwai
  [USENIX ATC '24] Accelerating the Training of Large Language Models using Efficient Activation Rematerialization and Optimal Hybrid Paral…
  ☆55Updated 10 months ago
• LeiWang1999 / AutoGPTQ.tvm
  GPTQ inference TVM kernel
  ☆40Updated last year
• harleyszhang / llm_counts
  llm theoretical performance analysis tools and support params, flops, memory and latency analysis.
  ☆92Updated last week
• YJHMITWEB / ExFlow
  Explore Inter-layer Expert Affinity in MoE Model Inference
  ☆9Updated last year
• infinigence / FlashOverlap
  A lightweight design for computation-communication overlap.
  ☆132Updated last month
• Chtholly-Boss / swizzle
  A practical way of learning Swizzle
  ☆20Updated 4 months ago
• ByteDance-Seed / StragglerAnalysis
  ☆21Updated last month
• alpha0422 / torch-graph
  Simple PyTorch graph capturing.
  ☆19Updated 2 years ago
• awslabs / optimizing-multitask-training-through-dynamic-pipelines
  Official repository for the paper DynaPipe: Optimizing Multi-task Training through Dynamic Pipelines
  ☆19Updated last year
• l1nkr / DL-Compiler-Navigation
  Machine Learning Compiler Road Map
  ☆43Updated last year
• nvixnu / pmpp__programming_massively_parallel_processors
  Examples and exercises from the book Programming Massively Parallel Processors - A Hands-on Approach. David B. Kirk and Wen-mei W. Hwu (T…
  ☆67Updated 4 years ago
• Azure / msccl
  Microsoft Collective Communication Library
  ☆65Updated 6 months ago
• InternLM / turbomind
  ☆85Updated 2 months ago
• CalvinXKY / mfu_calculation
  A simple calculation for LLM MFU.
  ☆38Updated 3 months ago
• AlibabaPAI / FLASHNN
  ☆96Updated 8 months ago
• feifeibear / LLMRoofline
  Compare different hardware platforms via the Roofline Model for LLM inference tasks.
  ☆100Updated last year
• msr-fiddle / dnn-partitioning
  ☆40Updated 4 years ago
• DD-DuDa / BitDecoding
  A GPU-optimized system for efficient long-context LLMs decoding with low-bit KV cache.
  ☆36Updated last month
• dlsyscourse / hw2
  ☆8Updated 7 months ago
• MDK8888 / vllmini
  A minimal implementation of vllm.
  ☆41Updated 10 months ago
• gpu-mode / triton-index
  Cataloging released Triton kernels.
  ☆229Updated 4 months ago
• tspeterkim / paged-attention-minimal
  a minimal cache manager for PagedAttention, on top of llama3.
  ☆89Updated 9 months ago
• DachengLi1 / AMP
  (NeurIPS 2022) Automatically finding good model-parallel strategies, especially for complex models and clusters.
  ☆38Updated 2 years ago
• Bruce-Lee-LY / decoding_attention
  Decoding Attention is specially optimized for MHA, MQA, GQA and MLA using CUDA core for the decoding stage of LLM inference.
  ☆36Updated 2 months ago
• thu-pacman / FasterMoE
  ☆84Updated 3 years ago
• triton-lang / kernels
  ☆80Updated 7 months ago
• gpu-mode / ring-attention
  ring-attention experiments
  ☆145Updated 7 months ago
• tile-ai / AttentionEngine
  ☆49Updated 2 weeks ago
• hao-ai-lab / MuxServe
  ☆62Updated 11 months ago