Alternatives and similar repositories for llmsys_code_examples

Users that are interested in llmsys_code_examples are comparing it to the libraries listed below

• mit-han-lab / parallel-computing-tutorial
  ☆172Updated last year
• ailzhang / EfficientPyTorch
  Code release for book "Efficient Training in PyTorch"
  ☆73Updated 3 months ago
• gpu-mode / triton-index
  Cataloging released Triton kernels.
  ☆245Updated 6 months ago
• InternLM / turbomind
  ☆90Updated 3 months ago
• MDK8888 / vllmini
  A minimal implementation of vllm.
  ☆49Updated 11 months ago
• hkproj / triton-flash-attention
  ☆180Updated 6 months ago
• tspeterkim / paged-attention-minimal
  a minimal cache manager for PagedAttention, on top of llama3.
  ☆93Updated 10 months ago
• SiriusNEO / Triton-Puzzles-Lite
  Puzzles for learning Triton, play it with minimal environment configuration!
  ☆416Updated 7 months ago
• interestingLSY / swiftLLM
  A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with only 2k lines of code (2% of …
  ☆234Updated last month
• gpu-mode / ring-attention
  ring-attention experiments
  ☆143Updated 9 months ago
• mdy666 / mdy_triton
  ☆140Updated last week
• FlagOpen / FlagAttention
  A collection of memory efficient attention operators implemented in the Triton language.
  ☆272Updated last year
• harleyszhang / llm_counts
  llm theoretical performance analysis tools and support params, flops, memory and latency analysis.
  ☆98Updated this week
• dlsyscourse / hw0
  ☆38Updated last year
• fzyzcjy / torch_memory_saver
  Allow torch tensor memory to be released and resumed later
  ☆80Updated last week
• HazyResearch / Megakernels
  kernels, of the mega variety
  ☆441Updated last month
• microsoft / chunk-attention
  ☆77Updated 2 months ago
• EfficientMoE / MoE-Infinity
  PyTorch library for cost-effective, fast and easy serving of MoE models.
  ☆209Updated last week
• Deep-Learning-Profiling-Tools / triton-viz
  ☆225Updated this week
• openmlsys / openmlsys-cuda
  Tutorials for writing high-performance GPU operators in AI frameworks.
  ☆129Updated last year
• mlc-ai / notebooks
  ☆206Updated 7 months ago
• mit-han-lab / Quest
  [ICML 2024] Quest: Query-Aware Sparsity for Efficient Long-Context LLM Inference
  ☆305Updated last week
• InternLM / Awesome-LLM-Training-System
  ☆40Updated 11 months ago
• galeselee / Awesome_LLM_System-PaperList
  Since the emergence of chatGPT in 2022, the acceleration of Large Language Model has become increasingly important. Here is a list of pap…
  ☆259Updated 4 months ago
• smart-lty / ParallelSpeculativeDecoding
  [ICLR 2025] PEARL: Parallel Speculative Decoding with Adaptive Draft Length
  ☆93Updated 3 months ago
• CalvinXKY / mfu_calculation
  A simple calculation for LLM MFU.
  ☆39Updated 4 months ago
• mit-han-lab / tinychat-tutorial
  ☆71Updated 8 months ago
• efeslab / Atom
  [MLSys'24] Atom: Low-bit Quantization for Efficient and Accurate LLM Serving
  ☆314Updated last year
• AlibabaPAI / FLASHNN
  ☆96Updated 10 months ago
• Shenggan / awesome-distributed-ml
  A curated list of awesome projects and papers for distributed training or inference
  ☆238Updated 9 months ago