Alternatives and similar repositories for llmsys_code_examples

Users that are interested in llmsys_code_examples are comparing it to the libraries listed below

• MDK8888 / vllmini
  A minimal implementation of vllm.
  ☆41Updated 10 months ago
• gpu-mode / triton-index
  Cataloging released Triton kernels.
  ☆229Updated 4 months ago
• gpu-mode / ring-attention
  ring-attention experiments
  ☆145Updated 7 months ago
• tspeterkim / paged-attention-minimal
  a minimal cache manager for PagedAttention, on top of llama3.
  ☆89Updated 9 months ago
• Deep-Learning-Profiling-Tools / triton-viz
  ☆215Updated this week
• microsoft / chunk-attention
  ☆76Updated last month
• fanlai0990 / CS598
  Systems for GenAI
  ☆136Updated last month
• InternLM / turbomind
  ☆85Updated 2 months ago
• mit-han-lab / parallel-computing-tutorial
  ☆169Updated last year
• tgale96 / grouped_gemm
  PyTorch bindings for CUTLASS grouped GEMM.
  ☆93Updated last week
• pytorch-labs / tritonbench
  Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.
  ☆127Updated this week
• mit-han-lab / tinychat-tutorial
  ☆67Updated 7 months ago
• AlibabaResearch / flash-llm
  Flash-LLM: Enabling Cost-Effective and Highly-Efficient Large Generative Model Inference with Unstructured Sparsity
  ☆211Updated last year
• nvixnu / pmpp__programming_massively_parallel_processors
  Examples and exercises from the book Programming Massively Parallel Processors - A Hands-on Approach. David B. Kirk and Wen-mei W. Hwu (T…
  ☆67Updated 4 years ago
• triton-lang / kernels
  ☆80Updated 7 months ago
• KnowingNothing / MatmulTutorial
  A Easy-to-understand TensorOp Matmul Tutorial
  ☆360Updated 8 months ago
• hkproj / triton-flash-attention
  ☆169Updated 5 months ago
• ademeure / DeeperGEMM
  DeeperGEMM: crazy optimized version
  ☆69Updated last month
• interestingLSY / swiftLLM
  A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with only 2k lines of code (2% of …
  ☆202Updated 2 weeks ago
• flashinfer-ai / cutlass-viz
  ☆59Updated last month
• INT-FlashAttention2024 / INT-FlashAttention
  ☆73Updated 4 months ago
• tile-ai / AttentionEngine
  ☆49Updated 2 weeks ago
• InternLM / Awesome-LLM-Training-System
  ☆36Updated 10 months ago
• HazyResearch / Megakernels
  kernels, of the mega variety
  ☆329Updated this week
• microsoft / AttentionEngine
  ☆71Updated 2 weeks ago
• SiriusNEO / Triton-Puzzles-Lite
  Puzzles for learning Triton, play it with minimal environment configuration!
  ☆346Updated 6 months ago
• luliyucoordinate / cute-flash-attention
  Implement Flash Attention using Cute.
  ☆85Updated 5 months ago
• LLMServe / SwiftTransformer
  High performance Transformer implementation in C++.
  ☆124Updated 4 months ago
• harleyszhang / llm_counts
  llm theoretical performance analysis tools and support params, flops, memory and latency analysis.
  ☆92Updated last week
• mlc-ai / notebooks
  ☆207Updated 6 months ago