Alternatives and similar repositories for llmsys_code_examples:

Users that are interested in llmsys_code_examples are comparing it to the libraries listed below

• openmlsys / openmlsys-cuda
  Tutorials for writing high-performance GPU operators in AI frameworks.
  ☆130Updated last year
• CalvinXKY / mfu_calculation
  A simple calculation for LLM MFU.
  ☆29Updated 3 weeks ago
• MDK8888 / vllmini
  A minimal implementation of vllm.
  ☆37Updated 8 months ago
• WukLab / preble
  Stateful LLM Serving
  ☆50Updated 2 weeks ago
• chenhongyu2048 / LLM-inference-optimization-paper
  Summary of some awesome work for optimizing LLM inference
  ☆66Updated this week
• yinuotxie / Efficient-LLM-Inferencing-on-GPUs
  Penn CIS 5650 (GPU Programming and Architecture) Final Project
  ☆29Updated last year
• thu-pacman / FasterMoE
  ☆81Updated 2 years ago
• tspeterkim / paged-attention-minimal
  a minimal cache manager for PagedAttention, on top of llama3.
  ☆73Updated 7 months ago
• feifeibear / Odysseus-Transformer
  Odysseus: Playground of LLM Sequence Parallelism
  ☆68Updated 9 months ago
• feifeibear / DPSKV3MFU
  Estimate MFU for DeepSeekV3
  ☆21Updated 2 months ago
• AlibabaPAI / FLASHNN
  ☆90Updated 6 months ago
• galeselee / Awesome_LLM_System-PaperList
  Since the emergence of chatGPT in 2022, the acceleration of Large Language Model has become increasingly important. Here is a list of pap…
  ☆238Updated 3 weeks ago
• LeiWang1999 / AutoGPTQ.tvm
  GPTQ inference TVM kernel
  ☆38Updated 11 months ago
• ademeure / DeeperGEMM
  DeeperGEMM: crazy optimized version
  ☆63Updated 2 weeks ago
• kyegomez / FlashAttention20Triton
  Triton implementation of Flash Attention2.0
  ☆31Updated last year
• d-matrix-ai / keyformer-llm
  ☆52Updated last year
• LLMServe / SwiftTransformer
  High performance Transformer implementation in C++.
  ☆111Updated 2 months ago
• flexflow / flexflow-serve
  FlexFlow Serve: Low-Latency, High-Performance LLM Serving
  ☆32Updated this week
• IBM / triton-dejavu
  Framework to reduce autotune overhead to zero for well known deployments.
  ☆63Updated last week
• alibaba / easydist
  Automated Parallelization System and Infrastructure for Multiple Ecosystems
  ☆78Updated 4 months ago
• InternLM / turbomind
  ☆75Updated this week
• microsoft / AttentionEngine
  ☆52Updated this week
• TiledTensor / TiledCUDA
  We invite you to visit and follow our new repository at https://github.com/microsoft/TileFusion. TiledCUDA is a highly efficient kernel …
  ☆179Updated 2 months ago
• Chtholly-Boss / swizzle
  A practical way of learning Swizzle
  ☆16Updated last month
• tgale96 / grouped_gemm
  PyTorch bindings for CUTLASS grouped GEMM.
  ☆77Updated 4 months ago
• AlibabaResearch / flash-llm
  Flash-LLM: Enabling Cost-Effective and Highly-Efficient Large Generative Model Inference with Unstructured Sparsity
  ☆202Updated last year
• eedalong / ECE408
  Code base and slides for ECE408：Applied Parallel Programming On GPU.
  ☆120Updated 3 years ago
• pytorch-labs / tritonbench
  Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.
  ☆104Updated this week
• zartbot / shallowsim
  DeepSeek-V3/R1 inference performance simulator
  ☆89Updated this week
• triton-lang / kernels
  ☆73Updated 4 months ago