daemyung / practice-triton

Related projects: ⓘ

• kakaobrain / trident
  A performance library for machine learning applications.
  ☆178Updated 11 months ago
• SqueezeBits / QUICK
  QUICK: Quantization-aware Interleaving and Conflict-free Kernel for efficient LLM inference
  ☆106Updated 6 months ago
• swsnu / aisys2023
  ☆101Updated last year
• hpcaitech / Elixir
  Elixir: Train a Large Language Model on a Small GPU Cluster
  ☆12Updated last year
• NetEase-FuXi / EETQ
  Easy and Efficient Quantization for Transformers
  ☆172Updated 2 months ago
• junstar92 / nvidia-libraries-study
  ☆38Updated this week
• EleutherAI / oslo
  OSLO: Open Source for Large-scale Optimization
  ☆172Updated last year
• SNU-ARC / any-precision-llm
  [ICML 2024 Oral] Any-Precision LLM: Low-Cost Deployment of Multiple, Different-Sized LLMs
  ☆72Updated last month
• zinccat / Awesome-Triton-Kernels
  Collection of kernels written in Triton language
  ☆48Updated 2 weeks ago
• mlsys-seo / ooo-backprop
  ☆21Updated last year
• friendliai / FAI-Model
  FriendliAI Model Hub
  ☆88Updated 2 years ago
• hunkim / llm_gpu_cal
  🔮 LLM GPU Calculator
  ☆20Updated last year
• vedantroy / gpu_kernels
  ☆22Updated 8 months ago
• IST-DASLab / Sparse-Marlin
  Boosting 4-bit inference kernels with 2:4 Sparsity
  ☆47Updated 2 weeks ago
• jiwonsong-dev / SLEB
  Official Implementation of SLEB: Streamlining LLMs through Redundancy Verification and Elimination of Transformer Blocks
  ☆28Updated 2 months ago
• bytedance / AffineQuant
  Official implementation of the ICLR 2024 paper AffineQuant
  ☆16Updated 5 months ago
• kssteven418 / BigLittleDecoder
  [NeurIPS'23] Speculative Decoding with Big Little Decoder
  ☆84Updated 7 months ago
• HanGuo97 / flute
  Fast Matrix Multiplications for Lookup Table-Quantized LLMs
  ☆156Updated this week
• insoochung / transformer_bcq
  BCQ tutorial for transformers
  ☆15Updated last year
• EleutherAI / dps
  Data processing system for polyglot
  ☆88Updated last year
• opengear-project / GEAR
  GEAR: An Efficient KV Cache Compression Recipefor Near-Lossless Generative Inference of LLM
  ☆134Updated 2 months ago
• cloneofsimo / ezmup
  Simple implementation of muP, based on Spectral Condition for Feature Learning. The implementation is SGD only, dont use it for Adam
  ☆66Updated last month
• nicksypark / rope-triton
  ☆10Updated 5 months ago
• mgmalek / efficient_cross_entropy
  ☆66Updated 3 months ago
• siyan-zhao / prepacking
  The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models"
  ☆57Updated 5 months ago
• mscheong01 / speculative_decoding.c
  minimal C implementation of speculative decoding based on llama2.c
  ☆16Updated 2 months ago
• casys-kaist / DaCapo
  ☆12Updated 2 months ago
• davidkim205 / translation
  ☆11Updated 5 months ago
• StableFluffy / EasyLLMFeaturePorter
  1-Click is all you need.
  ☆58Updated 4 months ago