vedantroy / gpu_kernels

Related projects ⓘ

Alternatives and complementary repositories for gpu_kernels

• IST-DASLab / Sparse-Marlin
  Boosting 4-bit inference kernels with 2:4 Sparsity
  ☆51Updated 2 months ago
• rayleizhu / vllm-ra
  [ACL 2024] RelayAttention for Efficient Large Language Model Serving with Long System Prompts
  ☆34Updated 8 months ago
• GindaChen / FlexFlashAttention3
  FlexAttention w/ FlashAttention3 Support
  ☆27Updated last month
• feifeibear / Odysseus-Transformer
  Odysseus: Playground of LLM Sequence Parallelism
  ☆57Updated 5 months ago
• dame-cell / Triformer
  Transformers components but in Triton
  ☆27Updated last week
• tgale96 / grouped_gemm
  PyTorch bindings for CUTLASS grouped GEMM.
  ☆53Updated 3 weeks ago
• mobiusml / gemlite
  Simple and fast low-bit matmul kernels in CUDA / Triton
  ☆147Updated this week
• ankan-ban / llama_cu_awq
  llama INT4 cuda inference with AWQ
  ☆48Updated 4 months ago
• IST-DASLab / SparseFinetuning
  Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry
  ☆38Updated 10 months ago
• INT-FlashAttention2024 / INT-FlashAttention
  ☆47Updated 2 months ago
• NVlabs / COAT
  ☆35Updated this week
• feifeibear / ChituAttention
  Quantized Attention on GPU
  ☆31Updated this week
• zinccat / Awesome-Triton-Kernels
  Collection of kernels written in Triton language
  ☆69Updated 3 weeks ago
• Aleph-Alpha / NeurIPS-WANT-submission-efficient-parallelization-layouts
  ☆22Updated 11 months ago
• triton-lang / kernels
  ☆49Updated 2 weeks ago
• microsoft / DeepSpeed-Kernels
  ☆55Updated 6 months ago
• LeiWang1999 / AutoGPTQ.tvm
  GPTQ inference TVM kernel
  ☆36Updated 7 months ago
• MDK8888 / vllmini
  A minimal implementation of vllm.
  ☆30Updated 3 months ago
• stanford-futuredata / stk
  ☆90Updated 2 months ago
• GATECH-EIC / ShiftAddLLM
  ShiftAddLLM: Accelerating Pretrained LLMs via Post-Training Multiplication-Less Reparameterization
  ☆87Updated last month
• thu-ml / Jetfire-INT8Training
  ☆23Updated 4 months ago
• tanyuqian / redco
  NAACL '24 (Best Demo Paper RunnerUp) / MlSys @ NeurIPS '23 - RedCoast: A Lightweight Tool to Automate Distributed Training and Inference
  ☆61Updated last month
• siyan-zhao / prepacking
  The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models"
  ☆56Updated last month
• sgl-project / tensorrt-demo
  TensorRT LLM Benchmark Configuration
  ☆11Updated 3 months ago
• yuzhenmao / IceFormer
  Implementation of IceFormer: Accelerated Inference with Long-Sequence Transformers on CPUs (ICLR 2024).
  ☆20Updated 5 months ago
• shadowpa0327 / Palu
  Code for Palu: Compressing KV-Cache with Low-Rank Projection
  ☆57Updated last week
• FasterDecoding / TEAL
  ☆96Updated 2 months ago
• SNU-ARC / any-precision-llm
  [ICML 2024 Oral] Any-Precision LLM: Low-Cost Deployment of Multiple, Different-Sized LLMs
  ☆83Updated 3 months ago
• zankner / Hydra
  ☆34Updated 9 months ago