lutnn / blink-mm

Related projects ⓘ

Alternatives and complementary repositories for blink-mm

• LeiWang1999 / Stream-k.tvm
  ☆18Updated last month
• feifeibear / ChituAttention
  Quantized Attention on GPU
  ☆30Updated 2 weeks ago
• marsupialtail / gpu-sparsert
  ☆17Updated 4 years ago
• leesou / PIM-DL-ASPLOS
  PIM-DL: Expanding the Applicability of Commodity DRAM-PIMs for Deep Learning via Algorithm-System Co-Optimization
  ☆25Updated 9 months ago
• LeiWang1999 / tvm_gpu_gemm
  play gemm with tvm
  ☆84Updated last year
• mit-han-lab / tinychat-tutorial
  ☆52Updated 2 weeks ago
• Cjkkkk / KgeN
  A TVM-like CUDA/C code generator.
  ☆9Updated 2 years ago
• SNU-ARC / flashneuron
  ☆31Updated last year
• tlc-pack / cutlass_fpA_intB_gemm
  A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer
  ☆85Updated 8 months ago
• bytedance / QSync
  Official resporitory for "IPDPS' 24 QSync: Quantization-Minimized Synchronous Distributed Training Across Hybrid Devices".
  ☆19Updated 8 months ago
• tigert1998 / qat
  Manually implemented quantization-aware training
  ☆21Updated 2 years ago
• microsoft / SparTA
  ☆131Updated 4 months ago
• TiledTensor / TiledCUDA
  TiledCUDA is a highly efficient kernel template library designed to elevate CUDA C’s level of abstraction for processing tiles.
  ☆156Updated this week
• tlc-pack / libflash_attn
  Standalone Flash Attention v2 kernel without libtorch dependency
  ☆98Updated 2 months ago
• casys-kaist / EnvPipe
  ☆23Updated last year
• LeiWang1999 / AutoGPTQ.tvm
  GPTQ inference TVM kernel
  ☆36Updated 6 months ago
• chhzh123 / ptc-tutorial
  PyTorch compilation tutorial covering TorchScript, torch.fx, and Slapo
  ☆19Updated last year
• Linestro / GRACE
  Artifact of ASPLOS'23 paper entitled: GRACE: A Scalable Graph-Based Approach to Accelerating Recommendation Model Inference
  ☆16Updated last year
• benja263 / Integer-Only-Inference-for-Deep-Learning-in-Native-C
  Converting a deep neural network to integer-only inference in native C via uniform quantization and the fixed-point representation.
  ☆21Updated 2 years ago
• weishengying / tiny-flash-attention
  使用 cutlass 实现 flash-attention 精简版，具有教学意义
  ☆32Updated 3 months ago
• pigirons / conv3x3_m1
  This is a demo how to write a high performance convolution run on apple silicon
  ☆52Updated 2 years ago
• sjtu-epcc / Tacker
  Tacker: Tensor-CUDA Core Kernel Fusion for Improving the GPU Utilization while Ensuring QoS
  ☆17Updated 2 years ago
• IntelLabs / FP8-Emulation-Toolkit
  PyTorch extension for emulating FP8 data formats on standard FP32 Xeon/GPU hardware.
  ☆100Updated 11 months ago
• jiazhihao / attention_superoptimizer
  An Attention Superoptimizer
  ☆20Updated 6 months ago
• pku-liang / TileFlow
  TileFlow is a performance analysis tool based on Timeloop for fusion dataflows
  ☆55Updated 7 months ago
• Raincleared-Song / sparse_gpu_operator
  GPU operators for sparse tensor operations
  ☆29Updated 8 months ago
• hgyhungry / alcop-artifact
  ☆21Updated last year
• naver-aics / lut-gemm
  ☆40Updated 7 months ago
• Qualcomm-AI-research / gptvq
  ☆24Updated 7 months ago
• qipengwang / Melon
  MobiSys#114
  ☆21Updated last year