quic / efficient-transformers

Related projects ⓘ

Alternatives and complementary repositories for efficient-transformers

• INT-FlashAttention2024 / INT-FlashAttention
  ☆45Updated last month
• facebookresearch / fairring
  Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large …
  ☆63Updated 2 years ago
• onnx / neural-compressor
  Model compression for ONNX
  ☆73Updated 3 weeks ago
• microsoft / DeepSpeed-Kernels
  ☆55Updated 5 months ago
• neuralmagic / compressed-tensors
  A safetensors extension to efficiently store sparse quantized tensors on disk
  ☆46Updated this week
• pytorch-labs / applied-ai
  Applied AI experiments and examples for PyTorch
  ☆159Updated last week
• mit-han-lab / pruning-sparsity-publications
  ☆21Updated last year
• pytorch-labs / superblock
  A block oriented training approach for inference time optimization.
  ☆29Updated 2 months ago
• ankan-ban / llama_cu_awq
  llama INT4 cuda inference with AWQ
  ☆47Updated 4 months ago
• octoml / octoml-profile
  Home for OctoML PyTorch Profiler
  ☆107Updated last year
• DeMoriarty / custom_matmul_kernels
  Customized matrix multiplication kernels
  ☆53Updated 2 years ago
• facebookresearch / MODel_opt
  Memory Optimizations for Deep Learning (ICML 2023)
  ☆59Updated 7 months ago
• jundaf2 / INT8-Flash-Attention-FMHA-Quantization
  ☆156Updated last year
• Deep-Learning-Profiling-Tools / triton-viz
  ☆140Updated this week
• facebookresearch / NasRec
  NASRec Weight Sharing Neural Architecture Search for Recommender Systems
  ☆26Updated 11 months ago
• wangsiping97 / FastGEMV
  High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.
  ☆87Updated 3 months ago
• NVlabs / EfficientDL
  ☆30Updated 4 months ago
• mit-han-lab / tinychat-tutorial
  ☆40Updated this week
• gpu-mode / triton-index
  Cataloging released Triton kernels.
  ☆132Updated 2 months ago
• tlc-pack / libflash_attn
  Standalone Flash Attention v2 kernel without libtorch dependency
  ☆98Updated 2 months ago
• leimao / LibTorch-ResNet-CIFAR
  ResNet Implementation, Training, and Inference Using LibTorch C++ API
  ☆35Updated 5 months ago
• foundation-model-stack / foundation-model-stack
  🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.
  ☆163Updated this week
• andylolu2 / simpleGEMM
  The simplest but fast implementation of matrix multiplication in CUDA.
  ☆32Updated 3 months ago
• mobiusml / gemlite
  Simple and fast low-bit matmul kernels in CUDA / Triton
  ☆133Updated this week
• ahennequ / cuda-tensorcores-register-mapping
  ☆18Updated 2 years ago
• kshitij12345 / torchnnprofiler
  Context Manager to profile the forward and backward times of PyTorch's nn.Module
  ☆83Updated last year
• cli99 / flops-profiler
  pytorch-profiler
  ☆49Updated last year
• Qualcomm-AI-research / FP8-quantization
  ☆121Updated last year
• HanGuo97 / flute
  Fast Matrix Multiplications for Lookup Table-Quantized LLMs
  ☆183Updated last month
• vedantroy / gpu_kernels
  ☆22Updated 10 months ago