NVIDIA / HMM_sample_code

Related projects ⓘ

Alternatives and complementary repositories for HMM_sample_code

• LeiWang1999 / AutoGPTQ.tvm
  GPTQ inference TVM kernel
  ☆36Updated 6 months ago
• enp1s0 / ozIMMU
  FP64 equivalent GEMM via Int8 Tensor Cores using the Ozaki scheme
  ☆46Updated 2 months ago
• jiazhihao / attention_superoptimizer
  An Attention Superoptimizer
  ☆20Updated 6 months ago
• Lin-Mao / DrGPUM
  A memory profiler for NVIDIA GPUs to explore memory inefficiencies in GPU-accelerated applications.
  ☆22Updated last month
• iree-org / iree-nvgpu
  ☆48Updated 8 months ago
• microsoft / DeepSpeed-Kernels
  ☆55Updated 5 months ago
• zhuzilin / pytorch-malloc
  An external memory allocator example for PyTorch.
  ☆13Updated 3 years ago
• tgale96 / grouped_gemm
  PyTorch bindings for CUTLASS grouped GEMM.
  ☆53Updated 3 weeks ago
• K-Wu / pytorch-direct
  Code for Large Graph Convolutional Network Training with GPU-Oriented Data Communication Architecture (accepted by PVLDB).The outdated wr…
  ☆8Updated last year
• Aleph-Alpha / NeurIPS-WANT-submission-efficient-parallelization-layouts
  ☆22Updated 11 months ago
• tlc-pack / libflash_attn
  Standalone Flash Attention v2 kernel without libtorch dependency
  ☆98Updated 2 months ago
• wmmae / wmma_extension
  An extension library of WMMA API (Tensor Core API)
  ☆84Updated 4 months ago
• chips-compilers-mlsys-21 / chips-compilers-mlsys-21.github.io
  ☆11Updated 3 years ago
• hpcgarage / cuASR
  cuASR: CUDA Algebra for Semirings
  ☆34Updated 2 years ago
• tlc-pack / cutlass_fpA_intB_gemm
  A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer
  ☆85Updated 8 months ago
• Harry-Chen / InfMoE
  Inference framework for MoE layers based on TensorRT with Python binding
  ☆41Updated 3 years ago
• eth-cscs / Tiled-MM
  Matrix multiplication on GPUs for matrices stored on a CPU. Similar to cublasXt, but ported to both NVIDIA and AMD GPUs.
  ☆29Updated 2 months ago
• feifeibear / ChituAttention
  Quantized Attention on GPU
  ☆30Updated 2 weeks ago
• ptillet / triton-llvm-releases
  ☆20Updated last year
• Jokeren / GPA
  GPU Performance Advisor
  ☆63Updated 2 years ago
• facebookresearch / fairring
  Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large …
  ☆63Updated 2 years ago
• feifeibear / Odysseus-Transformer
  Odysseus: Playground of LLM Sequence Parallelism
  ☆57Updated 5 months ago
• zheng-ningxin / SparTA
  ☆8Updated last year
• DachengLi1 / AMP
  (NeurIPS 2022) Automatically finding good model-parallel strategies, especially for complex models and clusters.
  ☆34Updated 2 years ago
• dame-cell / Triformer
  Transformers components but in Triton
  ☆27Updated this week
• manishucsd / py-codegen
  ☆14Updated last month
• Bruce-Lee-LY / cuda_back2back_hgemm
  Use tensor core to calculate back-to-back HGEMM (half-precision general matrix multiplication) with MMA PTX instruction.
  ☆11Updated last year
• Azure / msccl-executor-nccl
  ☆33Updated 2 months ago
• GindaChen / FlexFlashAttention3
  FlexAttention w/ FlashAttention3 Support
  ☆27Updated last month