leimao / Nsight-Systems-Docker-Image

Related projects: ⓘ

• ankan-ban / llama_cu_awq
  llama INT4 cuda inference with AWQ
  ☆46Updated 2 months ago
• tlc-pack / libflash_attn
  Standalone Flash Attention v2 kernel without libtorch dependency
  ☆93Updated last week
• SqueezeAILab / open_source_projects
  Open Source Projects from Pallas Lab
  ☆17Updated 2 years ago
• tlc-pack / cutlass_fpA_intB_gemm
  A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer
  ☆82Updated 6 months ago
• mit-han-lab / tinychat-tutorial
  ☆37Updated 2 months ago
• YashasSamaga / ConvolutionBuildingBlocks
  GEMM and Winograd based convolutions using CUTLASS
  ☆24Updated 4 years ago
• masahi / torchscript-to-tvm
  ☆66Updated last year
• UDC-GAC / openCNN
  A Winograd Minimal Filter Implementation in CUDA
  ☆20Updated 3 years ago
• LeiWang1999 / AutoGPTQ.tvm
  GPTQ inference TVM kernel
  ☆35Updated 4 months ago
• quic / efficient-transformers
  This library empowers users to seamlessly port pretrained models and checkpoints on the HuggingFace (HF) hub (developed using HF transfor…
  ☆37Updated this week
• LeiWang1999 / Stream-k.tvm
  ☆14Updated 2 weeks ago
• yinuotxie / Efficient-LLM-Inferencing-on-GPUs
  Penn CIS 5650 (GPU Programming and Architecture) Final Project
  ☆21Updated 9 months ago
• NVIDIA / online-softmax
  Benchmark code for the "Online normalizer calculation for softmax" paper
  ☆52Updated 6 years ago
• sgl-project / tensorrt-demo
  TensorRT LLM Benchmark Configuration
  ☆10Updated last month
• AndrewZhaoLuo / TVM-Sandbox
  Sandbox for TVM and playing around!
  ☆22Updated last year
• benja263 / Integer-Only-Inference-for-Deep-Learning-in-Native-C
  Converting a deep neural network to integer-only inference in native C via uniform quantization and the fixed-point representation.
  ☆20Updated 2 years ago
• comaniac / epoi
  Benchmark PyTorch Custom Operators
  ☆13Updated last year
• bytedance / ABQ-LLM
  ☆23Updated last week
• tlc-pack / TLCBench
  Benchmark scripts for TVM
  ☆73Updated 2 years ago
• naver-aics / lut-gemm
  ☆33Updated 5 months ago
• Bruce-Lee-LY / cuda_hgemv
  Several optimization methods of half-precision general matrix vector multiplication (HGEMV) using CUDA core.
  ☆40Updated 2 weeks ago
• zhuzilin / pytorch-malloc
  An external memory allocator example for PyTorch.
  ☆13Updated 2 years ago
• ColfaxResearch / cfx-article-src
  ☆17Updated this week
• Qualcomm-AI-research / FP8-quantization
  ☆113Updated last year
• marsupialtail / gpu-sparsert
  ☆17Updated 3 years ago
• chenyu-jiang / nsys2json
  A Python script to convert the output of NVIDIA Nsight Systems (in SQLite format) to JSON in Google Chrome Trace Event Format.
  ☆19Updated 2 weeks ago
• microsoft / DeepSpeed-Kernels
  ☆50Updated 3 months ago
• jundaf2 / CUDA-INT8-GEMM
  CUDA 8-bit Tensor Core Matrix Multiplication based on m16n16k16 WMMA API
  ☆22Updated last year
• MARD1NO / FxxkCUDA
  ☆52Updated this week
• Bruce-Lee-LY / flash_attention_inference
  Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.
  ☆20Updated 2 weeks ago