quic / efficient-transformers

Related projects ⓘ

Alternatives and complementary repositories for efficient-transformers

• onnx / neural-compressor
  Model compression for ONNX
  ☆75Updated this week
• microsoft / DeepSpeed-Kernels
  ☆55Updated 5 months ago
• quic / cloud-ai-sdk
  Qualcomm Cloud AI SDK (Platform and Apps) enable high performance deep learning inference on Qualcomm Cloud AI platforms delivering high …
  ☆55Updated 3 weeks ago
• INT-FlashAttention2024 / INT-FlashAttention
  ☆47Updated 2 months ago
• facebookresearch / fairring
  Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large …
  ☆63Updated 2 years ago
• Qualcomm-AI-research / gptvq
  ☆24Updated 7 months ago
• DeMoriarty / custom_matmul_kernels
  Customized matrix multiplication kernels
  ☆53Updated 2 years ago
• neuralmagic / compressed-tensors
  A safetensors extension to efficiently store sparse quantized tensors on disk
  ☆50Updated this week
• onnx / steering-committee
  Notes and artifacts from the ONNX steering committee
  ☆25Updated last week
• octoml / octoml-profile
  Home for OctoML PyTorch Profiler
  ☆107Updated last year
• SqueezeAILab / open_source_projects
  Open Source Projects from Pallas Lab
  ☆20Updated 3 years ago
• pytorch-labs / applied-ai
  Applied AI experiments and examples for PyTorch
  ☆166Updated 3 weeks ago
• wangsiping97 / FastGEMV
  High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.
  ☆90Updated 4 months ago
• Deep-Learning-Profiling-Tools / triton-viz
  ☆153Updated this week
• NVlabs / EfficientDL
  ☆30Updated 5 months ago
• facebookresearch / MODel_opt
  Memory Optimizations for Deep Learning (ICML 2023)
  ☆60Updated 8 months ago
• jundaf2 / INT8-Flash-Attention-FMHA-Quantization
  ☆156Updated last year
• YashasSamaga / ConvolutionBuildingBlocks
  GEMM and Winograd based convolutions using CUTLASS
  ☆25Updated 4 years ago
• pytorch-labs / superblock
  A block oriented training approach for inference time optimization.
  ☆30Updated 3 months ago
• gpu-mode / triton-index
  Cataloging released Triton kernels.
  ☆134Updated 2 months ago
• cli99 / flops-profiler
  pytorch-profiler
  ☆50Updated last year
• masahi / torchscript-to-tvm
  ☆67Updated last year
• ankan-ban / llama_cu_awq
  llama INT4 cuda inference with AWQ
  ☆48Updated 4 months ago
• NVIDIA / online-softmax
  Benchmark code for the "Online normalizer calculation for softmax" paper
  ☆59Updated 6 years ago
• marsupialtail / sparsednn
  Fast sparse deep learning on CPUs
  ☆51Updated 2 years ago
• IST-DASLab / SparseFinetuning
  Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry
  ☆38Updated 10 months ago
• mlcommons / logging
  MLPerf™ logging library
  ☆30Updated this week
• ahennequ / cuda-tensorcores-register-mapping
  ☆18Updated 2 years ago
• leimao / Nsight-Systems-Docker-Image
  Nsight Systems in Docker
  ☆17Updated 11 months ago
• parasj / checkmate
  Training neural networks in TensorFlow 2.0 with 5x less memory
  ☆129Updated 2 years ago