Alternatives and similar repositories for efficient-transformers:

Users that are interested in efficient-transformers are comparing it to the libraries listed below

• quic / cloud-ai-sdk
  Qualcomm Cloud AI SDK (Platform and Apps) enable high performance deep learning inference on Qualcomm Cloud AI platforms delivering high …
  ☆55Updated 2 months ago
• onnx / neural-compressor
  Model compression for ONNX
  ☆81Updated 2 months ago
• microsoft / DeepSpeed-Kernels
  ☆57Updated 7 months ago
• pytorch-labs / superblock
  A block oriented training approach for inference time optimization.
  ☆32Updated 5 months ago
• mobiusml / gemlite
  Fast low-bit matmul kernels in Triton
  ☆187Updated last week
• ankan-ban / llama_cu_awq
  llama INT4 cuda inference with AWQ
  ☆49Updated 6 months ago
• facebookresearch / fairring
  Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large …
  ☆63Updated 2 years ago
• mlc-ai / mlc-python
  ☆21Updated last week
• foundation-model-stack / foundation-model-stack
  🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.
  ☆182Updated this week
• Qualcomm-AI-research / FP8-quantization
  ☆131Updated last year
• pytorch-labs / tritonbench
  Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.
  ☆75Updated this week
• yuzhenmao / IceFormer
  Implementation of IceFormer: Accelerated Inference with Long-Sequence Transformers on CPUs (ICLR 2024).
  ☆22Updated 7 months ago
• leimao / Nsight-Systems-Docker-Image
  Nsight Systems in Docker
  ☆19Updated last year
• leimao / CUDA-GEMM-Optimization
  CUDA Matrix Multiplication Optimization
  ☆152Updated 6 months ago
• INT-FlashAttention2024 / INT-FlashAttention
  ☆56Updated 3 months ago
• gpu-mode / triton-index
  Cataloging released Triton kernels.
  ☆156Updated last week
• mit-han-lab / pruning-sparsity-publications
  ☆22Updated last year
• Deep-Learning-Profiling-Tools / triton-viz
  ☆170Updated last week
• wangsiping97 / FastGEMV
  High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.
  ☆93Updated 6 months ago
• neuralmagic / compressed-tensors
  A safetensors extension to efficiently store sparse quantized tensors on disk
  ☆64Updated this week
• SqueezeAILab / open_source_projects
  Open Source Projects from Pallas Lab
  ☆20Updated 3 years ago
• tlc-pack / libflash_attn
  Standalone Flash Attention v2 kernel without libtorch dependency
  ☆99Updated 4 months ago
• facebookresearch / MODel_opt
  Memory Optimizations for Deep Learning (ICML 2023)
  ☆62Updated 10 months ago
• jundaf2 / INT8-Flash-Attention-FMHA-Quantization
  ☆157Updated last year
• stanford-futuredata / stk
  ☆96Updated 4 months ago
• habanero-lab / APPy
  APPy (Annotated Parallelism for Python) enables users to annotate loops and tensor expressions in Python with compiler directives akin to…
  ☆21Updated 3 weeks ago
• GindaChen / FlexFlashAttention3
  FlexAttention w/ FlashAttention3 Support
  ☆27Updated 3 months ago
• vedantroy / gpu_kernels
  ☆25Updated last year
• unixpickle / learn-ptx
  Learning about CUDA by writing PTX code.
  ☆31Updated 10 months ago
• InternLM / turbomind
  ☆54Updated last month