Alternatives and similar repositories for efficient-transformers

Users that are interested in efficient-transformers are comparing it to the libraries listed below

• google-ai-edge / ai-edge-quantizer
  AI Edge Quantizer: flexible post training quantization for LiteRT models.
  ☆60Updated this week
• onnx / neural-compressor
  Model compression for ONNX
  ☆97Updated 9 months ago
• NVlabs / EfficientDL
  ☆33Updated 2 months ago
• pytorch / multipy
  torch::deploy (multipy for non-torch uses) is a system that lets you get around the GIL problem by running multiple Python interpreters i…
  ☆180Updated last month
• triton-inference-server / pytorch_backend
  The Triton backend for the PyTorch TorchScript models.
  ☆158Updated 3 weeks ago
• gpu-mode / triton-tutorials
  ☆14Updated 3 months ago
• IntelLabs / DyNAS-T
  Dynamic Neural Architecture Search Toolkit
  ☆30Updated 8 months ago
• facebookresearch / fairring
  Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large …
  ☆65Updated 3 years ago
• mlcommons / mobile_app_open
  Mobile App Open
  ☆59Updated this week
• leimao / Nsight-Systems-Docker-Image
  Nsight Systems In Docker
  ☆20Updated last year
• facebookresearch / NasRec
  NASRec Weight Sharing Neural Architecture Search for Recommender Systems
  ☆30Updated last year
• meta-pytorch / superblock
  A block oriented training approach for inference time optimization.
  ☆34Updated last year
• Libraries-Openly-Fused / cvGPUSpeedup
  A faster implementation of OpenCV-CUDA that uses OpenCV objects, and more!
  ☆51Updated 3 weeks ago
• ahennequ / cuda-tensorcores-register-mapping
  ☆19Updated 2 years ago
• GATECH-EIC / SuperTickets
  [ECCV 2022] SuperTickets: Drawing Task-Agnostic Lottery Tickets from Supernets via Jointly Architecture Searching and Parameter Pruning
  ☆21Updated 3 years ago
• graphcore / poptorch
  PyTorch interface for the IPU
  ☆180Updated last year
• LukasHedegaard / pytorch-benchmark
  Easily benchmark PyTorch model FLOPs, latency, throughput, allocated gpu memory and energy consumption
  ☆105Updated 2 years ago
• MILVLG / mlc-imp
  Enable everyone to develop, optimize and deploy AI models natively on everyone's devices.
  ☆10Updated last year
• meta-pytorch / tokenizers
  C++ implementations for various tokenizers (sentencepiece, tiktoken etc).
  ☆34Updated 2 weeks ago
• neuralmagic / compressed-tensors
  A safetensors extension to efficiently store sparse quantized tensors on disk
  ☆153Updated this week
• vedantroy / gpu_kernels
  ☆26Updated last year
• Qualcomm-AI-research / FP8-quantization
  ☆156Updated 2 years ago
• Qualcomm-AI-research / transformer-quantization
  ☆206Updated 3 years ago
• facebookresearch / MODel_opt
  Memory Optimizations for Deep Learning (ICML 2023)
  ☆102Updated last year
• jundaf2 / INT8-Flash-Attention-FMHA-Quantization
  ☆159Updated last year
• quic / cloud-ai-sdk
  Qualcomm Cloud AI SDK (Platform and Apps) enable high performance deep learning inference on Qualcomm Cloud AI platforms delivering high …
  ☆66Updated 3 weeks ago
• zhenhuaw-me / onnxcli
  ONNX Command-Line Toolbox
  ☆35Updated 10 months ago
• DeMoriarty / custom_matmul_kernels
  Customized matrix multiplication kernels
  ☆56Updated 3 years ago
• dusty-nv / NanoDB
  Zero-copy multimodal vector DB with CUDA and CLIP/SigLIP
  ☆61Updated 3 months ago
• yuzhenmao / IceFormer
  Implementation of IceFormer: Accelerated Inference with Long-Sequence Transformers on CPUs (ICLR 2024).
  ☆25Updated last month