Alternatives and similar repositories for efficient-transformers

Users that are interested in efficient-transformers are comparing it to the libraries listed below

• onnx / neural-compressor
  Model compression for ONNX
  ☆96Updated 6 months ago
• pytorch-labs / superblock
  A block oriented training approach for inference time optimization.
  ☆33Updated 9 months ago
• quic / cloud-ai-sdk
  Qualcomm Cloud AI SDK (Platform and Apps) enable high performance deep learning inference on Qualcomm Cloud AI platforms delivering high …
  ☆61Updated 2 weeks ago
• leimao / Nsight-Systems-Docker-Image
  Nsight Systems In Docker
  ☆20Updated last year
• gpu-mode / triton-tutorials
  ☆10Updated 3 weeks ago
• pytorch-labs / tritonbench
  Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.
  ☆127Updated this week
• NVlabs / EfficientDL
  ☆31Updated 11 months ago
• mit-han-lab / tinychat-tutorial
  ☆67Updated 7 months ago
• IST-DASLab / SparseFinetuning
  Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry
  ☆42Updated last year
• facebookresearch / ParetoQ
  This repository contains the training code of ParetoQ introduced in our work "ParetoQ Scaling Laws in Extremely Low-bit LLM Quantization"
  ☆64Updated last week
• vedantroy / gpu_kernels
  ☆26Updated last year
• wangsiping97 / FastGEMV
  High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.
  ☆109Updated 10 months ago
• Qualcomm-AI-research / FP8-quantization
  ☆149Updated 2 years ago
• IST-DASLab / gemm-fp8
  High Performance FP8 GEMM Kernels for SM89 and later GPUs.
  ☆13Updated 4 months ago
• ARM-software / kleidiai
  This repository is a read-only mirror of https://gitlab.arm.com/kleidi/kleidiai
  ☆43Updated last week
• facebookresearch / NasRec
  NASRec Weight Sharing Neural Architecture Search for Recommender Systems
  ☆30Updated last year
• INT-FlashAttention2024 / INT-FlashAttention
  ☆73Updated 4 months ago
• facebookresearch / MODel_opt
  Memory Optimizations for Deep Learning (ICML 2023)
  ☆64Updated last year
• NVIDIA / online-softmax
  Benchmark code for the "Online normalizer calculation for softmax" paper
  ☆94Updated 6 years ago
• groq / mlagility
  Machine Learning Agility (MLAgility) benchmark and benchmarking tools
  ☆39Updated 3 weeks ago
• GATECH-EIC / SuperTickets
  [ECCV 2022] SuperTickets: Drawing Task-Agnostic Lottery Tickets from Supernets via Jointly Architecture Searching and Parameter Pruning
  ☆20Updated 2 years ago
• Qualcomm-AI-research / gptvq
  ☆30Updated last year
• IST-DASLab / QIGen
  Repository for CPU Kernel Generation for LLM Inference
  ☆26Updated last year
• jundaf2 / INT8-Flash-Attention-FMHA-Quantization
  ☆157Updated last year
• google-ai-edge / ai-edge-quantizer
  AI Edge Quantizer: flexible post training quantization for LiteRT models.
  ☆41Updated last week
• megvii-research / Arch-Net
  Arch-Net: Model Distillation for Architecture Agnostic Model Deployment
  ☆22Updated 3 years ago
• octoml / octoml-profile
  Home for OctoML PyTorch Profiler
  ☆113Updated 2 years ago
• deepspeedai / DeepSpeed-Kernels
  ☆71Updated 2 months ago
• ahennequ / cuda-tensorcores-register-mapping
  ☆18Updated 2 years ago
• GATECH-EIC / ShiftAddLLM
  ShiftAddLLM: Accelerating Pretrained LLMs via Post-Training Multiplication-Less Reparameterization
  ☆108Updated 7 months ago