Alternatives and similar repositories for efficient-transformers:

Users that are interested in efficient-transformers are comparing it to the libraries listed below

• quic / cloud-ai-sdk
  Qualcomm Cloud AI SDK (Platform and Apps) enable high performance deep learning inference on Qualcomm Cloud AI platforms delivering high …
  ☆58Updated 5 months ago
• leimao / Nsight-Systems-Docker-Image
  Nsight Systems In Docker
  ☆20Updated last year
• NVlabs / EfficientDL
  ☆31Updated 10 months ago
• onnx / neural-compressor
  Model compression for ONNX
  ☆91Updated 5 months ago
• SqueezeAILab / open_source_projects
  Open Source Projects from Pallas Lab
  ☆20Updated 3 years ago
• megvii-research / Arch-Net
  Arch-Net: Model Distillation for Architecture Agnostic Model Deployment
  ☆22Updated 3 years ago
• facebookresearch / NasRec
  NASRec Weight Sharing Neural Architecture Search for Recommender Systems
  ☆30Updated last year
• Qualcomm-AI-research / FP8-quantization
  ☆143Updated 2 years ago
• mit-han-lab / tinychat-tutorial
  ☆62Updated 5 months ago
• graphcore-research / out-of-the-box-fp8-training
  Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.
  ☆45Updated 9 months ago
• INT-FlashAttention2024 / INT-FlashAttention
  ☆68Updated 3 months ago
• yuzhenmao / IceFormer
  Implementation of IceFormer: Accelerated Inference with Long-Sequence Transformers on CPUs (ICLR 2024).
  ☆24Updated 10 months ago
• octoml / octoml-profile
  Home for OctoML PyTorch Profiler
  ☆112Updated last year
• facebookresearch / fairring
  Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large …
  ☆65Updated 3 years ago
• pytorch-labs / tritonbench
  Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.
  ☆111Updated this week
• IST-DASLab / QIGen
  Repository for CPU Kernel Generation for LLM Inference
  ☆26Updated last year
• Qualcomm-AI-research / transformer-quantization
  ☆203Updated 3 years ago
• hisrg / SNPE
  Snapdragon Neural Processing Engine (SNPE) SDKThe Snapdragon Neural Processing Engine (SNPE) is a Qualcomm Snapdragon software accelerate…
  ☆34Updated 3 years ago
• fastmachinelearning / qonnx
  QONNX: Arbitrary-Precision Quantized Neural Networks in ONNX
  ☆145Updated this week
• mobiusml / gemlite
  Fast low-bit matmul kernels in Triton
  ☆291Updated this week
• frankxwang / dpo-prefix-sharing
  DPO, but faster 🚀
  ☆40Updated 4 months ago
• triton-inference-server / pytorch_backend
  The Triton backend for the PyTorch TorchScript models.
  ☆146Updated this week
• saic-fi / MobileQuant
  [EMNLP Findings 2024] MobileQuant: Mobile-friendly Quantization for On-device Language Models
  ☆56Updated 7 months ago
• WaveSpeedAI / QuantumAttention
  [WIP] Better (FP8) attention for Hopper
  ☆27Updated last month
• stas00 / ml-ways
  ML/DL Math and Method notes
  ☆60Updated last year
• rasbt / pytorch-memory-optim
  This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…
  ☆91Updated last year
• mit-han-lab / pruning-sparsity-publications
  ☆22Updated last year
• ultralytics / thop
  Profile PyTorch models for FLOPs and parameters, helping to evaluate computational efficiency and memory usage.
  ☆37Updated 3 weeks ago
• vedantroy / gpu_kernels
  ☆26Updated last year
• lightmatter-ai / INT-FP-QSim
  Flexible simulator for mixed precision and format simulation of LLMs and vision transformers.
  ☆49Updated last year