quic / efficient-transformersLinks
This library empowers users to seamlessly port pretrained models and checkpoints on the HuggingFace (HF) hub (developed using HF transformers library) into inference-ready formats that run efficiently on Qualcomm Cloud AI 100 accelerators.
☆85Updated this week
Alternatives and similar repositories for efficient-transformers
Users that are interested in efficient-transformers are comparing it to the libraries listed below
Sorting:
- ☆34Updated 6 months ago
- Model compression for ONNX☆99Updated last year
- AI Edge Quantizer: flexible post training quantization for LiteRT models.☆84Updated last week
- A faster implementation of OpenCV-CUDA that uses OpenCV objects, and more!☆54Updated last month
- Mobile App Open☆66Updated this week
- QONNX: Arbitrary-Precision Quantized Neural Networks in ONNX☆168Updated this week
- torch::deploy (multipy for non-torch uses) is a system that lets you get around the GIL problem by running multiple Python interpreters i…☆182Updated 2 weeks ago
- Easily benchmark PyTorch model FLOPs, latency, throughput, allocated gpu memory and energy consumption☆109Updated 2 years ago
- ☆208Updated 4 years ago
- NASRec Weight Sharing Neural Architecture Search for Recommender Systems☆31Updated 2 years ago
- Qualcomm Cloud AI SDK (Platform and Apps) enable high performance deep learning inference on Qualcomm Cloud AI platforms delivering high …☆70Updated 3 weeks ago
- A block oriented training approach for inference time optimization.☆34Updated last year
- Memory Optimizations for Deep Learning (ICML 2023)☆114Updated last year
- ☆15Updated 7 months ago
- TAO Toolkit deep learning networks with PyTorch backend☆107Updated 3 weeks ago
- ☆168Updated 2 years ago
- A Hackable Quantization Library for PyTorch☆22Updated 4 years ago
- C++ implementations for various tokenizers (sentencepiece, tiktoken etc).☆44Updated last week
- Reference implementations of popular Binarized Neural Networks☆109Updated 3 weeks ago
- Customized matrix multiplication kernels☆57Updated 3 years ago
- PyTorch Quantization Aware Training Example☆146Updated last year
- Swin Transformer C++ Implementation☆65Updated 4 years ago
- PyTorch interface for the IPU☆181Updated 2 years ago
- Nsight Systems In Docker☆20Updated 2 years ago
- ☆176Updated 2 years ago
- ☆70Updated 3 years ago
- ONNX Command-Line Toolbox☆35Updated last year
- ☆160Updated 2 years ago
- ☆68Updated 2 years ago
- 🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.☆217Updated 2 weeks ago