quic / efficient-transformersLinks
This library empowers users to seamlessly port pretrained models and checkpoints on the HuggingFace (HF) hub (developed using HF transformers library) into inference-ready formats that run efficiently on Qualcomm Cloud AI 100 accelerators.
☆85Updated this week
Alternatives and similar repositories for efficient-transformers
Users that are interested in efficient-transformers are comparing it to the libraries listed below
Sorting:
- Model compression for ONNX☆99Updated last year
- ☆34Updated 7 months ago
- QONNX: Arbitrary-Precision Quantized Neural Networks in ONNX☆170Updated last week
- AI Edge Quantizer: flexible post training quantization for LiteRT models.☆88Updated this week
- C++ implementations for various tokenizers (sentencepiece, tiktoken etc).☆46Updated this week
- Mobile App Open☆67Updated this week
- ☆169Updated 2 years ago
- ☆208Updated 4 years ago
- Efficient in-memory representation for ONNX, in Python☆41Updated this week
- NASRec Weight Sharing Neural Architecture Search for Recommender Systems☆31Updated 2 years ago
- A Hackable Quantization Library for PyTorch☆22Updated 4 years ago
- Qualcomm Cloud AI SDK (Platform and Apps) enable high performance deep learning inference on Qualcomm Cloud AI platforms delivering high …☆71Updated last month
- Sandbox for TVM and playing around!☆22Updated 3 years ago
- [ECCV 2022] SuperTickets: Drawing Task-Agnostic Lottery Tickets from Supernets via Jointly Architecture Searching and Parameter Pruning☆20Updated 3 years ago
- ☆70Updated 3 years ago
- TAO Toolkit deep learning networks with PyTorch backend☆107Updated last month
- torch::deploy (multipy for non-torch uses) is a system that lets you get around the GIL problem by running multiple Python interpreters i…☆182Updated last month
- Easily benchmark PyTorch model FLOPs, latency, throughput, allocated gpu memory and energy consumption☆109Updated 2 years ago
- PyTorch interface for the IPU☆181Updated 2 years ago
- ☆19Updated 3 years ago
- Efficient GPU kernels for mixed-precision Vision Transformers in Triton☆16Updated 4 months ago
- ☆68Updated 2 years ago
- ☆160Updated 2 years ago
- A faster implementation of OpenCV-CUDA that uses OpenCV objects, and more!☆54Updated 2 months ago
- Home for OctoML PyTorch Profiler☆114Updated 2 years ago
- Memory Optimizations for Deep Learning (ICML 2023)☆114Updated last year
- Reference implementations of popular Binarized Neural Networks☆109Updated 2 weeks ago
- Inference of quantization aware trained networks using TensorRT☆83Updated 2 years ago
- CLIP and SigLIP models optimized with TensorRT with a Transformers-like API☆30Updated last year
- A block oriented training approach for inference time optimization.☆34Updated last year