quic / efficient-transformersLinks
This library empowers users to seamlessly port pretrained models and checkpoints on the HuggingFace (HF) hub (developed using HF transformers library) into inference-ready formats that run efficiently on Qualcomm Cloud AI 100 accelerators.
☆82Updated this week
Alternatives and similar repositories for efficient-transformers
Users that are interested in efficient-transformers are comparing it to the libraries listed below
Sorting:
- Model compression for ONNX☆97Updated 11 months ago
- ☆34Updated 4 months ago
- AI Edge Quantizer: flexible post training quantization for LiteRT models.☆72Updated this week
- Mobile App Open☆63Updated this week
- A faster implementation of OpenCV-CUDA that uses OpenCV objects, and more!☆53Updated last month
- ☆205Updated 3 years ago
- ☆163Updated 2 years ago
- Qualcomm Cloud AI SDK (Platform and Apps) enable high performance deep learning inference on Qualcomm Cloud AI platforms delivering high …☆66Updated 2 months ago
- torch::deploy (multipy for non-torch uses) is a system that lets you get around the GIL problem by running multiple Python interpreters i…☆181Updated 2 months ago
- Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large …☆65Updated 3 years ago
- [ECCV 2022] SuperTickets: Drawing Task-Agnostic Lottery Tickets from Supernets via Jointly Architecture Searching and Parameter Pruning☆20Updated 3 years ago
- Easily benchmark PyTorch model FLOPs, latency, throughput, allocated gpu memory and energy consumption☆107Updated 2 years ago
- ☆15Updated 5 months ago
- QONNX: Arbitrary-Precision Quantized Neural Networks in ONNX☆161Updated this week
- C++ implementations for various tokenizers (sentencepiece, tiktoken etc).☆39Updated this week
- llama INT4 cuda inference with AWQ☆55Updated 9 months ago
- High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.☆117Updated last year
- Nsight Systems In Docker☆20Updated last year
- 🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.☆215Updated this week
- A safetensors extension to efficiently store sparse quantized tensors on disk☆180Updated this week
- ☆158Updated 2 years ago
- Customized matrix multiplication kernels☆57Updated 3 years ago
- NASRec Weight Sharing Neural Architecture Search for Recommender Systems☆31Updated last year
- Profile PyTorch models for FLOPs and parameters, helping to evaluate computational efficiency and memory usage.☆59Updated this week
- PyTorch extension for emulating FP8 data formats on standard FP32 Xeon/GPU hardware.☆111Updated 10 months ago
- A block oriented training approach for inference time optimization.☆33Updated last year
- ☆19Updated 3 years ago
- Snapdragon Neural Processing Engine (SNPE) SDKThe Snapdragon Neural Processing Engine (SNPE) is a Qualcomm Snapdragon software accelerate…☆35Updated 3 years ago
- Standalone Flash Attention v2 kernel without libtorch dependency☆112Updated last year
- ML model training for edge devices☆167Updated 2 years ago