SqueezeBits / owlite-examplesLinks
OwLite Examples repository offers illustrative example codes to help users seamlessly compress PyTorch deep learning models and transform them into TensorRT engines.
☆10Updated 11 months ago
Alternatives and similar repositories for owlite-examples
Users that are interested in owlite-examples are comparing it to the libraries listed below
Sorting:
- Study Group of Deep Learning Compiler☆163Updated 2 years ago
- ☆54Updated 9 months ago
- OwLite is a low-code AI model compression toolkit for AI models.☆50Updated 3 months ago
- Code for the AAAI 2024 Oral paper "OWQ: Outlier-Aware Weight Quantization for Efficient Fine-Tuning and Inference of Large Language Model…☆64Updated last year
- ☆56Updated 2 years ago
- ☆73Updated 3 months ago
- ☆68Updated last year
- QUICK: Quantization-aware Interleaving and Conflict-free Kernel for efficient LLM inference☆119Updated last year
- LaLaRAND: Flexible Layer-by-Layer CPU/GPU Scheduling for Real-Time DNN Tasks☆15Updated 3 years ago
- NEST Compiler☆117Updated 6 months ago
- PyTorch CoreSIG☆56Updated 8 months ago
- ☆103Updated 2 years ago
- ☆25Updated 2 years ago
- Provides the examples to write and build Habana custom kernels using the HabanaTools☆22Updated 4 months ago
- [ICML 2024 Oral] Any-Precision LLM: Low-Cost Deployment of Multiple, Different-Sized LLMs☆113Updated last month
- PyTorch emulation library for Microscaling (MX)-compatible data formats☆288Updated 2 months ago
- ☆51Updated last year
- ☆13Updated 2 weeks ago
- ☆158Updated 2 years ago
- ☆90Updated last year
- ☆206Updated 3 years ago
- ☆20Updated 8 months ago
- Tender: Accelerating Large Language Models via Tensor Decompostion and Runtime Requantization (ISCA'24)☆20Updated last year
- Multi-DNN Inference Engine for Heterogeneous Mobile Processors☆34Updated last year
- ☆238Updated 2 years ago
- PyTorch Quantization Framework For OCP MX Datatypes.☆13Updated 3 months ago
- List of papers related to Vision Transformers quantization and hardware acceleration in recent AI conferences and journals.☆94Updated last year
- [ICML'21 Oral] I-BERT: Integer-only BERT Quantization☆255Updated 2 years ago
- Study parallel programming - CUDA, OpenMP, MPI, Pthread☆58Updated 3 years ago
- ☆107Updated last year