megvii-research / IntLLaMALinks
IntLLaMA: A fast and light quantization solution for LLaMA
☆18Updated last year
Alternatives and similar repositories for IntLLaMA
Users that are interested in IntLLaMA are comparing it to the libraries listed below
Sorting:
- An object detection codebase based on MegEngine.☆28Updated 2 years ago
- FastCache: Fast Caching for Diffusion Transformer Through Learnable Linear Approximation [Efficient ML Model]☆21Updated last week
- ☆31Updated last year
- [CVPR 2025] Q-DiT: Accurate Post-Training Quantization for Diffusion Transformers☆50Updated 9 months ago
- TVMScript kernel for deformable attention☆25Updated 3 years ago
- Quantized Attention on GPU☆44Updated 6 months ago
- Accelerate LLM preference tuning via prefix sharing with a single line of code☆41Updated last month
- Patch convolution to avoid large GPU memory usage of Conv2D☆87Updated 4 months ago
- ☆11Updated last year
- Triton implement of bi-directional (non-causal) linear attention☆49Updated 4 months ago
- Benchmarking Attention Mechanism in Vision Transformers.☆18Updated 2 years ago
- [ICLR 2024] This is the official PyTorch implementation of "QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Mod…☆38Updated last year
- [ICLR 2024] This is the official PyTorch implementation of "QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Mod…☆27Updated last year
- An auxiliary project analysis of the characteristics of KV in DiT Attention.☆30Updated 6 months ago
- Implementation of IceFormer: Accelerated Inference with Long-Sequence Transformers on CPUs (ICLR 2024).☆25Updated 11 months ago
- [ICML 2022] "DepthShrinker: A New Compression Paradigm Towards Boosting Real-Hardware Efficiency of Compact Neural Networks", by Yonggan …☆71Updated 2 years ago
- torch.compile artifacts for common deep learning models, can be used as a learning resource for torch.compile☆17Updated last year
- torch_quantizer is a out-of-box quantization tool for PyTorch models on CUDA backend, specially optimized for Diffusion Models.☆22Updated last year
- Code for Draft Attention☆37Updated 2 weeks ago
- ☆21Updated 2 years ago
- APPy (Annotated Parallelism for Python) enables users to annotate loops and tensor expressions in Python with compiler directives akin to…☆23Updated this week
- High Performance FP8 GEMM Kernels for SM89 and later GPUs.☆13Updated 4 months ago
- Odysseus: Playground of LLM Sequence Parallelism☆70Updated 11 months ago
- Official Code For Dual Grained Quantization: Efficient Fine-Grained Quantization for LLM☆14Updated last year
- Various test models in WNNX format. It can view with `pip install wnetron && wnetron`☆12Updated 2 years ago
- [ICLR 2025] Linear Combination of Saved Checkpoints Makes Consistency and Diffusion Models Better☆14Updated 3 months ago
- Training LLaMA language model with MMEngine! It supports LoRA fine-tuning!☆40Updated 2 years ago
- ☆31Updated 11 months ago
- [CVPR-2023] Towards Any Structural Pruning☆16Updated 2 years ago
- ACL 2023☆39Updated 2 years ago