Faster Pytorch bitsandbytes 4bit fp4 nn.Linear ops
☆30Mar 16, 2024Updated 2 years ago
Alternatives and similar repositories for torch-bnb-fp4
Users that are interested in torch-bnb-fp4 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆13Feb 24, 2021Updated 5 years ago
- IntLLaMA: A fast and light quantization solution for LLaMA☆19Jul 21, 2023Updated 3 years ago
- The official PyTorch implementation of the NeurIPS2022 (spotlight) paper, Outlier Suppression: Pushing the Limit of Low-bit Transformer L…☆50Oct 5, 2022Updated 4 years ago
- BGEMM-CUDA is a CUDA-based low-bit GEMM kernel library for efficient neural network inference. It implements optimized binary and ternary…☆21Aug 30, 2024Updated 2 years ago
- ☆18Sep 22, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆10Feb 26, 2026Updated 8 months ago
- Collections of model quantization algorithms. Any issues, please contact Peng Chen (blueardour@gmail.com)☆45Aug 19, 2021Updated 5 years ago
- Arrow Matrix Decomposition - Communication-Efficient Distributed Sparse Matrix Multiplication☆15Mar 25, 2024Updated 2 years ago
- Pragmatic approach to parsing import profiles for CI's☆12Jul 1, 2024Updated 2 years ago
- ☆12Sep 1, 2023Updated 3 years ago
- ACL 2023☆38Jun 6, 2023Updated 3 years ago
- PyTorch implementation of "Deep Transferring Quantization" (ECCV2020)☆18Jun 22, 2022Updated 4 years ago
- Solve puzzles. Learn CUDA.☆62Dec 13, 2023Updated 2 years ago
- PyTorch half precision gemm lib w/ fused optional bias + optional relu/gelu☆80Dec 3, 2024Updated last year
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Parallel Associative Scan for Language Models☆18Jan 8, 2024Updated 2 years ago
- [ICDCS 2023] Evaluation and Optimization of Gradient Compression for Distributed Deep Learning☆10Apr 28, 2023Updated 3 years ago
- Playing Pokemon Red with Reinforcement Learning☆22Jul 28, 2025Updated last year
- The official implementation of the paper "Reducing Fine-Tuning Memory Overhead by Approximate and Memory-Sharing Backpropagation"☆21Aug 16, 2026Updated 2 months ago
- High Performance FP8 GEMM Kernels for SM89 and later GPUs.☆21Jan 24, 2025Updated last year
- Code repo for "Model-Generated Pretraining Signals Improves Zero-Shot Generalization of Text-to-Text Transformers" (ACL 2023)☆22Nov 1, 2023Updated 3 years ago
- ☆236Jun 11, 2024Updated 2 years ago
- Knowledge Graph Generator app☆35Apr 18, 2024Updated 2 years ago
- Post-Training Quantization for Vision transformers.☆246Jul 19, 2022Updated 4 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Code for paper: "QuIP: 2-Bit Quantization of Large Language Models With Guarantees" adapted for Llama models☆40Aug 4, 2023Updated 3 years ago
- [Neurips 2022] “ Back Razor: Memory-Efficient Transfer Learning by Self-Sparsified Backpropogation”, Ziyu Jiang*, Xuxi Chen*, Xueqin Huan…☆19Mar 14, 2023Updated 3 years ago
- [NeurIPS 2024] Low rank memory efficient optimizer without SVD☆34Jul 1, 2025Updated last year
- Applied AI experiments and examples for PyTorch☆322Aug 22, 2025Updated last year
- ☆19Nov 6, 2023Updated 2 years ago
- CUDA and Triton implementations of Flash Attention with SoftmaxN.☆75May 26, 2024Updated 2 years ago
- QLoRA: Efficient Finetuning of Quantized LLMs☆11Jul 22, 2023Updated 3 years ago
- A fine-tune framework based on pytorch-pretrained-BERT☆17Dec 8, 2022Updated 3 years ago
- 记录斯坦福公开课EE263的学习资料以及笔记。☆17Aug 29, 2019Updated 7 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Build modern UIs in Jupyter with Python☆12Dec 28, 2022Updated 3 years ago
- [ICML 2025] This is the official PyTorch implementation of "ZipAR: Accelerating Auto-regressive Image Generation through Spatial Locality…☆52Mar 25, 2025Updated last year
- Unofficial Scalable-Softmax Is Superior for Attention☆21May 30, 2025Updated last year
- extensible collectives library in triton☆98Mar 31, 2025Updated last year
- The official implementation of PTQD: Accurate Post-Training Quantization for Diffusion Models☆104Mar 12, 2024Updated 2 years ago
- 模型量化工程 Base pretrained models and datasets in pytorch (MNIST, SVHN, CIFAR10, CIFAR100, STL10, AlexNet, VGG16, VGG19, ResNet, Inception,…☆12Aug 3, 2018Updated 8 years ago
- ☆13Nov 14, 2024Updated last year