erika-n / GPTzip
An implementation of LLMzip using GPT-2
☆12Updated last year
Related projects ⓘ
Alternatives and complementary repositories for GPTzip
- QuIP quantization☆46Updated 7 months ago
- ☆61Updated last week
- KV cache compression for high-throughput LLM inference☆82Updated last week
- Official repository for the paper "SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention"☆91Updated last month
- An algorithm for static activation quantization of LLMs☆68Updated this week
- EfficientQAT: Efficient Quantization-Aware Training for Large Language Models☆222Updated last month
- ☆95Updated last month
- A toolkit for fine-tuning, inferencing, and evaluating GreenBitAI's LLMs.☆73Updated 3 weeks ago
- GPTQLoRA: Efficient Finetuning of Quantized LLMs with GPTQ☆96Updated last year
- A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIM☆49Updated 7 months ago
- Course Project for COMP4471 on RWKV☆16Updated 9 months ago
- The simplest, fastest repository for training/finetuning medium-sized xLSTMs.☆38Updated 5 months ago
- PB-LLM: Partially Binarized Large Language Models☆146Updated 11 months ago
- An efficent implementation of the method proposed in "The Era of 1-bit LLMs"☆154Updated 3 weeks ago
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks☆129Updated last month
- SparseGPT + GPTQ Compression of LLMs like LLaMa, OPT, Pythia☆41Updated last year
- Block Transformer: Global-to-Local Language Modeling for Fast Inference (Official Code)☆133Updated last month
- Low-bit optimizers for PyTorch☆118Updated last year
- The training notebooks that were similar to the original script used to train TinyMistral.☆19Updated 11 months ago
- Official implementation of the ICLR 2024 paper AffineQuant☆21Updated 7 months ago
- ☆182Updated 3 weeks ago
- ☆62Updated last month
- FBI-LLM: Scaling Up Fully Binarized LLMs from Scratch via Autoregressive Distillation☆45Updated 4 months ago
- ☆67Updated 8 months ago
- ☆40Updated last year
- Official repository for the paper "NeuZip: Memory-Efficient Training and Inference with Dynamic Compression of Neural Networks". This rep…☆27Updated last week
- Code for paper: "QuIP: 2-Bit Quantization of Large Language Models With Guarantees" adapted for Llama models☆36Updated last year
- ☆43Updated 3 months ago
- This repository contains code for the MicroAdam paper.☆12Updated 4 months ago
- (ICML 2024) BiLLM: Pushing the Limit of Post-Training Quantization for LLMs☆193Updated 5 months ago
- Layer-Condensed KV cache w/ 10 times larger batch size, fewer params and less computation. Dramatic speed up with better task performance…☆137Updated this week