erika-n / GPTzipLinks
An implementation of LLMzip using GPT-2
☆13Updated 2 years ago
Alternatives and similar repositories for GPTzip
Users that are interested in GPTzip are comparing it to the libraries listed below
Sorting:
- QuIP quantization☆55Updated last year
- SparseGPT + GPTQ Compression of LLMs like LLaMa, OPT, Pythia☆41Updated 2 years ago
- ☆146Updated last month
- ☆58Updated 6 months ago
- [ACL 2025 Main] EfficientQAT: Efficient Quantization-Aware Training for Large Language Models☆289Updated 2 months ago
- Query-agnostic KV cache eviction: 3–4× reduction in memory and 2× decrease in latency (Qwen3/2.5, Gemma3, LLaMA3)☆96Updated 2 weeks ago
- Load multiple LoRA modules simultaneously and automatically switch the appropriate combination of LoRA modules to generate the best answe…☆156Updated last year
- Training-free Post-training Efficient Sub-quadratic Complexity Attention. Implemented with OpenAI Triton.☆142Updated this week
- This is the official repository for the paper "Flora: Low-Rank Adapters Are Secretly Gradient Compressors" in ICML 2024.☆104Updated last year
- GPTQLoRA: Efficient Finetuning of Quantized LLMs with GPTQ☆103Updated 2 years ago
- ☆199Updated 8 months ago
- Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.☆41Updated 3 weeks ago
- ☆220Updated last year
- Structural Pruning for LLaMA☆54Updated 2 years ago
- Repo for "LoLCATs: On Low-Rank Linearizing of Large Language Models"☆244Updated 6 months ago
- 3x Faster Inference; Unofficial implementation of EAGLE Speculative Decoding☆75Updated last month
- Automated Identification of Redundant Layer Blocks for Pruning in Large Language Models☆241Updated last year
- scalable and robust tree-based speculative decoding algorithm☆355Updated 6 months ago
- Work in progress.☆70Updated last month
- ☆46Updated last month
- Testing LLM reasoning abilities with family relationship quizzes.☆63Updated 6 months ago
- ☆77Updated last month
- RWKV-7: Surpassing GPT☆94Updated 8 months ago
- Modeling code for a BitNet b1.58 Llama-style model.☆25Updated last year
- Model REVOLVER, a human in the loop model mixing system.☆33Updated 2 years ago
- PB-LLM: Partially Binarized Large Language Models☆153Updated last year
- Official repository for the paper "NeuZip: Memory-Efficient Training and Inference with Dynamic Compression of Neural Networks". This rep…☆59Updated 9 months ago
- Code for the paper "SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot" with LLaMA implementation.☆71Updated 2 years ago
- Code for paper: "QuIP: 2-Bit Quantization of Large Language Models With Guarantees"☆376Updated last year
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks (EMNLP'24)☆147Updated 10 months ago