erika-n / GPTzipLinks
An implementation of LLMzip using GPT-2
☆13Updated 2 years ago
Alternatives and similar repositories for GPTzip
Users that are interested in GPTzip are comparing it to the libraries listed below
Sorting:
- ☆63Updated 11 months ago
- QuIP quantization☆61Updated last year
- [ACL 2025 Main] EfficientQAT: Efficient Quantization-Aware Training for Large Language Models☆319Updated last month
- Official repository for the paper "NeuZip: Memory-Efficient Training and Inference with Dynamic Compression of Neural Networks". This rep…☆60Updated last year
- ☆159Updated 6 months ago
- SparseGPT + GPTQ Compression of LLMs like LLaMa, OPT, Pythia☆41Updated 2 years ago
- An efficent implementation of the method proposed in "The Era of 1-bit LLMs"☆155Updated last year
- 3x Faster Inference; Unofficial implementation of EAGLE Speculative Decoding☆82Updated 5 months ago
- GPTQLoRA: Efficient Finetuning of Quantized LLMs with GPTQ☆101Updated 2 years ago
- Load multiple LoRA modules simultaneously and automatically switch the appropriate combination of LoRA modules to generate the best answe…☆157Updated last year
- This is the official repository for the paper "Flora: Low-Rank Adapters Are Secretly Gradient Compressors" in ICML 2024.☆105Updated last year
- Genertaes control vectors for use with llama.cpp in GGUF format.☆36Updated 9 months ago
- PB-LLM: Partially Binarized Large Language Models☆157Updated 2 years ago
- RWKV-7: Surpassing GPT☆101Updated last year
- REAP: Router-weighted Expert Activation Pruning for SMoE compression☆151Updated 2 weeks ago
- Advanced Ultra-Low Bitrate Compression Techniques for the LLaMA Family of LLMs☆110Updated last year
- Training-free Post-training Efficient Sub-quadratic Complexity Attention. Implemented with OpenAI Triton.☆148Updated last month
- Repo for "LoLCATs: On Low-Rank Linearizing of Large Language Models"☆249Updated 10 months ago
- The simplest, fastest repository for training/finetuning medium-sized xLSTMs.☆41Updated last year
- An OpenAI API compatible LLM inference server based on ExLlamaV2.☆25Updated last year
- Testing LLM reasoning abilities with family relationship quizzes.☆63Updated 10 months ago
- Course Project for COMP4471 on RWKV☆17Updated last year
- Automated Identification of Redundant Layer Blocks for Pruning in Large Language Models☆258Updated last year
- ☆204Updated last year
- ☆42Updated 7 months ago
- Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.☆202Updated last year
- [NeurIPS'25 Oral] Query-agnostic KV cache eviction: 3–4× reduction in memory and 2× decrease in latency (Qwen3/2.5, Gemma3, LLaMA3)☆172Updated 3 weeks ago
- The homepage of OneBit model quantization framework.☆197Updated 10 months ago
- Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.☆47Updated last month
- Embed arbitrary modalities (images, audio, documents, etc) into large language models.☆188Updated last year