erika-n / GPTzipLinks
An implementation of LLMzip using GPT-2
☆13Updated last year
Alternatives and similar repositories for GPTzip
Users that are interested in GPTzip are comparing it to the libraries listed below
Sorting:
- ☆139Updated 3 weeks ago
- ☆56Updated 6 months ago
- Official repository for the paper "NeuZip: Memory-Efficient Training and Inference with Dynamic Compression of Neural Networks". This rep…☆59Updated 8 months ago
- QuIP quantization☆54Updated last year
- [ACL 2025 Main] EfficientQAT: Efficient Quantization-Aware Training for Large Language Models☆276Updated last month
- Repo for "LoLCATs: On Low-Rank Linearizing of Large Language Models"☆243Updated 5 months ago
- ☆134Updated 10 months ago
- ☆219Updated last year
- Automated Identification of Redundant Layer Blocks for Pruning in Large Language Models☆240Updated last year
- Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.☆198Updated 11 months ago
- GPTQLoRA: Efficient Finetuning of Quantized LLMs with GPTQ☆102Updated 2 years ago
- RWKV-7: Surpassing GPT☆92Updated 7 months ago
- Query-agnostic KV cache eviction: 3–4× reduction in memory and 2× decrease in latency (Qwen3/2.5, Gemma3, LLaMA3)☆91Updated this week
- ☆79Updated 8 months ago
- Training-free Post-training Efficient Sub-quadratic Complexity Attention. Implemented with OpenAI Triton.☆139Updated this week
- Load multiple LoRA modules simultaneously and automatically switch the appropriate combination of LoRA modules to generate the best answe…☆156Updated last year
- Train Llama Loras Easily☆31Updated last year
- An unsupervised model merging algorithm for Transformers-based language models.☆105Updated last year
- Train your own small bitnet model☆74Updated 8 months ago
- A collection of tricks and tools to speed up transformer models☆170Updated last month
- Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.☆31Updated 3 months ago
- A repository aimed at pruning DeepSeek V3, R1 and R1-zero to a usable size☆61Updated 3 months ago
- scalable and robust tree-based speculative decoding algorithm☆349Updated 5 months ago
- Implementation of DoRA☆296Updated last year
- ☆199Updated 7 months ago
- Model REVOLVER, a human in the loop model mixing system.☆33Updated last year
- Genertaes control vectors for use with llama.cpp in GGUF format.☆26Updated 3 months ago
- An efficent implementation of the method proposed in "The Era of 1-bit LLMs"☆154Updated 8 months ago
- PyTorch implementation of Infini-Transformer from "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention…☆290Updated last year
- LongRoPE is a novel method that can extends the context window of pre-trained LLMs to an impressive 2048k tokens.☆232Updated 10 months ago