erika-n / GPTzipLinks
An implementation of LLMzip using GPT-2
☆13Updated 2 years ago
Alternatives and similar repositories for GPTzip
Users that are interested in GPTzip are comparing it to the libraries listed below
Sorting:
- QuIP quantization☆58Updated last year
- GPTQLoRA: Efficient Finetuning of Quantized LLMs with GPTQ☆103Updated 2 years ago
- [ACL 2025 Main] EfficientQAT: Efficient Quantization-Aware Training for Large Language Models☆298Updated 3 months ago
- Repo for "LoLCATs: On Low-Rank Linearizing of Large Language Models"☆245Updated 7 months ago
- ☆60Updated 7 months ago
- ☆149Updated 2 months ago
- Training-free Post-training Efficient Sub-quadratic Complexity Attention. Implemented with OpenAI Triton.☆145Updated last week
- SparseGPT + GPTQ Compression of LLMs like LLaMa, OPT, Pythia☆41Updated 2 years ago
- Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.☆200Updated last year
- Automated Identification of Redundant Layer Blocks for Pruning in Large Language Models☆247Updated last year
- PB-LLM: Partially Binarized Large Language Models☆153Updated last year
- The training notebooks that were similar to the original script used to train TinyMistral.☆22Updated last year
- Model REVOLVER, a human in the loop model mixing system.☆33Updated 2 years ago
- Train your own small bitnet model☆75Updated 10 months ago
- Query-agnostic KV cache eviction: 3–4× reduction in memory and 2× decrease in latency (Qwen3/2.5, Gemma3, LLaMA3)☆100Updated last week
- Official repository for the paper "NeuZip: Memory-Efficient Training and Inference with Dynamic Compression of Neural Networks". This rep…☆59Updated 10 months ago
- ☆202Updated 9 months ago
- Modeling code for a BitNet b1.58 Llama-style model.☆25Updated last year
- Code for paper: "QuIP: 2-Bit Quantization of Large Language Models With Guarantees" adapted for Llama models☆39Updated 2 years ago
- Load multiple LoRA modules simultaneously and automatically switch the appropriate combination of LoRA modules to generate the best answe…☆158Updated last year
- Implementation of DoRA☆301Updated last year
- ☆134Updated last year
- The simplest, fastest repository for training/finetuning medium-sized xLSTMs.☆41Updated last year
- Work in progress.☆72Updated 2 months ago
- ☆89Updated last week
- PyTorch implementation of Infini-Transformer from "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention…☆291Updated last year
- ☆80Updated 9 months ago
- Code for the paper "SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot" with LLaMA implementation.☆71Updated 2 years ago
- A pipeline parallel training script for LLMs.☆157Updated 4 months ago
- An efficent implementation of the method proposed in "The Era of 1-bit LLMs"☆155Updated 10 months ago