erika-n / GPTzipLinks
An implementation of LLMzip using GPT-2
☆13Updated 2 years ago
Alternatives and similar repositories for GPTzip
Users that are interested in GPTzip are comparing it to the libraries listed below
Sorting:
- ☆156Updated 5 months ago
- QuIP quantization☆61Updated last year
- Official repository for the paper "NeuZip: Memory-Efficient Training and Inference with Dynamic Compression of Neural Networks". This rep…☆60Updated last year
- REAP: Router-weighted Expert Activation Pruning for SMoE compression☆119Updated 3 weeks ago
- ☆37Updated 6 months ago
- ☆63Updated 10 months ago
- Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.☆202Updated last year
- This is the official repository for the paper "Flora: Low-Rank Adapters Are Secretly Gradient Compressors" in ICML 2024.☆105Updated last year
- RWKV-7: Surpassing GPT☆101Updated last year
- GPTQLoRA: Efficient Finetuning of Quantized LLMs with GPTQ☆102Updated 2 years ago
- Lightweight toolkit package to train and fine-tune 1.58bit Language models☆99Updated 6 months ago
- ☆110Updated last week
- Repo for "LoLCATs: On Low-Rank Linearizing of Large Language Models"☆249Updated 10 months ago
- An efficent implementation of the method proposed in "The Era of 1-bit LLMs"☆155Updated last year
- ☆203Updated 11 months ago
- ☆63Updated 5 months ago
- ☆229Updated last year
- Work in progress.☆75Updated 5 months ago
- [ACL 2025 Main] EfficientQAT: Efficient Quantization-Aware Training for Large Language Models☆316Updated this week
- Automated Identification of Redundant Layer Blocks for Pruning in Large Language Models☆257Updated last year
- Train your own small bitnet model☆75Updated last year
- SparseGPT + GPTQ Compression of LLMs like LLaMa, OPT, Pythia☆41Updated 2 years ago
- Implementation of DoRA☆307Updated last year
- Training-free Post-training Efficient Sub-quadratic Complexity Attention. Implemented with OpenAI Triton.☆148Updated 3 weeks ago
- Modeling code for a BitNet b1.58 Llama-style model.☆25Updated last year
- Model REVOLVER, a human in the loop model mixing system.☆33Updated 2 years ago
- Load multiple LoRA modules simultaneously and automatically switch the appropriate combination of LoRA modules to generate the best answe…☆157Updated last year
- Video+code lecture on building nanoGPT from scratch☆68Updated last year
- scalable and robust tree-based speculative decoding algorithm☆363Updated 10 months ago
- flow-merge is a powerful Python library that enables seamless merging of multiple transformer-based language models using the most popula…☆20Updated 9 months ago