Alternatives and similar repositories for GPTzip:

Users that are interested in GPTzip are comparing it to the libraries listed below

• chu-tianxiang / QuIP-for-all
  QuIP quantization
  ☆48Updated 10 months ago
• vcskaushik / LLMzip
  ☆46Updated this week
• Cornell-RelaxML / qtip
  ☆99Updated 3 weeks ago
• IsaacRe / vllm-kvcompress
  KV cache compression for high-throughput LLM inference
  ☆103Updated last month
• GreenBitAI / green-bit-llm
  A toolkit for fine-tuning, inferencing, and evaluating GreenBitAI's LLMs.
  ☆78Updated this week
• RobertCsordas / moe_attention
  Official repository for the paper "SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention"
  ☆96Updated 3 months ago
• fangyuan-ksgk / Evolutionary-Model-Merge
  Unofficial Implementation of Evolutionary Model Merging
  ☆33Updated 9 months ago
• Locutusque / TinyMistral-train-eval
  The training notebooks that were similar to the original script used to train TinyMistral.
  ☆19Updated last year
• sramshetty / ShortGPT
  Unofficial implementations of block/layer-wise pruning methods for LLMs.
  ☆58Updated 8 months ago
• OpenGVLab / EfficientQAT
  EfficientQAT: Efficient Quantization-Aware Training for Large Language Models
  ☆237Updated 3 months ago
• whyNLP / LCKV
  Layer-Condensed KV cache w/ 10 times larger batch size, fewer params and less computation. Dramatic speed up with better task performance…
  ☆146Updated last month
• GreenBitAI / low_bit_llama
  Advanced Ultra-Low Bitrate Compression Techniques for the LLaMA Family of LLMs
  ☆110Updated last year
• HanGuo97 / lq-lora
  ☆124Updated 11 months ago
• qwopqwop200 / gptqlora
  GPTQLoRA: Efficient Finetuning of Quantized LLMs with GPTQ
  ☆99Updated last year
• SalesforceAIResearch / GemFilter
  ☆69Updated this week
• hahnyuan / PB-LLM
  PB-LLM: Partially Binarized Large Language Models
  ☆150Updated last year
• NolanoOrg / sparse_quant_llms
  SparseGPT + GPTQ Compression of LLMs like LLaMa, OPT, Pythia
  ☆41Updated last year
• HazyResearch / lolcats
  Repo for "LoLCATs: On Low-Rank Linearizing of Large Language Models"
  ☆203Updated 3 weeks ago
• BorealisAI / neuzip
  Official repository for the paper "NeuZip: Memory-Efficient Training and Inference with Dynamic Compression of Neural Networks". This rep…
  ☆46Updated 2 months ago
• samchaineau / llm_slerp_generation
  Repo hosting codes and materials related to speeding LLMs' inference using token merging.
  ☆34Updated 8 months ago
• nanowell / Q-Sparse-LLM
  My Implementation of Q-Sparse: All Large Language Models can be Fully Sparsely-Activated
  ☆31Updated 5 months ago
• FasterDecoding / TEAL
  ☆107Updated 3 months ago
• ChenMnZ / PrefixQuant
  An algorithm for static activation quantization of LLMs
  ☆107Updated this week
• VITA-Group / Q-GaLore
  Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.
  ☆188Updated 6 months ago
• nyunAI / PruneGPT
  ☆52Updated 7 months ago
• AlpinDale / QuIP-for-Llama
  Code for paper: "QuIP: 2-Bit Quantization of Large Language Models With Guarantees" adapted for Llama models
  ☆36Updated last year
• jy-yuan / KIVI
  [ICML 2024] KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache
  ☆264Updated 3 months ago
• zhuhanqing / APOLLO
  APOLLO: SGD-like Memory, AdamW-level Performance
  ☆82Updated 2 weeks ago
• thepowerfuldeez / OLMo
  My fork os allen AI's OLMo for educational purposes.
  ☆30Updated last month
• hahnyuan / ASVD4LLM
  Activation-aware Singular Value Decomposition for Compressing Large Language Models
  ☆55Updated 2 months ago