Alternatives and similar repositories for BitMat:

Users that are interested in BitMat are comparing it to the libraries listed below

• VITA-Group / Q-GaLore
  Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.
  ☆195Updated 8 months ago
• hahnyuan / PB-LLM
  PB-LLM: Partially Binarized Large Language Models
  ☆151Updated last year
• IST-DASLab / qmoe
  Code for the paper "QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models".
  ☆273Updated last year
• FasterDecoding / BitDelta
  ☆196Updated 4 months ago
• Zyphra / Zamba2
  PyTorch implementation of models from the Zamba2 series.
  ☆179Updated 2 months ago
• Zyphra / tree_attention
  Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters
  ☆125Updated 4 months ago
• rafacelente / bllama
  1.58-bit LLaMa model
  ☆81Updated last year
• Cornell-RelaxML / QuIP
  Code for paper: "QuIP: 2-Bit Quantization of Large Language Models With Guarantees"
  ☆363Updated last year
• arcee-ai / PruneMe
  Automated Identification of Redundant Layer Blocks for Pruning in Large Language Models
  ☆229Updated 11 months ago
• GreenBitAI / green-bit-llm
  A toolkit for fine-tuning, inferencing, and evaluating GreenBitAI's LLMs.
  ☆82Updated last month
• kroggen / mamba.c
  Inference of Mamba models in pure C
  ☆187Updated last year
• HazyResearch / lolcats
  Repo for "LoLCATs: On Low-Rank Linearizing of Large Language Models"
  ☆230Updated 2 months ago
• Cornell-RelaxML / qtip
  ☆119Updated 2 weeks ago
• chu-tianxiang / QuIP-for-all
  QuIP quantization
  ☆52Updated last year
• Infini-AI-Lab / Sequoia
  scalable and robust tree-based speculative decoding algorithm
  ☆341Updated 2 months ago
• HanGuo97 / lq-lora
  ☆125Updated last year
• OpenGVLab / EfficientQAT
  EfficientQAT: Efficient Quantization-Aware Training for Large Language Models
  ☆261Updated 6 months ago
• Digitous / LLM-SLERP-Merge
  Spherical Merge Pytorch/HF format Language Models with minimal feature loss.
  ☆120Updated last year
• dust-tt / llama-ssp
  Experiments on speculative sampling with Llama models
  ☆125Updated last year
• microsoft / TransformerCompression
  For releasing code related to compression methods for transformers, accompanying our publications
  ☆423Updated 2 months ago
• golololologol / LLM-Distillery
  A pipeline for LLM knowledge distillation
  ☆100Updated last week
• SqueezeAILab / KVQuant
  [NeurIPS 2024] KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization
  ☆340Updated 8 months ago
• cognitivecomputations / laserRMT
  This is our own implementation of 'Layer Selective Rank Reduction'
  ☆233Updated 10 months ago
• cognitivecomputations / spectrum
  ☆112Updated this week
• yuhuixu1993 / qa-lora
  Official PyTorch implementation of QA-LoRA
  ☆131Updated last year
• cognitivecomputations / grokadamw
  ☆129Updated 7 months ago
• Cornell-RelaxML / quip-sharp
  ☆530Updated 5 months ago
• abacusai / gh200-llm
  Docker image NVIDIA GH200 machines - optimized for vllm serving and hf trainer finetuning
  ☆38Updated last month
• IBM / ModuleFormer
  ModuleFormer is a MoE-based architecture that includes two different types of experts: stick-breaking attention heads and feedforward exp…
  ☆217Updated last year
• keeeeenw / MicroLlama
  Micro Llama is a small Llama based model with 300M parameters trained from scratch with $500 budget
  ☆146Updated last year