Alternatives and similar repositories for quantization-notes:

Users that are interested in quantization-notes are comparing it to the libraries listed below

• hkproj / triton-flash-attention
  ☆128Updated last month
• rasbt / dora-from-scratch
  LoRA and DoRA from Scratch Implementations
  ☆196Updated 11 months ago
• ThinamXx / Meta-llama
  Complete implementation of Llama2 with/without KV cache & inference 🚀
  ☆47Updated 8 months ago
• Macaronlin / LLaMA3-Quantization
  A repository dedicated to evaluating the performance of quantizied LLaMA3 using various quantization methods..
  ☆178Updated last month
• hkproj / mistral-src-commented
  Reference implementation of Mistral AI 7B v0.1 model.
  ☆28Updated last year
• hkproj / pytorch-lora
  LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch
  ☆94Updated last year
• gpu-mode / profiling-cuda-in-torch
  ☆142Updated last year
• melisa-writer / short-transformers
  Prune transformer layers
  ☆67Updated 8 months ago
• tspeterkim / mixed-precision-from-scratch
  Mixed precision training from scratch with Tensors and CUDA
  ☆21Updated 9 months ago
• huggingface / picotron_tutorial
  ☆135Updated last week
• jiwonsong-dev / SLEB
  Official Implementation of SLEB: Streamlining LLMs through Redundancy Verification and Elimination of Transformer Blocks
  ☆33Updated 2 weeks ago
• rkinas / triton-resources
  A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.
  ☆269Updated this week
• facebookresearch / LayerSkip
  Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", ACL 2024
  ☆272Updated last week
• hahnyuan / PB-LLM
  PB-LLM: Partially Binarized Large Language Models
  ☆151Updated last year
• spcl / QuaRot
  Code for Neurips24 paper: QuaRot, an end-to-end 4-bit inference of large language models.
  ☆342Updated 2 months ago
• GATECH-EIC / ShiftAddLLM
  ShiftAddLLM: Accelerating Pretrained LLMs via Post-Training Multiplication-Less Reparameterization
  ☆102Updated 4 months ago
• hkproj / pytorch-llama-notes
  Notes about LLaMA 2 model
  ☆53Updated last year
• alperiox / Compact-Language-Models-via-Pruning-and-Knowledge-Distillation
  Unofficial implementation of https://arxiv.org/pdf/2407.14679
  ☆42Updated 5 months ago
• mobiusml / gemlite
  Fast low-bit matmul kernels in Triton
  ☆236Updated this week
• mengxiayu / LLMSuperWeight
  Code for studying the super weight in LLM
  ☆80Updated 2 months ago
• ariG23498 / fine-tune-paligemma
  Notebooks for fine tuning pali gemma
  ☆93Updated last month
• samchaineau / llm_slerp_generation
  Repo hosting codes and materials related to speeding LLMs' inference using token merging.
  ☆35Updated 9 months ago
• VITA-Group / Q-GaLore
  Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.
  ☆191Updated 7 months ago
• NVlabs / MaskLLM
  [NeurIPS 24 Spotlight] MaskLLM: Learnable Semi-structured Sparsity for Large Language Models
  ☆150Updated last month
• hkproj / pytorch-transformer-distributed
  Distributed training (multi-node) of a Transformer model
  ☆53Updated 10 months ago
• OpenGVLab / EfficientQAT
  EfficientQAT: Efficient Quantization-Aware Training for Large Language Models
  ☆246Updated 4 months ago
• HanGuo97 / flute
  Fast Matrix Multiplications for Lookup Table-Quantized LLMs
  ☆229Updated this week
• ariG23498 / quantized-diffusion-inference
  Notebook and Scripts that showcase running quantized diffusion models on consumer GPUs
  ☆38Updated 3 months ago