Alternatives and similar repositories for UMbreLLa:

Users that are interested in UMbreLLa are comparing it to the libraries listed below

• Cornell-RelaxML / qtip
  ☆100Updated last month
• VITA-Group / Q-GaLore
  Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.
  ☆190Updated 6 months ago
• IsaacRe / vllm-kvcompress
  KV cache compression for high-throughput LLM inference
  ☆109Updated this week
• efeslab / fiddler
  [ICLR'25] Fast Inference of MoE Models with CPU-GPU Orchestration
  ☆180Updated 2 months ago
• BlinkDL / modded-nanogpt-rwkv
  RWKV-7: Surpassing GPT
  ☆73Updated 2 months ago
• Zyphra / tree_attention
  Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters
  ☆113Updated last month
• Mihaiii / backtrack_sampler
  An easy-to-understand framework for LLM samplers that rewind and revise generated tokens
  ☆120Updated this week
• neuralmagic / compressed-tensors
  A safetensors extension to efficiently store sparse quantized tensors on disk
  ☆66Updated this week
• keeeeenw / MicroLlama
  Micro Llama is a small Llama based model with 300M parameters trained from scratch with $500 budget
  ☆140Updated 10 months ago
• arcee-ai / PruneMe
  Automated Identification of Redundant Layer Blocks for Pruning in Large Language Models
  ☆212Updated 9 months ago
• cognitivecomputations / grokadamw
  ☆122Updated 5 months ago
• sebulo / LoQT
  ☆79Updated 2 months ago
• HanGuo97 / flute
  Fast Matrix Multiplications for Lookup Table-Quantized LLMs
  ☆221Updated last week
• GreenBitAI / green-bit-llm
  A toolkit for fine-tuning, inferencing, and evaluating GreenBitAI's LLMs.
  ☆80Updated last week
• OpenGVLab / EfficientQAT
  EfficientQAT: Efficient Quantization-Aware Training for Large Language Models
  ☆241Updated 3 months ago
• apple / ml-recurrent-drafter
  ☆192Updated last week
• fairydreaming / farel-bench
  Testing LLM reasoning abilities with family relationship quizzes.
  ☆57Updated this week
• yandex-research / specexec
  ☆48Updated 2 months ago
• rafacelente / bllama
  1.58-bit LLaMa model
  ☆80Updated 9 months ago
• astramind-ai / BitMat
  An efficent implementation of the method proposed in "The Era of 1-bit LLMs"
  ☆154Updated 3 months ago
• LostRuins / datasetexplorer
  Easily view and modify JSON datasets for large language models
  ☆69Updated 3 months ago
• Zyphra / Zamba2
  PyTorch implementation of models from the Zamba2 series.
  ☆173Updated last week
• cognitivecomputations / spectrum
  ☆110Updated 4 months ago
• FasterDecoding / BitDelta
  ☆192Updated last month
• kroggen / mamba.c
  Inference of Mamba models in pure C
  ☆183Updated 11 months ago
• tdrussell / qlora-pipe
  A pipeline parallel training script for LLMs.
  ☆121Updated this week
• HazyResearch / lolcats
  Repo for "LoLCATs: On Low-Rank Linearizing of Large Language Models"
  ☆205Updated last month
• willccbb / mlx_parallm
  Fast parallel LLM inference for MLX
  ☆153Updated 6 months ago
• Infini-AI-Lab / MagicPIG
  [ICLR2025] MagicPIG: LSH Sampling for Efficient LLM Generation
  ☆181Updated last month