Alternatives and similar repositories for TPI-LLM:

Users that are interested in TPI-LLM are comparing it to the libraries listed below

• xhedit / quantkit
  cli tool to quantize gguf, gptq, awq, hqq and exl2 models
  ☆67Updated last month
• microsoft / GRIN-MoE
  GRadient-INformed MoE
  ☆261Updated 4 months ago
• OpenGVLab / EfficientQAT
  EfficientQAT: Efficient Quantization-Aware Training for Large Language Models
  ☆241Updated 3 months ago
• exo-explore / mlx-bitnet
  1.58 Bit LLM on Apple Silicon using MLX
  ☆180Updated 8 months ago
• arcee-ai / PruneMe
  Automated Identification of Redundant Layer Blocks for Pruning in Large Language Models
  ☆212Updated 9 months ago
• VITA-Group / Q-GaLore
  Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.
  ☆190Updated 6 months ago
• SJTU-IPADS / Bamboo
  Bamboo-7B Large Language Model
  ☆89Updated 10 months ago
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆151Updated this week
• tdrussell / qlora-pipe
  A pipeline parallel training script for LLMs.
  ☆121Updated this week
• agiresearch / CoRE
  LLM as Interpreter for Natural Language Programming, Pseudo-code Programming and Flow Programming of AI Agents
  ☆34Updated 6 months ago
• Zyphra / Zamba2
  PyTorch implementation of models from the Zamba2 series.
  ☆173Updated last week
• mzbac / mlx_sharding
  Distributed Inference for mlx LLm
  ☆79Updated 5 months ago
• agokrani / distillKitPlus
  Easy to use, High Performant Knowledge Distillation for LLMs
  ☆40Updated 3 weeks ago
• Infini-AI-Lab / Sequoia
  scalable and robust tree-based speculative decoding algorithm
  ☆331Updated this week
• AlexBodner / How_Much_VRAM
  ☆98Updated 5 months ago
• PrimeIntellect-ai / OpenDiloco
  OpenDiLoCo: An Open-Source Framework for Globally Distributed Low-Communication Training
  ☆426Updated 2 weeks ago
• NVIDIA / Star-Attention
  Efficient LLM Inference over Long Sequences
  ☆349Updated last month
• astramind-ai / BitMat
  An efficent implementation of the method proposed in "The Era of 1-bit LLMs"
  ☆154Updated 3 months ago
• IsaacRe / vllm-kvcompress
  KV cache compression for high-throughput LLM inference
  ☆109Updated last week
• teknium1 / ShareGPT-Builder
  ☆109Updated last month
• fairydreaming / farel-bench
  Testing LLM reasoning abilities with family relationship quizzes.
  ☆57Updated this week
• rafacelente / bllama
  1.58-bit LLaMa model
  ☆80Updated 9 months ago
• microsoft / VPTQ
  VPTQ, A Flexible and Extreme low-bit quantization algorithm
  ☆572Updated last week
• keeeeenw / MicroLlama
  Micro Llama is a small Llama based model with 300M parameters trained from scratch with $500 budget
  ☆140Updated 10 months ago
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆133Updated this week
• SakanaAI / evo-memory
  Code to train and evaluate Neural Attention Memory Models to obtain universally-applicable memory systems for transformers.
  ☆282Updated 3 months ago
• likejazz / llama3.cuda
  llama3.cuda is a pure C/CUDA implementation for Llama 3 model.
  ☆319Updated 7 months ago
• apple / ml-recurrent-drafter
  ☆192Updated last week
• GreenBitAI / green-bit-llm
  A toolkit for fine-tuning, inferencing, and evaluating GreenBitAI's LLMs.
  ☆80Updated last week
• SanshruthR / CCTV_YOLO
  Fast Real-time Object Detection with High-Res Output https://x.com/_akhaliq/status/1840213012818329826
  ☆61Updated 4 months ago