Alternatives and similar repositories for pygguf:

Users that are interested in pygguf are comparing it to the libraries listed below

• KerfuffleV2 / gguf-tools
  Some random tools for working with the GGUF file format
  ☆25Updated last year
• BlinkDL / modded-nanogpt-rwkv
  RWKV-7: Surpassing GPT
  ☆79Updated 3 months ago
• IST-DASLab / SparseFinetuning
  Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry
  ☆40Updated last year
• AlpinDale / QuIP-for-Llama
  Code for paper: "QuIP: 2-Bit Quantization of Large Language Models With Guarantees" adapted for Llama models
  ☆36Updated last year
• catid / bitnet_cpu
  Experiments with BitNet inference on CPU
  ☆53Updated 10 months ago
• IST-DASLab / QIGen
  Repository for CPU Kernel Generation for LLM Inference
  ☆25Updated last year
• sekstini / basedxl
  ☆16Updated 11 months ago
• BlinkDL / nanoRWKV
  RWKV in nanoGPT style
  ☆187Updated 8 months ago
• abetlen / ggml-python
  Python bindings for ggml
  ☆137Updated 5 months ago
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆63Updated last year
• nisten / grokadamw
  new optimizer
  ☆19Updated 6 months ago
• neuralmagic / compressed-tensors
  A safetensors extension to efficiently store sparse quantized tensors on disk
  ☆77Updated this week
• nyunAI / PruneGPT
  ☆53Updated 8 months ago
• chu-tianxiang / QuIP-for-all
  QuIP quantization
  ☆50Updated 11 months ago
• wozeparrot / tinyrwkv
  tinygrad port of the RWKV large language model.
  ☆44Updated 8 months ago
• iamlemec / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆53Updated last year
• IST-DASLab / Sparse-Marlin
  Boosting 4-bit inference kernels with 2:4 Sparsity
  ☆64Updated 5 months ago
• casper-hansen / AutoAWQ_kernels
  ☆65Updated 2 months ago
• euclaise / supertrainer2000
  ☆49Updated 11 months ago
• arcee-ai / DAM
  ☆48Updated 3 months ago
• nanowell / Q-Sparse-LLM
  My Implementation of Q-Sparse: All Large Language Models can be Fully Sparsely-Activated
  ☆31Updated 6 months ago
• zhuzilin / faster-nougat
  Implementation of nougat that focuses on processing pdf locally.
  ☆79Updated last month
• ChrisHayduk / qlora-multi-gpu
  QLoRA with Enhanced Multi GPU Support
  ☆36Updated last year
• lianakoleva / no-libtorch-compile
  ☆21Updated 3 months ago
• golololologol / LLM-Distillery
  A pipeline for LLM knowledge distillation
  ☆91Updated 3 weeks ago
• malaysia-ai / transformers-openai-api
  Lightweight continuous batching OpenAI compatibility using HuggingFace Transformers include T5 and Whisper.
  ☆20Updated this week
• NolanoOrg / SpectraSuite
  ☆44Updated 7 months ago
• wejoncy / QLLM
  A general 2-8 bits quantization toolbox with GPTQ/AWQ/HQQ/VPTQ, and export to onnx/onnx-runtime easily.
  ☆159Updated last week