Alternatives and similar repositories for pygguf:

Users that are interested in pygguf are comparing it to the libraries listed below

• chu-tianxiang / QuIP-for-all
  QuIP quantization
  ☆52Updated last year
• catid / bitnet_cpu
  Experiments with BitNet inference on CPU
  ☆53Updated 11 months ago
• abetlen / ggml-python
  Python bindings for ggml
  ☆140Updated 6 months ago
• IST-DASLab / SparseFinetuning
  Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry
  ☆40Updated last year
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆63Updated last year
• BlinkDL / modded-nanogpt-rwkv
  RWKV-7: Surpassing GPT
  ☆82Updated 4 months ago
• mag- / gpu_benchmark
  Gpu benchmark
  ☆57Updated 2 months ago
• KerfuffleV2 / gguf-tools
  Some random tools for working with the GGUF file format
  ☆25Updated last year
• GreenBitAI / green-bit-llm
  A toolkit for fine-tuning, inferencing, and evaluating GreenBitAI's LLMs.
  ☆79Updated 2 weeks ago
• euclaise / supertrainer2000
  ☆49Updated last year
• nyunAI / PruneGPT
  ☆53Updated 9 months ago
• lianakoleva / no-libtorch-compile
  ☆21Updated 3 weeks ago
• cahya-wirawan / rwkv-tokenizer
  A fast RWKV Tokenizer written in Rust
  ☆44Updated last week
• BlinkDL / nanoRWKV
  RWKV in nanoGPT style
  ☆187Updated 9 months ago
• casper-hansen / AutoAWQ_kernels
  ☆69Updated 4 months ago
• kroggen / mamba.c
  Inference of Mamba models in pure C
  ☆186Updated last year
• GreenBitAI / low_bit_llama
  Advanced Ultra-Low Bitrate Compression Techniques for the LLaMA Family of LLMs
  ☆111Updated last year
• IST-DASLab / Sparse-Marlin
  Boosting 4-bit inference kernels with 2:4 Sparsity
  ☆71Updated 6 months ago
• UmerHA / triton_util
  Make triton easier
  ☆47Updated 9 months ago
• huggingface / kernels
  Load compute kernels from the Hub
  ☆99Updated this week
• Cornell-RelaxML / qtip
  ☆112Updated this week
• NolanoOrg / SpectraSuite
  ☆46Updated 8 months ago
• neuralmagic / compressed-tensors
  A safetensors extension to efficiently store sparse quantized tensors on disk
  ☆91Updated this week
• wangitu / Ada-Instruct
  ☆17Updated 11 months ago
• jaymody / speculative-sampling
  Simple implementation of Speculative Sampling in NumPy for GPT-2.
  ☆92Updated last year
• IST-DASLab / QIGen
  Repository for CPU Kernel Generation for LLM Inference
  ☆25Updated last year
• gau-nernst / quantized-training
  Explore training for quantized models
  ☆17Updated 2 months ago
• pytorch-labs / tritonbench
  Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.
  ☆104Updated this week
• astramind-ai / BitMat
  An efficent implementation of the method proposed in "The Era of 1-bit LLMs"
  ☆154Updated 5 months ago
• qwopqwop200 / gptqlora
  GPTQLoRA: Efficient Finetuning of Quantized LLMs with GPTQ
  ☆99Updated last year