Alternatives and similar repositories for gguf-tools:

Users that are interested in gguf-tools are comparing it to the libraries listed below

• monk1337 / auto-ollama
  run ollama & gguf easily with a single command
  ☆49Updated 9 months ago
• 99991 / pygguf
  GGUF parser in Python
  ☆26Updated 6 months ago
• mounta11n / plusplus-camall
  After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around…
  ☆56Updated 6 months ago
• rombodawg / Easy_training
  ☆45Updated this week
• HabermannR / Fantasy-Tribe-Game
  LLM backed Fantasy Tribe Game
  ☆18Updated 3 months ago
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆154Updated this week
• Gryphe / MergeMonster
  An unsupervised model merging algorithm for Transformers-based language models.
  ☆105Updated 9 months ago
• the-crypt-keeper / the-muse
  Experimental sampler to make LLMs more creative
  ☆30Updated last year
• LostRuins / datasetexplorer
  Easily view and modify JSON datasets for large language models
  ☆71Updated last week
• Digitous / ModelREVOLVER
  Model REVOLVER, a human in the loop model mixing system.
  ☆33Updated last year
• SicariusSicariiStuff / SLOP_Detector
  SLOP Detector and analyzer based on dictionary for shareGPT JSON and text
  ☆61Updated 3 months ago
• CharlesMod / quantizeHFmodel
  Accepts a Hugging Face model URL, automatically downloads and quantizes it using Bits and Bytes.
  ☆38Updated 11 months ago
• rafacelente / bllama
  1.58-bit LLaMa model
  ☆82Updated 10 months ago
• LAION-AI / Desktop_BUD-E
  BUD-E (Buddy) is an open-source voice assistant framework that facilitates seamless interaction with AI models and APIs, enabling the cre…
  ☆31Updated 7 months ago
• theroyallab / llm-prompt-templates
  Prompt Jinja2 templates for LLMs
  ☆29Updated last month
• brittlewis12 / autogguf
  Easily convert HuggingFace models to GGUF-format for llama.cpp
  ☆21Updated 6 months ago
• shinomakoi / magi_llm_gui
  A Qt GUI for large language models
  ☆41Updated last year
• AlpinDale / sparsegpt-for-LLaMA
  Code for the paper "SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot" with LLaMA implementation.
  ☆71Updated last year
• zarakiquemparte / zaraki-tools
  ☆27Updated last year
• cognitivecomputations / kraken
  ☆65Updated 8 months ago
• EdwardDali / EntropixLab
  entropix style sampling + GUI
  ☆25Updated 3 months ago
• VatsaDev / NanoPhi-alpha
  GPT-2 small trained on phi-like data
  ☆65Updated last year
• Ce-daros / Tinystory-LM-656K-param
  ☆16Updated 8 months ago
• PuchToTalk / DOOM-MistralAI
  Mistral7B playing DOOM
  ☆28Updated 10 months ago
• MichaelMcCulloch / WikiDex
  ☆30Updated 9 months ago
• chigkim / Ollama-MMLU-Pro
  ☆77Updated last month
• statchamber / ebook-to-chatml-conversion
  idea: https://github.com/nyxkrage/ebook-groupchat/
  ☆85Updated 6 months ago
• jabberjabberjabber / Chunkify
  Create text chunks which end at natural stopping points without using a tokenizer
  ☆26Updated 2 months ago
• p-e-w / chatbot_clinic
  Science-driven chatbot development
  ☆56Updated 9 months ago
• Nero10578 / LLM-Inference-Benchmark
  ☆14Updated 5 months ago