Alternatives and similar repositories for gguf-tools

Users that are interested in gguf-tools are comparing it to the libraries listed below

• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆219Updated last month
• LostRuins / datasetexplorer
  Easily view and modify JSON datasets for large language models
  ☆86Updated 8 months ago
• monk1337 / auto-ollama
  run ollama & gguf easily with a single command
  ☆52Updated last year
• rombodawg / Easy_training
  ☆51Updated 11 months ago
• SicariusSicariiStuff / SLOP_Detector
  SLOP Detector and analyzer based on dictionary for shareGPT JSON and text
  ☆80Updated last month
• Gryphe / MergeMonster
  An unsupervised model merging algorithm for Transformers-based language models.
  ☆108Updated last year
• jllllll / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆64Updated 2 years ago
• kevkid / gguf_gui
  ☆128Updated last year
• chigkim / Ollama-MMLU-Pro
  ☆109Updated 5 months ago
• pranavjad / tinyllama-bitnet
  Train your own small bitnet model
  ☆77Updated last year
• ddh0 / easy-llama
  Python package wrapping llama.cpp for on-device LLM inference
  ☆100Updated 3 months ago
• Aincvy / vscode-fauxpilot
  ☆24Updated last year
• theroyallab / YALS
  ☆90Updated last month
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆188Updated last year
• thomasgauthier / LoRD
  Low-Rank adapter extraction for fine-tuned transformers models
  ☆180Updated last year
• eugenepentland / landmark-attention-qlora
  Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA
  ☆124Updated 2 years ago
• mounta11n / plusplus-camall
  After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around…
  ☆53Updated last year
• jukofyork / control-vectors
  Genertaes control vectors for use with llama.cpp in GGUF format.
  ☆36Updated 10 months ago
• matt-c1 / llama-3-quant-comparison
  Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.
  ☆165Updated last year
• RandomInternetPreson / Lucid_Vision
  This extension enhances the capabilities of textgen-webui by integrating advanced vision models, allowing users to have contextualized co…
  ☆57Updated last year
• tdrussell / qlora-pipe
  A pipeline parallel training script for LLMs.
  ☆166Updated 9 months ago
• Digitous / ModelREVOLVER
  Model REVOLVER, a human in the loop model mixing system.
  ☆33Updated 2 years ago
• sam-paech / antislop-sampler
  ☆336Updated 6 months ago
• HabermannR / Fantasy-Tribe-Game
  LLM backed Fantasy Tribe Game
  ☆19Updated last year
• rafacelente / bllama
  1.58-bit LLaMa model
  ☆83Updated last year
• 99991 / pygguf
  GGUF parser in Python
  ☆28Updated last year
• p-e-w / chatbot_clinic
  Science-driven chatbot development
  ☆61Updated last year
• abgulati / hf-waitress
  Serving LLMs in the HF-Transformers format via a PyFlask API
  ☆72Updated last year
• danikhan632 / guidance_api
  An Extension for oobabooga/text-generation-webui
  ☆36Updated 2 years ago
• theroyallab / llm-prompt-templates
  Prompt Jinja2 templates for LLMs
  ☆35Updated 6 months ago