Alternatives and similar repositories for autogguf

Users that are interested in autogguf are comparing it to the libraries listed below

• jukofyork / transplant-vocab
  Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.
  ☆31Updated 2 months ago
• zarakiquemparte / zaraki-tools
  ☆27Updated last year
• monk1337 / auto-ollama
  run ollama & gguf easily with a single command
  ☆51Updated last year
• Gryphe / MergeMonster
  An unsupervised model merging algorithm for Transformers-based language models.
  ☆105Updated last year
• the-crypt-keeper / the-muse
  Experimental sampler to make LLMs more creative
  ☆31Updated last year
• FishiaTee / yawullm
  Yet Another (LLM) Web UI, made with Gemini
  ☆12Updated 6 months ago
• zenforic / csm-multi
  Adding a multi-text multi-speaker script (diffe) that is based on a script from asiff00 on issue 61 for Sesame: A Conversational Speech G…
  ☆23Updated 3 months ago
• beyondExp / B-Llama3-o
  B-Llama3o a llama3 with Vision Audio and Audio understanding as well as text and Audio and Animation Data output.
  ☆26Updated last year
• CharlesMod / quantizeHFmodel
  Accepts a Hugging Face model URL, automatically downloads and quantizes it using Bits and Bytes.
  ☆38Updated last year
• bjj / exllamav2-openai-server
  An OpenAI API compatible LLM inference server based on ExLlamaV2.
  ☆25Updated last year
• agokrani / distillKitPlus
  Easy to use, High Performant Knowledge Distillation for LLMs
  ☆86Updated last month
• LAION-AI / Desktop_BUD-E
  BUD-E (Buddy) is an open-source voice assistant framework that facilitates seamless interaction with AI models and APIs, enabling the cre…
  ☆36Updated 11 months ago
• ddh0 / easy-llama
  Python package wrapping llama.cpp for on-device LLM inference
  ☆72Updated this week
• slashml / awesome-finetuning
  ☆28Updated 10 months ago
• Codys12 / airllm
  AirLLM 70B inference with single 4GB GPU
  ☆14Updated this week
• nyunAI / PruneGPT
  ☆53Updated last year
• LAION-AI / Desktop-BUD-E_V1.0
  BUD-E (Buddy) is an open-source voice assistant framework that facilitates seamless interaction with AI models and APIs, enabling the cre…
  ☆20Updated 8 months ago
• Aesthisia / LLMinator
  Gradio based tool to run opensource LLM models directly from Huggingface
  ☆93Updated last year
• teknium1 / ShareGPT-Builder
  ☆115Updated 6 months ago
• mounta11n / plusplus-camall
  After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around…
  ☆54Updated 10 months ago
• Hellisotherpeople / llm_steer-oobabooga
  Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…
  ☆43Updated last year
• austinsilveria / tricksy
  Fast approximate inference on a single GPU with sparsity aware offloading
  ☆38Updated last year
• Ce-daros / Tinystory-LM-656K-param
  ☆18Updated last year
• rodrigobaron / anthill
  ☆24Updated 5 months ago
• fidecastro / llama-cpp-connector
  Super simple python connectors for llama.cpp, including vision models (Gemma 3, Qwen2-VL). Compile llama.cpp and run!
  ☆25Updated last month
• remichu-ai / gallamaUI
  ☆23Updated 8 months ago
• stringandstickytape / MaxsAiStudio
  A Windows tool to query various LLM AIs. Supports branched conversations, history and summaries among others.
  ☆31Updated this week
• keeeeenw / TinyLlama
  The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.
  ☆11Updated last year
• fairydreaming / farel-bench
  Testing LLM reasoning abilities with family relationship quizzes.
  ☆62Updated 5 months ago
• kyegomez / OpenStrawberry
  An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO
  ☆29Updated this week