Alternatives and similar repositories for autogguf:

Users that are interested in autogguf are comparing it to the libraries listed below

• austinsilveria / tricksy
  Fast approximate inference on a single GPU with sparsity aware offloading
  ☆38Updated last year
• HabermannR / Fantasy-Tribe-Game
  LLM backed Fantasy Tribe Game
  ☆18Updated 3 months ago
• zarakiquemparte / zaraki-tools
  ☆27Updated last year
• monk1337 / auto-ollama
  run ollama & gguf easily with a single command
  ☆49Updated 9 months ago
• CharlesMod / quantizeHFmodel
  Accepts a Hugging Face model URL, automatically downloads and quantizes it using Bits and Bytes.
  ☆38Updated 11 months ago
• attashe / ModifiedBeamSampler
  Modified Beam Search with periodical restart
  ☆12Updated 5 months ago
• the-crypt-keeper / the-muse
  Experimental sampler to make LLMs more creative
  ☆30Updated last year
• agokrani / distillKitPlus
  Easy to use, High Performant Knowledge Distillation for LLMs
  ☆50Updated last month
• j-webtek / LLM-Learning
  A repository to store helpful information and emerging insights in regard to LLMs
  ☆20Updated last year
• Hellisotherpeople / llm_steer-oobabooga
  Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…
  ☆43Updated 11 months ago
• PuchToTalk / DOOM-MistralAI
  Mistral7B playing DOOM
  ☆28Updated 11 months ago
• jabberjabberjabber / Chunkify
  Create text chunks which end at natural stopping points without using a tokenizer
  ☆26Updated 2 months ago
• remichu-ai / gallamaUI
  ☆21Updated 4 months ago
• LAION-AI / Desktop_BUD-E
  BUD-E (Buddy) is an open-source voice assistant framework that facilitates seamless interaction with AI models and APIs, enabling the cre…
  ☆31Updated 7 months ago
• Gryphe / MergeMonster
  An unsupervised model merging algorithm for Transformers-based language models.
  ☆106Updated 10 months ago
• astramind-ai / Pulsar
  The hearth of The Pulsar App, fast, secure and shared inference with modern UI
  ☆56Updated 3 months ago
• ddh0 / easy-llama
  Text generation in Python, as easy as possible
  ☆54Updated this week
• FishiaT / yawullm
  Yet Another (LLM) Web UI, made with Gemini
  ☆11Updated 2 months ago
• matthewrenze / jhu-concise-cot
  The Benefits of a Concise Chain of Thought on Problem Solving in Large Language Models
  ☆21Updated 3 months ago
• statchamber / ebook-to-chatml-conversion
  idea: https://github.com/nyxkrage/ebook-groupchat/
  ☆86Updated 6 months ago
• EdwardDali / EntropixLab
  entropix style sampling + GUI
  ☆25Updated 4 months ago
• severian42 / Proteus-The-Genesis-LLM
  Proteus is an experimental platform that combines the power of Large Language Models with the Genesis physics engine
  ☆21Updated 2 months ago
• beyondExp / B-Llama3-o
  B-Llama3o a llama3 with Vision Audio and Audio understanding as well as text and Audio and Animation Data output.
  ☆26Updated 9 months ago
• bjj / exllamav2-openai-server
  An OpenAI API compatible LLM inference server based on ExLlamaV2.
  ☆25Updated last year
• FishiaT / Tumera
  Yet another frontend for LLM, written using .NET and WinUI 3
  ☆10Updated 3 months ago
• sammcj / ollama-artefacts
  Build HTML artefacts with Ollama
  ☆11Updated 2 months ago
• fairydreaming / farel-bench
  Testing LLM reasoning abilities with family relationship quizzes.
  ☆60Updated last month
• mounta11n / plusplus-camall
  After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around…
  ☆56Updated 6 months ago
• cognitivecomputations / kraken
  ☆65Updated 9 months ago