Alternatives and similar repositories for ggml-downloader

Users that are interested in ggml-downloader are comparing it to the libraries listed below

• spyglass-search / talos
  Easily create LLM automation/agent workflows
  ☆60Updated last year
• elgatopanzon / gatogpt
  Local LLM inference & management server with built-in OpenAI API
  ☆31Updated last year
• shinomakoi / magi_llm_gui
  A Qt GUI for large language models
  ☆44Updated 2 years ago
• the-crypt-keeper / the-muse
  Experimental sampler to make LLMs more creative
  ☆31Updated 2 years ago
• monk1337 / auto-ollama
  run ollama & gguf easily with a single command
  ☆52Updated last year
• Maximilian-Winter / llama_cpp_function_calling
  ☆31Updated last year
• nydasco / jen-ai
  A simple speech-to-text and text-to-speech AI chatbot that can be run fully offline.
  ☆46Updated last year
• the-crypt-keeper / LLooM
  Experimental LLM Inference UX to aid in creative writing
  ☆125Updated 11 months ago
• VatsaDev / NanoPhi-alpha
  GPT-2 small trained on phi-like data
  ☆67Updated last year
• teleprint-me / py.gpt.prompt
  PyGPTPrompt: A CLI tool that manages context windows for AI models, facilitating user interaction and data ingestion for optimized long-t…
  ☆30Updated last year
• Itachi-Uchiha581 / Auto-Data
  Auto Data is a library designed for quick and effortless creation of datasets tailored for fine-tuning Large Language Models (LLMs).
  ☆102Updated last year
• bjj / exllamav2-openai-server
  An OpenAI API compatible LLM inference server based on ExLlamaV2.
  ☆25Updated last year
• OpenAccess-AI-Collective / servereless-runpod-ggml
  ☆53Updated 2 years ago
• noco-ai / spellbook-ui
  ☆16Updated last year
• jllllll / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆63Updated 2 years ago
• the-crypt-keeper / tiny_starcoder
  Python examples using the bigcode/tiny_starcoder_py 159M model to generate code
  ☆45Updated 2 years ago
• mzbac / AutoGPTQ-API
  Host the GPTQ model using AutoGPTQ as an API that is compatible with text generation UI API.
  ☆90Updated 2 years ago
• andrewginns / CoT-at-Home
  Who needs o1 anyways. Add CoT to any OpenAI compatible endpoint.
  ☆44Updated last year
• desik1998 / MathWithLLMs
  ☆49Updated last year
• j-webtek / LLM-Learning
  A repository to store helpful information and emerging insights in regard to LLMs
  ☆21Updated 2 years ago
• OpenAccess-AI-Collective / ggml-webui
  Deploy your GGML models to HuggingFace Spaces with Docker and gradio
  ☆38Updated 2 years ago
• multiplexerai / mplx_rag
  Complex RAG backend
  ☆29Updated last year
• shinomakoi / AI-Messenger
  A QT GUI for large language models
  ☆38Updated last year
• OoriData / OgbujiPT
  Client-side toolkit for using large language models, including where self-hosted
  ☆113Updated 2 weeks ago
• nicholasyager / llama-cpp-guidance
  A guidance compatibility layer for llama-cpp-python
  ☆36Updated 2 years ago
• rodrigobaron / anthill
  ☆24Updated 10 months ago
• FishiaTee / yawullm
  Yet Another (LLM) Web UI, made with Gemini
  ☆12Updated 10 months ago
• desik1998 / NovelWithLLMs
  ☆24Updated last year
• LLukas22 / llm-rs-python
  Unofficial python bindings for the rust llm library. 🐍❤️🦀
  ☆76Updated 2 years ago
• Fus3n / TwoAI
  A simple experiment on letting two local LLM have a conversation about anything!
  ☆111Updated last year