Alternatives and similar repositories for ggml-downloader

Users that are interested in ggml-downloader are comparing it to the libraries listed below

• nydasco / jen-ai
  A simple speech-to-text and text-to-speech AI chatbot that can be run fully offline.
  ☆46Updated last year
• the-crypt-keeper / the-muse
  Experimental sampler to make LLMs more creative
  ☆31Updated 2 years ago
• bjj / exllamav2-openai-server
  An OpenAI API compatible LLM inference server based on ExLlamaV2.
  ☆25Updated last year
• VatsaDev / NanoPhi-alpha
  GPT-2 small trained on phi-like data
  ☆67Updated last year
• shinomakoi / magi_llm_gui
  A Qt GUI for large language models
  ☆45Updated 2 years ago
• LLukas22 / llm-rs-python
  Unofficial python bindings for the rust llm library. 🐍❤️🦀
  ☆76Updated 2 years ago
• nicholasyager / llama-cpp-guidance
  A guidance compatibility layer for llama-cpp-python
  ☆36Updated 2 years ago
• Maximilian-Winter / llama_cpp_function_calling
  ☆32Updated 2 years ago
• desik1998 / MathWithLLMs
  ☆50Updated last year
• spyglass-search / talos
  Easily create LLM automation/agent workflows
  ☆60Updated last year
• mzbac / AutoGPTQ-API
  Host the GPTQ model using AutoGPTQ as an API that is compatible with text generation UI API.
  ☆90Updated 2 years ago
• monk1337 / auto-ollama
  run ollama & gguf easily with a single command
  ☆52Updated last year
• jquesnelle / literAI
  Generate visual podcasts about novels using open source models
  ☆25Updated 2 years ago
• ahoylabs / gguf.js
  A Javascript library (with Typescript types) to parse metadata of GGML based GGUF files.
  ☆51Updated last year
• OpenAccess-AI-Collective / ggml-webui
  Deploy your GGML models to HuggingFace Spaces with Docker and gradio
  ☆38Updated 2 years ago
• emrgnt-cmplxty / zero-shot-replication
  ☆74Updated 2 years ago
• thooton / muse
  Let's create synthetic textbooks together :)
  ☆75Updated last year
• teleprint-me / py.gpt.prompt
  PyGPTPrompt: A CLI tool that manages context windows for AI models, facilitating user interaction and data ingestion for optimized long-t…
  ☆30Updated last year
• OpenAccess-AI-Collective / servereless-runpod-ggml
  ☆54Updated 2 years ago
• Aesthisia / LLMinator
  Gradio based tool to run opensource LLM models directly from Huggingface
  ☆96Updated last year
• fishiatee / yawullm
  Yet Another (LLM) Web UI, made with Gemini
  ☆12Updated last year
• mgerstgrasser / tacheles
  a lightweight, open-source blueprint for building powerful and scalable LLM chat applications
  ☆28Updated last year
• taprosoft / llm_finetuning
  Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…
  ☆146Updated 2 years ago
• the-crypt-keeper / LLooM
  Experimental LLM Inference UX to aid in creative writing
  ☆127Updated last year
• jabberjabberjabber / Chunkify
  Create text chunks which end at natural stopping points without using a tokenizer
  ☆26Updated last month
• eugenepentland / landmark-attention-qlora
  Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA
  ☆124Updated 2 years ago
• ddh0 / easy-llama
  Python package wrapping llama.cpp for on-device LLM inference
  ☆97Updated 2 months ago
• michaelfeil / embed
  A stable, fast and easy-to-use inference library with a focus on a sync-to-async API
  ☆47Updated last year
• silphendio / sliced_llama
  Simple LLM inference server
  ☆20Updated last year
• the-crypt-keeper / tiny_starcoder
  Python examples using the bigcode/tiny_starcoder_py 159M model to generate code
  ☆45Updated 2 years ago