Alternatives and similar repositories for llama.cpp-helper:

Users that are interested in llama.cpp-helper are comparing it to the libraries listed below

• ChobPT / oobaboogas-webui-langchain_agent
  Creates an Langchain Agent which uses the WebUI's API and Wikipedia to work
  ☆74Updated last year
• danikhan632 / guidance_api
  An Extension for oobabooga/text-generation-webui
  ☆36Updated last year
• monk1337 / auto-ollama
  run ollama & gguf easily with a single command
  ☆49Updated 9 months ago
• the-crypt-keeper / the-muse
  Experimental sampler to make LLMs more creative
  ☆30Updated last year
• HabermannR / Fantasy-Tribe-Game
  LLM backed Fantasy Tribe Game
  ☆18Updated 3 months ago
• shinomakoi / magi_llm_gui
  A Qt GUI for large language models
  ☆42Updated last year
• thooton / muse
  Let's create synthetic textbooks together :)
  ☆73Updated last year
• jryebread / LLMBenchMark
  Like system requirements lab but for LLMs
  ☆31Updated last year
• CharlesMod / quantizeHFmodel
  Accepts a Hugging Face model URL, automatically downloads and quantizes it using Bits and Bytes.
  ☆38Updated last year
• rodrigobaron / anthill
  ☆24Updated last month
• MichaelMcCulloch / WikiDex
  ☆30Updated 10 months ago
• perk11 / large-model-proxy
  Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…
  ☆53Updated 2 weeks ago
• Maximilian-Winter / llama_cpp_function_calling
  ☆31Updated last year
• RandomInternetPreson / Lucid_Vision
  This extension enhances the capabilities of textgen-webui by integrating advanced vision models, allowing users to have contextualized co…
  ☆53Updated 4 months ago
• mounta11n / plusplus-camall
  After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around…
  ☆56Updated 6 months ago
• LAION-AI / Desktop_BUD-E
  BUD-E (Buddy) is an open-source voice assistant framework that facilitates seamless interaction with AI models and APIs, enabling the cre…
  ☆32Updated 7 months ago
• SicariusSicariiStuff / SLOP_Detector
  SLOP Detector and analyzer based on dictionary for shareGPT JSON and text
  ☆63Updated 4 months ago
• ragnarkar / reddit_imitator
  ☆16Updated last year
• 7ozzam / cohere-toolkit-with-openai
  Cohere Toolkit is a collection of prebuilt components enabling users to quickly build and deploy RAG applications.
  ☆26Updated last month
• Hellisotherpeople / llm_steer-oobabooga
  Steer LLM outputs towards a certain topic/subject and enhance response capabilities using activation engineering by adding steering vecto…
  ☆43Updated 11 months ago
• the-crypt-keeper / LLooM
  Experimental LLM Inference UX to aid in creative writing
  ☆112Updated 3 months ago
• eugenepentland / landmark-attention-qlora
  Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA
  ☆123Updated last year
• ddh0 / easy-llama
  Text generation in Python, as easy as possible
  ☆55Updated last week
• 0xrushi / Terminal-Voice-Assistant
  Terminal Voice Assistant is a powerful and flexible tool designed to help users interact with their terminal using natural language comma…
  ☆17Updated 9 months ago
• Fus3n / TwoAI
  A simple experiment on letting two local LLM have a conversation about anything!
  ☆106Updated 8 months ago
• serp-ai / unsloth
  5X faster 60% less memory QLoRA finetuning
  ☆21Updated 9 months ago
• YenRaven / annoy_ltm
  annoy long term memory experiment for oobabooga/text-generation-webui
  ☆31Updated last year
• jllllll / GPTQ-for-LLaMa-CUDA
  A combination of Oobabooga's fork and the main cuda branch of GPTQ-for-LLaMa in a package format.
  ☆22Updated last year
• p-e-w / arrows
  A frontend for creative writing with LLMs
  ☆121Updated 7 months ago