Alternatives and similar repositories for servereless-runpod-ggml:

Users that are interested in servereless-runpod-ggml are comparing it to the libraries listed below

• hommayushi3 / exllama-runpod-serverless
  ☆52Updated last year
• ashleykleynhans / runpod-worker-oobabooga
  RunPod Serverless Worker for Oobabooga Text Generation API for LLMs
  ☆2Updated 11 months ago
• the-crypt-keeper / the-muse
  Experimental sampler to make LLMs more creative
  ☆31Updated last year
• OpenAccess-AI-Collective / ggml-webui
  Deploy your GGML models to HuggingFace Spaces with Docker and gradio
  ☆36Updated last year
• ChobPT / oobaboogas-webui-langchain_agent
  Creates an Langchain Agent which uses the WebUI's API and Wikipedia to work
  ☆74Updated last year
• danikhan632 / guidance_api
  An Extension for oobabooga/text-generation-webui
  ☆36Updated last year
• Digitous / ModelREVOLVER
  Model REVOLVER, a human in the loop model mixing system.
  ☆33Updated last year
• spyglass-search / talos
  Easily create LLM automation/agent workflows
  ☆59Updated last year
• Urist-Mc-Urist / DoppeLLaMA
  Discord chatbot interface to train an LLM on user message history
  ☆27Updated last year
• teleprint-me / py.gpt.prompt
  PyGPTPrompt: A CLI tool that manages context windows for AI models, facilitating user interaction and data ingestion for optimized long-t…
  ☆29Updated 11 months ago
• eugenepentland / landmark-attention-qlora
  Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA
  ☆123Updated last year
• adrienbrault / ollama-nous-hermes2pro
  Ollama models of NousResearch/Hermes-2-Pro-Mistral-7B-GGUF
  ☆32Updated last year
• generativelabs / exllama-runpod-serverless
  ☆17Updated last year
• ossirytk / llama-cpp-chat-memory
  Local character AI chatbot with chroma vector store memory and some scripts to process documents for Chroma
  ☆34Updated 6 months ago
• CharlesMod / quantizeHFmodel
  Accepts a Hugging Face model URL, automatically downloads and quantizes it using Bits and Bytes.
  ☆38Updated last year
• OpenAgentLLM / OpenAgent
  🔓 The open-source autonomous agent LLM initiative 🔓
  ☆91Updated last year
• markokraemer / OACE
  ☆22Updated 10 months ago
• Maximilian-Winter / llama_cpp_function_calling
  ☆31Updated last year
• Ordinath / tool_juggler
  ☆41Updated last year
• jquesnelle / literAI
  Generate visual podcasts about novels using open source models
  ☆25Updated 2 years ago
• dibrale / webui_autonomics
  Dynamic parameter modulation for oobabooga's text-generation-webui that adjusts generation parameters to better mirror user affect.
  ☆35Updated last year
• nexusflowai / nexusraven-pip
  ☆38Updated last year
• abacaj / openhermes-function-calling
  ☆135Updated last year
• teknium1 / alpaca-discord
  A Simple Discord Bot for the Alpaca LLM
  ☆101Updated last year
• bdambrosio / AllTheWorldAPlay
  All the world is a play, we are but actors in it.
  ☆49Updated this week
• andreasjansson / AutoCog
  ☆39Updated 7 months ago
• j-webtek / LLM-Learning
  A repository to store helpful information and emerging insights in regard to LLMs
  ☆20Updated last year
• OoriData / OgbujiPT
  Client-side toolkit for using large language models, including where self-hosted
  ☆110Updated 5 months ago
• ragnarkar / reddit_imitator
  ☆16Updated last year
• theroyallab / llm-prompt-templates
  Prompt Jinja2 templates for LLMs
  ☆29Updated 4 months ago