Alternatives and similar repositories for exllama-runpod-serverless:

Users that are interested in exllama-runpod-serverless are comparing it to the libraries listed below

• ashleykleynhans / runpod-worker-oobabooga
  RunPod Serverless Worker for Oobabooga Text Generation API for LLMs
  ☆1Updated 8 months ago
• OpenAccess-AI-Collective / servereless-runpod-ggml
  ☆55Updated last year
• ChobPT / oobaboogas-webui-langchain_agent
  Creates an Langchain Agent which uses the WebUI's API and Wikipedia to work
  ☆72Updated last year
• theubie / complex_memory
  A KoboldAI-like memory extension for oobabooga's text-generation-webui
  ☆107Updated 3 months ago
• danikhan632 / guidance_api
  An Extension for oobabooga/text-generation-webui
  ☆36Updated last year
• FartyPants / Training_PRO
  Traing PRO extension for oobabooga WebUI - recent dev version
  ☆48Updated last week
• hallucinate-games / oobabooga-jsonformer-plugin
  This plugin forces models to output JSON of a specified schema using JSONFormer
  ☆26Updated 2 months ago
• ghostpad / ghostpad
  A free AI text generation interface based on KoboldAI
  ☆33Updated 11 months ago
• sebaxzero / LangChain_PDFChat_Oobabooga
  oobaboga -text-generation-webui implementation of wafflecomposite - langchain-ask-pdf-local
  ☆69Updated last year
• Maximilian-Winter / guidance
  A guidance language for controlling large language models.
  ☆44Updated last year
• p-e-w / chatbot_clinic
  Science-driven chatbot development
  ☆56Updated 8 months ago
• flurb18 / AgentOoba
  An autonomous AI agent extension for Oobabooga's web ui
  ☆176Updated last year
• FartyPants / Playground
  Text WebUI extension to add clever Notebooks to Chat mode
  ☆139Updated last year
• TheBlokeAI / dockerLLM
  TheBloke's Dockerfiles
  ☆301Updated 10 months ago
• DataBassGit / BabyBoogaAGI
  Porting BabyAGI to Oobabooba.
  ☆33Updated last year
• brucepro / Memoir
  Memoir+ a persona extension for Text Gen Web UI. That includes memory, emotions, command handling and more.
  ☆182Updated 2 weeks ago
• xr4dsh / CodeRunner
  ☆28Updated last year
• jeffrey-fong / Invoker
  The one who calls upon functions - Function-Calling Language Model
  ☆36Updated last year
• houseofbaud / doug
  doug is an ai experiment with openai, llama-cpp-python, and langchain
  ☆16Updated last year
• Fus3n / TwoAI
  A simple experiment on letting two local LLM have a conversation about anything!
  ☆101Updated 6 months ago
• kaiokendev / superbig
  A prompt/context management system
  ☆169Updated last year
• atisharma / chasm
  CHAracter State Management - a generative text adventure
  ☆33Updated 3 months ago
• runpod-workers / worker-vllm
  The RunPod worker template for serving our large language model endpoints. Powered by vLLM.
  ☆273Updated this week
• dibrale / webui_autonomics
  Dynamic parameter modulation for oobabooga's text-generation-webui that adjusts generation parameters to better mirror user affect.
  ☆34Updated last year
• Ordinath / tool_juggler
  ☆41Updated last year
• andreasjansson / AutoCog
  ☆38Updated 4 months ago
• mamei16 / LLM_Web_search
  An extension for oobabooga/text-generation-webui that enables the LLM to search the web using DuckDuckGo
  ☆201Updated this week
• generativelabs / exllama-runpod-serverless
  ☆17Updated last year
• adrienbrault / hf-gguf-to-ollama
  Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.
  ☆114Updated 8 months ago
• SicariusSicariiStuff / Diffusion_TTS
  Diffusion_TTS extension for booga
  ☆65Updated 7 months ago