Alternatives and similar repositories for exllama-runpod-serverless:

Users that are interested in exllama-runpod-serverless are comparing it to the libraries listed below

• ashleykleynhans / runpod-worker-oobabooga
  RunPod Serverless Worker for Oobabooga Text Generation API for LLMs
  ☆1Updated 10 months ago
• OpenAccess-AI-Collective / servereless-runpod-ggml
  ☆55Updated last year
• ChobPT / oobaboogas-webui-langchain_agent
  Creates an Langchain Agent which uses the WebUI's API and Wikipedia to work
  ☆74Updated last year
• FartyPants / Training_PRO
  Traing PRO extension for oobabooga WebUI - recent dev version
  ☆48Updated last month
• p-e-w / chatbot_clinic
  Science-driven chatbot development
  ☆56Updated 10 months ago
• theubie / complex_memory
  A KoboldAI-like memory extension for oobabooga's text-generation-webui
  ☆108Updated 4 months ago
• generativelabs / exllama-runpod-serverless
  ☆17Updated last year
• teknium1 / character-cards
  A collection of character cards for use in AI Roleplaying
  ☆84Updated last year
• TheBlokeAI / dockerLLM
  TheBloke's Dockerfiles
  ☆306Updated last year
• kodxana / Awesome-RunPod
  A curated list of amazing RunPod projects, libraries, and resources
  ☆108Updated 7 months ago
• dibrale / webui_autonomics
  Dynamic parameter modulation for oobabooga's text-generation-webui that adjusts generation parameters to better mirror user affect.
  ☆35Updated last year
• danikhan632 / guidance_api
  An Extension for oobabooga/text-generation-webui
  ☆36Updated last year
• runpod-workers / worker-vllm
  The RunPod worker template for serving our large language model endpoints. Powered by vLLM.
  ☆294Updated last week
• flurb18 / AgentOoba
  An autonomous AI agent extension for Oobabooga's web ui
  ☆175Updated last year
• CharlesMod / quantizeHFmodel
  Accepts a Hugging Face model URL, automatically downloads and quantizes it using Bits and Bytes.
  ☆38Updated last year
• jeffrey-fong / Invoker
  The one who calls upon functions - Function-Calling Language Model
  ☆36Updated last year
• ghostpad / ghostpad
  A free AI text generation interface based on KoboldAI
  ☆33Updated last year
• brucepro / Memoir
  Memoir+ a persona memory extension for Text Gen Web UI.
  ☆193Updated last week
• Urist-Mc-Urist / DoppeLLaMA
  Discord chatbot interface to train an LLM on user message history
  ☆27Updated last year
• Digitous / ModelREVOLVER
  Model REVOLVER, a human in the loop model mixing system.
  ☆33Updated last year
• Maximilian-Winter / guidance
  A guidance language for controlling large language models.
  ☆45Updated last year
• kaiokendev / superbig
  A prompt/context management system
  ☆170Updated last year
• the-crypt-keeper / LLooM
  Experimental LLM Inference UX to aid in creative writing
  ☆113Updated 3 months ago
• teknium1 / alpaca-roleplay-discordbot
  A discord bot that roleplays!
  ☆147Updated last year
• DataBassGit / BabyBoogaAGI
  Porting BabyAGI to Oobabooba.
  ☆33Updated last year
• FartyPants / Playground
  Text WebUI extension to add clever Notebooks to Chat mode
  ☆139Updated last year
• TheLocalLab / text-generation-webui-simple-colab
  A simple updated colab doc that will allow you to run the Ooba Booga Text-Generation-Webui for free with just a few lines of codes.
  ☆23Updated 5 months ago
• mounta11n / plusplus-camall
  After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around…
  ☆56Updated 7 months ago
• DavG25 / text-generation-webui-code_syntax_highlight
  An extension for oobabooga's text-generation-webui that adds syntax highlighting to code snippets
  ☆66Updated 9 months ago
• PromptEngineer48 / LLM_Selector
  This code implements a Local LLM Selector from the list of Local Installed Ollama LLMs for your specific user Query
  ☆102Updated last year