Alternatives and similar repositories for exllama-runpod-serverless

Users that are interested in exllama-runpod-serverless are comparing it to the libraries listed below

• hommayushi3 / exllama-runpod-serverless
  ☆52Updated last year
• ashleykleynhans / runpod-worker-oobabooga
  RunPod Serverless Worker for Oobabooga Text Generation API for LLMs
  ☆2Updated last year
• OpenAccess-AI-Collective / servereless-runpod-ggml
  ☆55Updated 2 years ago
• gkamradt / FineTuningClone
  ☆37Updated last year
• OpenAccess-AI-Collective / ggml-webui
  Deploy your GGML models to HuggingFace Spaces with Docker and gradio
  ☆37Updated 2 years ago
• kodxana / Awesome-RunPod
  A curated list of amazing RunPod projects, libraries, and resources
  ☆115Updated 10 months ago
• ChobPT / oobaboogas-webui-langchain_agent
  Creates an Langchain Agent which uses the WebUI's API and Wikipedia to work
  ☆74Updated last year
• xr4dsh / CodeRunner
  ☆29Updated last year
• ruvnet / coding-wingman
  A sample ChatGPT API Gateway. A robust interface for interacting with third-party APIs using FastAPI
  ☆25Updated last year
• adrienbrault / ollama-nous-hermes2pro
  Ollama models of NousResearch/Hermes-2-Pro-Mistral-7B-GGUF
  ☆32Updated last year
• 0xrushi / Terminal-Voice-Assistant
  Terminal Voice Assistant is a powerful and flexible tool designed to help users interact with their terminal using natural language comma…
  ☆18Updated last year
• the-crypt-keeper / the-muse
  Experimental sampler to make LLMs more creative
  ☆31Updated last year
• offskiies / KB_builder
  Build your own custom knowledge base from various sources such as youtube videos transcripts, tweets, articles, videos and audios. Uses G…
  ☆13Updated last year
• yaronbeen / YTDemos
  ☆18Updated last year
• TheLocalLab / text-generation-webui-simple-colab
  A simple updated colab doc that will allow you to run the Ooba Booga Text-Generation-Webui for free with just a few lines of codes.
  ☆23Updated 8 months ago
• houseofbaud / doug
  doug is an ai experiment with openai, llama-cpp-python, and langchain
  ☆16Updated last year
• andreasjansson / AutoCog
  ☆40Updated last month
• n4ze3m / utube-summarizer
  ☆11Updated last year
• replicate / reflux
  Replicate Flux LoRA image editor.
  ☆51Updated 9 months ago
• teleprint-me / py.gpt.prompt
  PyGPTPrompt: A CLI tool that manages context windows for AI models, facilitating user interaction and data ingestion for optimized long-t…
  ☆30Updated last year
• langchain-ai / twitter-finetune
  ☆59Updated last year
• j-webtek / LLM-Learning
  A repository to store helpful information and emerging insights in regard to LLMs
  ☆20Updated last year
• unclecode / whisperanywhere-js
  WhisperAnywhere: Effortless speech-to-text everywhere on your Mac. Use a hotkey to dictate in any app, powered by Whisper AI and Groq API…
  ☆31Updated 9 months ago
• groq / groq-mcp-server
  Groq MCP server
  ☆21Updated last month
• ossirytk / llama-cpp-chat-memory
  Local character AI chatbot with chroma vector store memory and some scripts to process documents for Chroma
  ☆34Updated 8 months ago
• camenduru / Mistral-colab
  ☆40Updated last year
• RandomInternetPreson / text_generation_webui_xtt_Alts
  XTTSv2 Extension for oobabooga text-generation-webui
  ☆34Updated 11 months ago
• FartyPants / Training_PRO
  Traing PRO extension for oobabooga WebUI - recent dev version
  ☆50Updated last week
• mshumer / gpt-podcast
  ☆43Updated last year
• multiplexerai / mplx_rag
  Complex RAG backend
  ☆28Updated last year