Alternatives and similar repositories for exllama-runpod-serverless

Users that are interested in exllama-runpod-serverless are comparing it to the libraries listed below

• hommayushi3 / exllama-runpod-serverless
  ☆52Updated last year
• gkamradt / FineTuningClone
  ☆37Updated last year
• ossirytk / llama-cpp-chat-memory
  Local character AI chatbot with chroma vector store memory and some scripts to process documents for Chroma
  ☆34Updated 7 months ago
• OpenAccess-AI-Collective / servereless-runpod-ggml
  ☆53Updated last year
• ashleykleynhans / runpod-worker-oobabooga
  RunPod Serverless Worker for Oobabooga Text Generation API for LLMs
  ☆2Updated last year
• spyglass-search / talos
  Easily create LLM automation/agent workflows
  ☆59Updated last year
• OpenAccess-AI-Collective / ggml-webui
  Deploy your GGML models to HuggingFace Spaces with Docker and gradio
  ☆36Updated last year
• Doriandarko / giotto-artist-assistant
  The very first artist assistant
  ☆21Updated last year
• jbilcke-hf / atryon
  [WIP] AI Try-On plugin for Chrome
  ☆27Updated last year
• cognitivecomputations / agenticworker
  ☆23Updated 6 months ago
• adrienbrault / ollama-nous-hermes2pro
  Ollama models of NousResearch/Hermes-2-Pro-Mistral-7B-GGUF
  ☆32Updated last year
• adrienbrault / hf-gguf-to-ollama
  Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.
  ☆115Updated last year
• abrenneke / rivet-plugin-example-python-exec
  Example plugin for Rivet, showing how to execute a python script in a node
  ☆11Updated last year
• BerriAI / Awesome-LLMOps
  An awesome & curated list of best LLMOps tools for developers
  ☆24Updated last year
• ruvnet / coding-wingman
  A sample ChatGPT API Gateway. A robust interface for interacting with third-party APIs using FastAPI
  ☆25Updated last year
• unclecode / whisperanywhere-js
  WhisperAnywhere: Effortless speech-to-text everywhere on your Mac. Use a hotkey to dictate in any app, powered by Whisper AI and Groq API…
  ☆30Updated 8 months ago
• abrenneke / rivet-plugin-ollama
  Rivet plugin for integration with Ollama, the tool for running LLMs locally easily
  ☆38Updated this week
• teleprint-me / py.gpt.prompt
  PyGPTPrompt: A CLI tool that manages context windows for AI models, facilitating user interaction and data ingestion for optimized long-t…
  ☆29Updated last year
• houseofbaud / doug
  doug is an ai experiment with openai, llama-cpp-python, and langchain
  ☆16Updated last year
• offskiies / KB_builder
  Build your own custom knowledge base from various sources such as youtube videos transcripts, tweets, articles, videos and audios. Uses G…
  ☆13Updated last year
• Actioninsight / AutoNL
  AutoNL - Natural Language Automation tool
  ☆85Updated last year
• bdambrosio / AllTheWorldAPlay
  All the world is a play, we are but actors in it.
  ☆50Updated this week
• JayZeeDesign / universal-web-scraper
  ☆45Updated last year
• menloparklab / chatbot-ui
  An open source ChatGPT UI taken from Chatbot UI and combined with LangChain-python based backend served using Lanarky.
  ☆36Updated last year
• ChobPT / oobaboogas-webui-langchain_agent
  Creates an Langchain Agent which uses the WebUI's API and Wikipedia to work
  ☆73Updated last year
• WismutHansen / READ2ME
  Turn text from websites into spoken audio with edge-tts, F5, etc. and save as mp3 files
  ☆47Updated this week
• danikhan632 / guidance_api
  An Extension for oobabooga/text-generation-webui
  ☆36Updated last year
• FlowiseAI / Flowise-Pinokio
  ☆41Updated last year
• TheLocalLab / text-generation-webui-simple-colab
  A simple updated colab doc that will allow you to run the Ooba Booga Text-Generation-Webui for free with just a few lines of codes.
  ☆24Updated 8 months ago
• multiplexerai / mplx_rag
  Complex RAG backend
  ☆28Updated last year