Alternatives and similar repositories for servereless-runpod-ggml

Users that are interested in servereless-runpod-ggml are comparing it to the libraries listed below

• hommayushi3 / exllama-runpod-serverless
  ☆52Updated last year
• ashleykleynhans / runpod-worker-oobabooga
  RunPod Serverless Worker for Oobabooga Text Generation API for LLMs
  ☆2Updated last year
• OpenAccess-AI-Collective / ggml-webui
  Deploy your GGML models to HuggingFace Spaces with Docker and gradio
  ☆37Updated 2 years ago
• spyglass-search / talos
  Easily create LLM automation/agent workflows
  ☆59Updated last year
• the-crypt-keeper / the-muse
  Experimental sampler to make LLMs more creative
  ☆31Updated last year
• OoriData / OgbujiPT
  Client-side toolkit for using large language models, including where self-hosted
  ☆111Updated 7 months ago
• teknium1 / ShareGPT-Builder
  ☆115Updated 6 months ago
• Maximilian-Winter / llama_cpp_function_calling
  ☆31Updated last year
• DataBassGit / AssistAF
  ☆44Updated last year
• Itachi-Uchiha581 / Auto-Data
  Auto Data is a library designed for quick and effortless creation of datasets tailored for fine-tuning Large Language Models (LLMs).
  ☆102Updated 8 months ago
• TheBlokeAI / dockerLLM
  TheBloke's Dockerfiles
  ☆305Updated last year
• c0sogi / llama-api
  An OpenAI-like LLaMA inference API
  ☆112Updated last year
• desik1998 / MathWithLLMs
  ☆49Updated last year
• ChobPT / oobaboogas-webui-langchain_agent
  Creates an Langchain Agent which uses the WebUI's API and Wikipedia to work
  ☆74Updated last year
• Rivridis / LLM-Assistant
  Locally running LLM with internet access
  ☆95Updated last week
• adrienbrault / hf-gguf-to-ollama
  Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.
  ☆116Updated last year
• serp-ai / unsloth
  5X faster 60% less memory QLoRA finetuning
  ☆21Updated last year
• the-crypt-keeper / LLooM
  Experimental LLM Inference UX to aid in creative writing
  ☆114Updated 6 months ago
• multiplexerai / mplx_rag
  Complex RAG backend
  ☆28Updated last year
• jeffrey-fong / Invoker
  The one who calls upon functions - Function-Calling Language Model
  ☆36Updated last year
• ossirytk / llama-cpp-chat-memory
  Local character AI chatbot with chroma vector store memory and some scripts to process documents for Chroma
  ☆34Updated 9 months ago
• shinomakoi / magi_llm_gui
  A Qt GUI for large language models
  ☆43Updated last year
• wangcx18 / llm-vscode-inference-server
  An endpoint server for efficiently serving quantized open-source LLMs for code.
  ☆55Updated last year
• teknium1 / character-cards
  A collection of character cards for use in AI Roleplaying
  ☆84Updated 2 years ago
• andreasjansson / AutoCog
  ☆40Updated last month
• monk1337 / auto-ollama
  run ollama & gguf easily with a single command
  ☆52Updated last year
• KillianLucas / ooba
  Run language models on consumer hardware.
  ☆25Updated last year
• cognitivecomputations / OpenChatML
  ☆157Updated 11 months ago
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆183Updated last year
• marlaman / DebateTree
  A langchain app to visualise a debate using Tree-of-Thought reasoning
  ☆60Updated last year