Alternatives and similar repositories for llama-runpod

Users that are interested in llama-runpod are comparing it to the libraries listed below

• hommayushi3 / exllama-runpod-serverless
  ☆52Updated last year
• ashleykleynhans / runpod-worker-oobabooga
  RunPod Serverless Worker for Oobabooga Text Generation API for LLMs
  ☆2Updated last year
• OpenAccess-AI-Collective / servereless-runpod-ggml
  ☆55Updated 2 years ago
• the-crypt-keeper / LLooM
  Experimental LLM Inference UX to aid in creative writing
  ☆114Updated 5 months ago
• Gryphe / MergeMonster
  An unsupervised model merging algorithm for Transformers-based language models.
  ☆105Updated last year
• desik1998 / NovelWithLLMs
  ☆24Updated last year
• adrienbrault / hf-gguf-to-ollama
  Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.
  ☆115Updated last year
• VatsaDev / NanoPhi-alpha
  GPT-2 small trained on phi-like data
  ☆66Updated last year
• ValyrianTech / OpenVoice_server
  API server for Instant voice cloning by MyShell.
  ☆93Updated 8 months ago
• itsme2417 / PolyMind
  A multimodal, function calling powered LLM webui.
  ☆214Updated 8 months ago
• kaiokendev / superbig
  A prompt/context management system
  ☆170Updated 2 years ago
• Pandaily591 / OnlySpeakTTS
  Made slight modifications to the Tortoise API, provided 3 additional scripts to make using Tortoise easier. Less focus on cloning makes s…
  ☆52Updated last year
• sam-paech / antislop-sampler
  ☆291Updated 2 months ago
• atisharma / chasm_engine
  CHAracter State Management - a generative text adventure (engine)
  ☆65Updated 7 months ago
• RandomInternetPreson / text_generation_webui_xtt_Alts
  XTTSv2 Extension for oobabooga text-generation-webui
  ☆34Updated 10 months ago
• thomasgauthier / LoRD
  Low-Rank adapter extraction for fine-tuned transformers models
  ☆173Updated last year
• eugenepentland / landmark-attention-qlora
  Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA
  ☆123Updated last year
• jeffrey-fong / Invoker
  The one who calls upon functions - Function-Calling Language Model
  ☆36Updated last year
• j-csc / mlx_bark
  Port of Suno's Bark TTS transformer in Apple's MLX Framework
  ☆82Updated last year
• spyglass-search / talos
  Easily create LLM automation/agent workflows
  ☆59Updated last year
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆183Updated last year
• wassname / prob_jsonformer
  Generate Structured JSON with probs from Language Models
  ☆17Updated 2 months ago
• OoriData / OgbujiPT
  Client-side toolkit for using large language models, including where self-hosted
  ☆111Updated 6 months ago
• theroyallab / YALS
  ☆76Updated last week
• TheBlokeAI / dockerLLM
  TheBloke's Dockerfiles
  ☆303Updated last year
• markokraemer / OACE
  ☆22Updated 11 months ago
• bdambrosio / AllTheWorldAPlay
  All the world is a play, we are but actors in it.
  ☆50Updated this week
• remichu-ai / pai
  Your personal and private AI
  ☆47Updated 2 months ago
• runpod-workers / worker-template
  Starting point to build your own custom serverless endpoint
  ☆108Updated last month
• c0sogi / llama-api
  An OpenAI-like LLaMA inference API
  ☆112Updated last year