Alternatives and similar repositories for servereless-runpod-ggml

Users that are interested in servereless-runpod-ggml are comparing it to the libraries listed below

• hommayushi3 / exllama-runpod-serverless
  ☆52Updated last year
• ashleykleynhans / runpod-worker-oobabooga
  RunPod Serverless Worker for Oobabooga Text Generation API for LLMs
  ☆2Updated last year
• the-crypt-keeper / the-muse
  Experimental sampler to make LLMs more creative
  ☆31Updated last year
• OpenAccess-AI-Collective / ggml-webui
  Deploy your GGML models to HuggingFace Spaces with Docker and gradio
  ☆36Updated last year
• s4rduk4r / alpaca_lora_4bit_readme
  Just a simple HowTo for https://github.com/johnsmith0031/alpaca_lora_4bit
  ☆30Updated 2 years ago
• Digitous / ModelREVOLVER
  Model REVOLVER, a human in the loop model mixing system.
  ☆32Updated last year
• serp-ai / unsloth
  5X faster 60% less memory QLoRA finetuning
  ☆21Updated last year
• generativelabs / exllama-runpod-serverless
  ☆17Updated last year
• virtualzx-nad / easy_llm_agents
  Flexible Python package for managing and extending LLM based agents
  ☆25Updated 2 years ago
• nicholasyager / llama-cpp-guidance
  A guidance compatibility layer for llama-cpp-python
  ☆34Updated last year
• eugenepentland / landmark-attention-qlora
  Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA
  ☆122Updated last year
• jbilcke-hf / template-node-wizardcoder-express
  A minimalist Docker project to help people getting started with Node, WizardCoder, CTransformers, Python, Express and TypeScript. Ready t…
  ☆14Updated last year
• jquesnelle / literAI
  Generate visual podcasts about novels using open source models
  ☆25Updated 2 years ago
• danikhan632 / guidance_api
  An Extension for oobabooga/text-generation-webui
  ☆36Updated last year
• Alignment-Lab-AI / AutoMaticAssistant
  ☆24Updated last year
• FartyPants / Training_PRO
  Traing PRO extension for oobabooga WebUI - recent dev version
  ☆49Updated last week
• cognitivecomputations / kraken
  ☆66Updated last year
• KillianLucas / ooba
  Run language models on consumer hardware.
  ☆24Updated last year
• Maximilian-Winter / llama_cpp_function_calling
  ☆30Updated last year
• ossirytk / llama-cpp-chat-memory
  Local character AI chatbot with chroma vector store memory and some scripts to process documents for Chroma
  ☆34Updated 7 months ago
• nova-land / gbnf-compiler
  Plug n Play GBNF Compiler for llama.cpp
  ☆25Updated last year
• markokraemer / OACE
  ☆22Updated 11 months ago
• DataBassGit / AssistAF
  ☆44Updated last year
• Urist-Mc-Urist / DoppeLLaMA
  Discord chatbot interface to train an LLM on user message history
  ☆27Updated last year
• spyglass-search / talos
  Easily create LLM automation/agent workflows
  ☆59Updated last year
• aigoopy / llm-jeopardy
  Automated prompting and scoring framework to evaluate LLMs using updated human knowledge prompts
  ☆109Updated last year
• dibrale / webui_autonomics
  Dynamic parameter modulation for oobabooga's text-generation-webui that adjusts generation parameters to better mirror user affect.
  ☆34Updated last year
• VatsaDev / NanoPhi-alpha
  GPT-2 small trained on phi-like data
  ☆66Updated last year
• the-crypt-keeper / ggml-downloader
  Simple, Fast, Parallel Huggingface GGML model downloader written in python
  ☆24Updated last year
• IntrinsicLabsAI / grammar-builder
  Generates grammer files from typescript for LLM generation
  ☆38Updated last year