Alternatives and similar repositories for servereless-runpod-ggml:

Users that are interested in servereless-runpod-ggml are comparing it to the libraries listed below

• hommayushi3 / exllama-runpod-serverless
  ☆52Updated last year
• ashleykleynhans / runpod-worker-oobabooga
  RunPod Serverless Worker for Oobabooga Text Generation API for LLMs
  ☆1Updated 8 months ago
• OpenAccess-AI-Collective / ggml-webui
  Deploy your GGML models to HuggingFace Spaces with Docker and gradio
  ☆35Updated last year
• Digitous / ModelREVOLVER
  Model REVOLVER, a human in the loop model mixing system.
  ☆33Updated last year
• eugenepentland / landmark-attention-qlora
  Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA
  ☆123Updated last year
• danikhan632 / guidance_api
  An Extension for oobabooga/text-generation-webui
  ☆36Updated last year
• the-crypt-keeper / the-muse
  Experimental sampler to make LLMs more creative
  ☆30Updated last year
• s4rduk4r / alpaca_lora_4bit_readme
  Just a simple HowTo for https://github.com/johnsmith0031/alpaca_lora_4bit
  ☆31Updated last year
• Alignment-Lab-AI / AutoMaticAssistant
  ☆24Updated last year
• YenRaven / annoy_ltm
  annoy long term memory experiment for oobabooga/text-generation-webui
  ☆31Updated last year
• ChobPT / oobaboogas-webui-langchain_agent
  Creates an Langchain Agent which uses the WebUI's API and Wikipedia to work
  ☆72Updated last year
• andreasjansson / AutoCog
  ☆38Updated 3 months ago
• OpenAgentLLM / OpenAgent
  🔓 The open-source autonomous agent LLM initiative 🔓
  ☆90Updated 11 months ago
• Gryphe / MergeMonster
  An unsupervised model merging algorithm for Transformers-based language models.
  ☆101Updated 8 months ago
• VatsaDev / NanoPhi-alpha
  GPT-2 small trained on phi-like data
  ☆65Updated 11 months ago
• PygmalionAI / training-code
  The code we currently use to fine-tune models.
  ☆112Updated 8 months ago
• serp-ai / unsloth
  5X faster 60% less memory QLoRA finetuning
  ☆21Updated 7 months ago
• pooyahrtn / RunpodOllama
  Running Ollama with Runpod
  ☆53Updated 5 months ago
• IntrinsicLabsAI / grammar-builder
  Generates grammer files from typescript for LLM generation
  ☆35Updated 11 months ago
• taprosoft / llm_finetuning
  Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…
  ☆146Updated last year
• jquesnelle / literAI
  Generate visual podcasts about novels using open source models
  ☆24Updated last year
• kaiokendev / superbig
  A prompt/context management system
  ☆167Updated last year
• gkamradt / FineTuningClone
  ☆37Updated last year
• spyglass-search / talos
  Easily create LLM automation/agent workflows
  ☆58Updated 11 months ago
• markokraemer / OACE
  ☆22Updated 6 months ago
• nicholasyager / llama-cpp-guidance
  A guidance compatibility layer for llama-cpp-python
  ☆34Updated last year
• FartyPants / Training_PRO
  Traing PRO extension for oobabooga WebUI - recent dev version
  ☆48Updated last week
• nexusflowai / nexusraven-pip
  ☆38Updated last year
• TheBlokeAI / AIScripts
  Some simple scripts that I use day-to-day when working with LLMs and Huggingface Hub
  ☆156Updated last year