Alternatives and similar repositories for runpod-python

Users that are interested in runpod-python are comparing it to the libraries listed below

• runpod / runpodctl
  🧰 | RunPod CLI for pod management
  ☆315Updated 2 weeks ago
• runpod-workers / worker-template
  Starting point to build your own custom serverless endpoint
  ☆108Updated last month
• kodxana / Awesome-RunPod
  A curated list of amazing RunPod projects, libraries, and resources
  ☆115Updated 10 months ago
• runpod-workers / worker-vllm
  The RunPod worker template for serving our large language model endpoints. Powered by vLLM.
  ☆327Updated last week
• runpod / containers
  🐳 | Dockerfiles for the RunPod container images used for our official templates.
  ☆193Updated this week
• basetenlabs / truss-examples
  Examples of models deployable with Truss
  ☆184Updated last week
• ashleykleynhans / runpod-worker-oobabooga
  RunPod Serverless Worker for Oobabooga Text Generation API for LLMs
  ☆2Updated last year
• runpod / serverless-workers
  ⚙️ | REPLACED BY https://github.com/runpod-workers | Official set of serverless worker provided by RunPod as endpoints.
  ☆59Updated 2 weeks ago
• hommayushi3 / exllama-runpod-serverless
  ☆52Updated last year
• huggingface / frp
  FRP Fork
  ☆169Updated 2 months ago
• PygmalionAI / training-code
  The code we currently use to fine-tune models.
  ☆114Updated last year
• eugenepentland / landmark-attention-qlora
  Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA
  ☆123Updated 2 years ago
• runpod-workers / worker-a1111
  Automatic1111 serverless worker.
  ☆89Updated last month
• jllllll / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆64Updated last year
• Gryphe / MergeMonster
  An unsupervised model merging algorithm for Transformers-based language models.
  ☆105Updated last year
• cognitivecomputations / laserRMT
  This is our own implementation of 'Layer Selective Rank Reduction'
  ☆239Updated last year
• c0sogi / llama-api
  An OpenAI-like LLaMA inference API
  ☆112Updated last year
• Preemo-Inc / text-generation-inference
  ☆199Updated last year
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆183Updated last year
• runpod-workers / worker-faster_whisper
  faster-whisper as serverless endpoint
  ☆105Updated last month
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆246Updated last year
• tdrussell / qlora-pipe
  A pipeline parallel training script for LLMs.
  ☆150Updated last month
• jondurbin / qlora
  QLoRA: Efficient Finetuning of Quantized LLMs
  ☆78Updated last year
• cognitivecomputations / OpenChatML
  ☆157Updated 11 months ago
• TheBlokeAI / dockerLLM
  TheBloke's Dockerfiles
  ☆305Updated last year
• TheBloke / AutoGPTQ
  An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
  ☆37Updated last year
• bananaml / serverless-template
  ☆84Updated last year
• adrienbrault / hf-gguf-to-ollama
  Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.
  ☆115Updated last year
• Vaibhavs10 / optimise-my-whisper
  ☆205Updated last year
• teknium1 / ShareGPT-Builder
  ☆115Updated 6 months ago