Alternatives and similar repositories for runpod-python

Users that are interested in runpod-python are comparing it to the libraries listed below

• runpod-workers / worker-template
  Starting point to build your own custom serverless endpoint
  ☆104Updated last week
• runpod / runpodctl
  🧰 | RunPod CLI for pod management
  ☆304Updated 4 months ago
• kodxana / Awesome-RunPod
  A curated list of amazing RunPod projects, libraries, and resources
  ☆112Updated 8 months ago
• runpod / containers
  🐳 | Dockerfiles for the RunPod container images used for our official templates.
  ☆181Updated 2 weeks ago
• runpod-workers / worker-vllm
  The RunPod worker template for serving our large language model endpoints. Powered by vLLM.
  ☆313Updated last week
• basetenlabs / truss-examples
  Examples of models deployable with Truss
  ☆170Updated this week
• hommayushi3 / exllama-runpod-serverless
  ☆52Updated last year
• bananaml / serverless-template
  ☆84Updated last year
• pooyahrtn / RunpodOllama
  Running Ollama with Runpod
  ☆59Updated 9 months ago
• epolewski / EricLLM
  A fast batching API to serve LLM models
  ☆182Updated last year
• adrienbrault / hf-gguf-to-ollama
  Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.
  ☆115Updated 11 months ago
• runpod / serverless-workers
  ⚙️ | REPLACED BY https://github.com/runpod-workers | Official set of serverless worker provided by RunPod as endpoints.
  ☆58Updated last year
• ashleykleynhans / runpod-worker-oobabooga
  RunPod Serverless Worker for Oobabooga Text Generation API for LLMs
  ☆2Updated 11 months ago
• eugenepentland / landmark-attention-qlora
  Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA
  ☆123Updated last year
• PygmalionAI / training-code
  The code we currently use to fine-tune models.
  ☆114Updated last year
• andreasjansson / AutoCog
  ☆39Updated this week
• TheBlokeAI / dockerLLM
  TheBloke's Dockerfiles
  ☆303Updated last year
• runpod-workers / worker-infinity-embedding
  Create embeddings with infinity as serverless endpoint
  ☆28Updated last week
• replicate / lora-inference
  LoRA inference model packaged with Cog
  ☆74Updated last year
• runpod / serverless-ckpt-template
  🖼️ | Quickly deploy a custom RunPod Endpoint API using your own model ckpt.
  ☆27Updated 2 years ago
• bananaml / serverless-template-stable-diffusion
  ☆88Updated last year
• jllllll / exllama
  A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
  ☆64Updated last year
• multimodalart / grog
  Gradio UI for a Cog API
  ☆67Updated last year
• lucataco / cog-flux-dev-lora
  LoRA Explorer model to test with LoRAs using Flux.1[Dev] as the base model
  ☆47Updated 7 months ago
• TheBloke / AutoGPTQ
  An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
  ☆37Updated last year
• wangcx18 / llm-vscode-inference-server
  An endpoint server for efficiently serving quantized open-source LLMs for code.
  ☆55Updated last year
• cmp-nct / ggllm.cpp
  Falcon LLM ggml framework with CPU and GPU support
  ☆246Updated last year
• supabase / vecs
  Postgres/pgvector Python Client
  ☆254Updated last month
• replicate / setup-cog
  A GitHub Action for installing and using Cog so you can run, test, and push machine learning models
  ☆70Updated 3 months ago
• Preemo-Inc / text-generation-inference
  ☆199Updated last year