runpod / runpod-python
š | Python library for RunPod API and serverless worker SDK.
ā202Updated this week
Alternatives and similar repositories for runpod-python:
Users that are interested in runpod-python are comparing it to the libraries listed below
- A curated list of amazing RunPod projects, libraries, and resourcesā104Updated 4 months ago
- š§° | RunPod CLI for pod managementā274Updated this week
- š³ | Dockerfiles for the RunPod container images used for our official templates.ā159Updated last month
- š | A simple worker that can be used as a starting point to build your own custom RunPod Endpoint API worker.ā88Updated 2 months ago
- Examples of models deployable with Trussā148Updated this week
- The RunPod worker template for serving our large language model endpoints. Powered by vLLM.ā266Updated 2 weeks ago
- RunPod Serverless Worker for Oobabooga Text Generation API for LLMsā1Updated 8 months ago
- ā52Updated last year
- āļø | REPLACED BY https://github.com/runpod-workers | Official set of serverless worker provided by RunPod as endpoints.ā56Updated last year
- ā165Updated this week
- Automatic1111 serverless worker.ā80Updated last month
- TheBloke's Dockerfilesā300Updated 10 months ago
- QLoRA: Efficient Finetuning of Quantized LLMsā77Updated 9 months ago
- Falcon LLM ggml framework with CPU and GPU supportā245Updated 11 months ago
- The code we currently use to fine-tune models.ā112Updated 8 months ago
- Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRAā123Updated last year
- Wheels for llama-cpp-python compiled with cuBLAS supportā95Updated 11 months ago
- A fast batching API to serve LLM modelsā177Updated 8 months ago
- Simple and fast server for GPTQ-quantized LLaMA inferenceā24Updated last year
- Made slight modifications to the Tortoise API, provided 3 additional scripts to make using Tortoise easier. Less focus on cloning makes sā¦ā52Updated 8 months ago
- ā61Updated 2 months ago
- Some simple scripts that I use day-to-day when working with LLMs and Huggingface Hubā156Updated last year
- web search extension for text-generation-webuiā99Updated 10 months ago
- 4 bits quantization of LLaMa using GPTQā131Updated last year
- XTTSv2 Extension for oobabooga text-generation-webuiā149Updated last year
- Official code for "F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matching"ā75Updated 3 months ago
- Gradio UI for a Cog APIā65Updated 9 months ago
- Unofficial python bindings for the rust llm library. šā¤ļøš¦ā73Updated last year
- BIG: Back In the Game of Creative AIā26Updated last year
- Stable Diffusion XL training and inference as a cog modelā218Updated 2 months ago