vast-ai / vast-cliLinks
Vast.ai python and cli api client
☆175Updated this week
Alternatives and similar repositories for vast-cli
Users that are interested in vast-cli are comparing it to the libraries listed below
Sorting:
- 🐍 | Python library for RunPod API and serverless worker SDK.☆268Updated 2 weeks ago
- 🧰 | Runpod CLI for pod management☆362Updated last week
- 🏥 Health monitor for a Petals swarm☆40Updated last year
- My swiftsknife for vast.ai service☆153Updated 3 months ago
- 🐳 | Dockerfiles for the RunPod container images used for our official templates.☆219Updated last month
- ☆122Updated last year
- DiffusionWithAutoscaler☆29Updated last year
- ☆54Updated 3 months ago
- Pipeline is an open source python SDK for building AI/ML workflows☆138Updated last year
- ☆172Updated 11 months ago
- Starting point to build your own custom serverless endpoint☆130Updated 8 months ago
- A template to run LLaMA in Cog☆66Updated 2 years ago
- Examples of models deployable with Truss☆214Updated this week
- Tool to download models from Huggingface Hub and convert them to GGML/GGUF for llama.cpp☆170Updated 9 months ago
- A curated list of amazing RunPod projects, libraries, and resources☆128Updated last year
- Command-line script for inferencing from models such as MPT-7B-Chat☆100Updated 2 years ago
- GPU accelerated client-side embeddings for vector search, RAG etc.☆65Updated 2 years ago
- ☆64Updated last year
- A high-throughput and memory-efficient inference and serving engine for LLMs☆53Updated 2 years ago
- Drop in replacement for OpenAI, but with Open models.☆154Updated 2 years ago
- ☆87Updated 2 years ago
- A high performance batching router optimises max throughput for text inference workload☆16Updated 2 years ago
- ☆142Updated 2 years ago
- ☆52Updated 2 years ago
- A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.☆64Updated 2 years ago
- ☆119Updated last year
- faster-whisper as serverless endpoint☆126Updated 2 months ago
- Modified Stanford-Alpaca Trainer for Training Replit's Code Model☆42Updated 2 years ago
- The RunPod worker template for serving our large language model endpoints. Powered by vLLM.☆393Updated last week
- Generate visual podcasts about novels using open source models☆25Updated 2 years ago