basetenlabs / truss-examplesLinks
Examples of models deployable with Truss
☆214Updated this week
Alternatives and similar repositories for truss-examples
Users that are interested in truss-examples are comparing it to the libraries listed below
Sorting:
- The RunPod worker template for serving our large language model endpoints. Powered by vLLM.☆401Updated 2 weeks ago
- 🐍 | Python library for RunPod API and serverless worker SDK.☆270Updated this week
- ☆119Updated last year
- ☆134Updated 2 months ago
- Gradio based tool to run opensource LLM models directly from Huggingface☆97Updated last year
- WIP - Allows you to create DSPy pipelines using ComfyUI☆204Updated last year
- ☆207Updated last year
- A fast batching API to serve LLM models☆189Updated last year
- Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.☆119Updated last year
- Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI☆222Updated last year
- An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.☆266Updated 11 months ago
- Gradio UI for a Cog API☆70Updated last year
- ☆135Updated 2 years ago
- ☆166Updated 6 months ago
- ☆54Updated 2 years ago
- The official Cartesia client for Python.☆119Updated this week
- ☆36Updated 2 years ago
- An OpenAI-like LLaMA inference API☆113Updated 2 years ago
- Pipeline is an open source python SDK for building AI/ML workflows☆138Updated last year
- Distributed Inference for mlx LLm☆100Updated last year
- faster-whisper as serverless endpoint☆127Updated 2 months ago
- 🐳 | Dockerfiles for the RunPod container images used for our official templates.☆219Updated last month
- Auto Data is a library designed for quick and effortless creation of datasets tailored for fine-tuning Large Language Models (LLMs).☆105Updated last year
- A curated list of amazingly awesome Modal applications, demos, and shiny things. Inspired by awesome-php.☆174Updated last month
- automatically quant GGUF models☆219Updated last month
- A curated list of amazing RunPod projects, libraries, and resources☆128Updated last year
- Run inference on replit-3B code instruct model using CPU☆160Updated 2 years ago
- Low-Rank adapter extraction for fine-tuned transformers models☆180Updated last year
- ☆198Updated 2 years ago
- Experimental LLM Inference UX to aid in creative writing☆128Updated last year