basetenlabs / truss-examplesLinks
Examples of models deployable with Truss
☆189Updated this week
Alternatives and similar repositories for truss-examples
Users that are interested in truss-examples are comparing it to the libraries listed below
Sorting:
- 🐍 | Python library for RunPod API and serverless worker SDK.☆239Updated last week
- The RunPod worker template for serving our large language model endpoints. Powered by vLLM.☆333Updated 3 weeks ago
- ☆115Updated 6 months ago
- ☆131Updated 2 months ago
- An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.☆257Updated 4 months ago
- A fast batching API to serve LLM models☆183Updated last year
- 🐳 | Dockerfiles for the RunPod container images used for our official templates.☆196Updated last week
- Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI☆222Updated last year
- Phi-3.5 for Mac: Locally-run Vision and Language Models for Apple Silicon☆271Updated 10 months ago
- ☆157Updated last year
- automatically quant GGUF models☆187Updated this week
- Gradio based tool to run opensource LLM models directly from Huggingface☆93Updated last year
- Run inference on replit-3B code instruct model using CPU☆156Updated 2 years ago
- Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.☆116Updated last year
- A curated list of amazing RunPod projects, libraries, and resources☆118Updated 10 months ago
- Experimental LLM Inference UX to aid in creative writing☆116Updated 7 months ago
- All the world is a play, we are but actors in it.☆50Updated this week
- Starting point to build your own custom serverless endpoint☆111Updated 2 months ago
- Gradio UI for a Cog API☆69Updated last year
- Distributed Inference for mlx LLm☆93Updated 11 months ago
- Chat to Compose Video☆189Updated last year
- WIP - Allows you to create DSPy pipelines using ComfyUI☆190Updated 7 months ago
- ☆37Updated last year
- Low-Rank adapter extraction for fine-tuned transformers models☆173Updated last year
- A python package for developing AI applications with local LLMs.☆150Updated 6 months ago
- Auto Data is a library designed for quick and effortless creation of datasets tailored for fine-tuning Large Language Models (LLMs).☆102Updated 8 months ago
- ☆199Updated last year
- Create embeddings with infinity as serverless endpoint☆34Updated last month
- A curated list of amazingly awesome Modal applications, demos, and shiny things. Inspired by awesome-php.☆151Updated last month
- AutoNL - Natural Language Automation tool☆85Updated last year