basetenlabs / truss-examplesLinks
Examples of models deployable with Truss
☆212Updated this week
Alternatives and similar repositories for truss-examples
Users that are interested in truss-examples are comparing it to the libraries listed below
Sorting:
- 🐍 | Python library for RunPod API and serverless worker SDK.☆264Updated last week
- ☆119Updated last year
- ☆134Updated last month
- Gradio based tool to run opensource LLM models directly from Huggingface☆96Updated last year
- The RunPod worker template for serving our large language model endpoints. Powered by vLLM.☆391Updated this week
- A curated list of amazing RunPod projects, libraries, and resources☆127Updated last year
- Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.☆118Updated last year
- Gradio UI for a Cog API☆71Updated last year
- All the world is a play, we are but actors in it.☆49Updated 5 months ago
- A fast batching API to serve LLM models☆188Updated last year
- Auto Data is a library designed for quick and effortless creation of datasets tailored for fine-tuning Large Language Models (LLMs).☆103Updated last year
- WIP - Allows you to create DSPy pipelines using ComfyUI☆199Updated last year
- ☆55Updated 4 months ago
- Ollama models of NousResearch/Hermes-2-Pro-Mistral-7B-GGUF☆34Updated last year
- Starting point to build your own custom serverless endpoint☆129Updated 8 months ago
- A pipeline parallel training script for LLMs.☆165Updated 8 months ago
- A curated list of amazingly awesome Modal applications, demos, and shiny things. Inspired by awesome-php.☆168Updated 3 weeks ago
- ☆165Updated 5 months ago
- ASR + diarization model server with speculative decoding☆63Updated last year
- ☆81Updated last year
- FRP Fork☆177Updated 9 months ago
- Low-Rank adapter extraction for fine-tuned transformers models☆180Updated last year
- Experimental LLM Inference UX to aid in creative writing☆127Updated last year
- Distributed Inference for mlx LLm☆100Updated last year
- Local character AI chatbot with chroma vector store memory and some scripts to process documents for Chroma☆34Updated last year
- An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.☆267Updated 10 months ago
- AutoNL - Natural Language Automation tool☆86Updated last year
- Deploy your GGML models to HuggingFace Spaces with Docker and gradio☆38Updated 2 years ago
- Chat to Compose Video☆198Updated 2 years ago
- Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI☆222Updated last year