basetenlabs / truss-examples
Examples of models deployable with Truss
β170Updated this week
Alternatives and similar repositories for truss-examples
Users that are interested in truss-examples are comparing it to the libraries listed below
Sorting:
- β130Updated 2 weeks ago
- π | Python library for RunPod API and serverless worker SDK.β228Updated last month
- The RunPod worker template for serving our large language model endpoints. Powered by vLLM.β313Updated last week
- A curated list of amazing RunPod projects, libraries, and resourcesβ112Updated 8 months ago
- automatically quant GGUF modelsβ175Updated this week
- An unsupervised model merging algorithm for Transformers-based language models.β105Updated last year
- All the world is a play, we are but actors in it.β49Updated this week
- β114Updated 4 months ago
- ASR + diarization model server with speculative decodingβ60Updated 11 months ago
- Low-Rank adapter extraction for fine-tuned transformers modelsβ173Updated last year
- Gradio UI for a Cog APIβ67Updated last year
- Deploy your GGML models to HuggingFace Spaces with Docker and gradioβ36Updated last year
- An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.β37Updated last year
- π³ | Dockerfiles for the RunPod container images used for our official templates.β181Updated 2 weeks ago
- β101Updated 8 months ago
- β199Updated last year
- A pipeline parallel training script for LLMs.β145Updated 2 weeks ago
- Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.β115Updated 11 months ago
- Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAIβ223Updated last year
- A fast batching API to serve LLM modelsβ182Updated last year
- β204Updated 11 months ago
- Own your AI, search the web with itππβ85Updated 4 months ago
- An JS web client for connecting to Pipecat bots with voice and visionβ44Updated 4 months ago
- Gradio based tool to run opensource LLM models directly from Huggingfaceβ91Updated 10 months ago
- A curated list of amazingly awesome Modal applications, demos, and shiny things. Inspired by awesome-php.β138Updated last week
- The code we currently use to fine-tune models.β114Updated last year
- GPT-4 Level Conversational QA Trained In a Few Hoursβ61Updated 8 months ago
- β79Updated last year
- The one who calls upon functions - Function-Calling Language Modelβ36Updated last year
- Embed anything.β29Updated 11 months ago