Self-host LLMs with vLLM and BentoML
☆174Jul 14, 2026Updated last month
Alternatives and similar repositories for BentoVLLM
Users that are interested in BentoVLLM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Simple dependency injection framework for Python☆21Jul 14, 2026Updated last month
- ☆58Nov 18, 2024Updated last year
- 🚀 Launching Bento in a Kubernetes cluster☆17Jul 14, 2026Updated last month
- ☆11Apr 25, 2021Updated 5 years ago
- Benchmarking suite for popular AI APIs☆88Feb 6, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Cluster doctor skills☆14May 23, 2026Updated 3 months ago
- The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!☆8,823Aug 28, 2026Updated last week
- ☆12Oct 25, 2023Updated 2 years ago
- ☆22Apr 17, 2025Updated last year
- This is "Your Private StackOverflow" app that helps you perform generative search in your code bases. This is built using open-source sta…☆11Aug 14, 2023Updated 3 years ago
- LLMPerf is a library for validating and benchmarking LLMs☆1,126Dec 9, 2024Updated last year
- AutoML 2024: HPOD: Hyperparameter Optimization for Unsupervised Outlier Detection☆13Jul 12, 2024Updated 2 years ago
- how to build a sentence embedding application using BentoML☆15Jul 14, 2026Updated last month
- ☆15Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆12Jul 5, 2023Updated 3 years ago
- Chatbot-to-speech using Orpheus TTS model. Interactive console app.☆21May 1, 2025Updated last year
- Pycon KR 2023 presentation☆13Feb 7, 2024Updated 2 years ago
- ☆12May 20, 2022Updated 4 years ago
- ☆356Aug 17, 2026Updated 3 weeks ago
- Aplicação em Python para Optical Character Recognition (OCR), uma técnica para extrair textos em imagens. Adicionalmente, o programa tent…☆12Aug 13, 2021Updated 5 years ago
- Fast model deployment on AWS Lambda☆15Feb 25, 2024Updated 2 years ago
- [ICAIF 2024] Official implementation of "Stock Recommendations for Individual Investors: A Temporal Graph Network Approach with Mean-Vari…☆21Oct 21, 2025Updated 10 months ago
- Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.☆12,528Aug 31, 2026Updated last week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Fine-tune an LLM to perform batch inference and online serving.☆123May 29, 2025Updated last year
- VS Code extension for create remote workstations (sessions) using ClearML.☆16Mar 14, 2024Updated 2 years ago
- Reward Model을 이용하여 언어모델의 답변을 평가하기☆30Feb 23, 2024Updated 2 years ago
- A high performance batching router optimises max throughput for text inference workload☆16Sep 6, 2023Updated 3 years ago
- This is a boilerplate which has dependencies for pyspark(3.3.0) mongo(>4.x) connectivity☆10May 3, 2024Updated 2 years ago
- vLLM adapter for a TGIS-compatible gRPC server.☆58Updated this week
- GAP-text2SQL: Learning Contextual Representations for Semantic Parsing with Generation-Augmented Pre-Training☆31May 23, 2024Updated 2 years ago
- ☆107Sep 9, 2024Updated last year
- ☆12Jan 24, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- AIME API Server - Scalable AI Model Inference API Server☆15Sep 19, 2025Updated 11 months ago
- ☆48Nov 8, 2023Updated 2 years ago
- 🐳 Build OCI images for Bentos in k8s☆19Jul 14, 2026Updated last month
- 🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.☆233Aug 4, 2026Updated last month
- Implementation of VisionLLaMA from the paper: "VisionLLaMA: A Unified LLaMA Interface for Vision Tasks" in PyTorch and Zeta☆15Nov 11, 2024Updated last year
- Pixel Parsing. A reproduction of OCR-free end-to-end document understanding models with open data☆25Jul 30, 2024Updated 2 years ago
- Make codex, gemini-cli, or any other coding agent into an RLM.☆20Feb 27, 2026Updated 6 months ago