substratusai / vllm-dockerLinks
☆64Updated 6 months ago
Alternatives and similar repositories for vllm-docker
Users that are interested in vllm-docker are comparing it to the libraries listed below
Sorting:
- Self-host LLMs with vLLM and BentoML☆152Updated 2 weeks ago
- A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.☆73Updated last year
- Machine Learning Serving focused on GenAI with simplicity as the top priority.☆58Updated 2 weeks ago
- Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models☆110Updated 6 months ago
- A collection of all available inference solutions for the LLMs☆91Updated 7 months ago
- ☆18Updated last year
- 🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.☆139Updated last year
- ☆197Updated last year
- Using LlamaIndex with Ray for productionizing LLM applications☆71Updated 2 years ago
- IBM development fork of https://github.com/huggingface/text-generation-inference☆61Updated last month
- TitanML Takeoff Server is an optimization, compression and deployment platform that makes state of the art machine learning models access…☆114Updated last year
- vLLM adapter for a TGIS-compatible gRPC server.☆41Updated this week
- Data preparation code for Amber 7B LLM☆93Updated last year
- Deployment a light and full OpenAI API for production with vLLM to support /v1/embeddings with all embeddings models.☆44Updated last year
- ☆51Updated last year
- Tutorial for building LLM router☆231Updated last year
- Large Language Model Hosting Container☆90Updated 2 weeks ago
- Notus is a collection of fine-tuned LLMs using SFT, DPO, SFT+DPO, and/or any other RLHF techniques, while always keeping a data-first app…☆169Updated last year
- Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platform☆90Updated last month
- Just a bunch of benchmark logs for different LLMs☆118Updated last year
- ☆79Updated 9 months ago
- Simple examples using Argilla tools to build AI☆56Updated 11 months ago
- The backend behind the LLM-Perf Leaderboard☆11Updated last year
- experiments with inference on llama☆103Updated last year
- Tutorial to get started with SkyPilot!☆57Updated last year
- Develop, evaluate and monitor LLM applications at scale☆98Updated 10 months ago
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆78Updated 11 months ago
- Benchmarking the serving capabilities of vLLM☆54Updated last year
- Mixing Language Models with Self-Verification and Meta-Verification☆109Updated 10 months ago
- An OpenAI Completions API compatible server for NLP transformers models☆64Updated last year