Alternatives and similar repositories for vllm-docker:

Users that are interested in vllm-docker are comparing it to the libraries listed below

• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆100Updated this week
• aniketmaurya / fastserve-ai
  Machine Learning Serving focused on GenAI with simplicity as the top priority.
  ☆58Updated last week
• flowaicom / flow-judge
  Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…
  ☆66Updated 5 months ago
• ai-hero / llm-research-fine-tuning
  ☆16Updated 10 months ago
• ianhohoho / auto-hyde
  🔎 A deep-dive into HyDE for Advanced LLM RAG + 💡 Introducing AutoHyDE, a semi-supervised framework to improve the effectiveness, covera…
  ☆32Updated last year
• substratusai / helm
  ☆18Updated 7 months ago
• fw-ai / benchmark
  Benchmark suite for LLMs from Fireworks.ai
  ☆70Updated 2 months ago
• louisbrulenaudet / ragoon
  High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡
  ☆67Updated 5 months ago
• nyunAI / PruneGPT
  ☆53Updated 10 months ago
• IlyasMoutawwakil / llm-perf-backend
  The backend behind the LLM-Perf Leaderboard
  ☆10Updated 11 months ago
• S1M0N38 / dspy-arxiv
  Explore the use of DSPy for extracting features from PDFs 🔎
  ☆39Updated last year
• asprenger / ray_vllm_inference
  A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.
  ☆65Updated last year
• jquesnelle / transformers-openai-api
  An OpenAI Completions API compatible server for NLP transformers models
  ☆65Updated last year
• TheBlokeAI / AIScripts
  Some simple scripts that I use day-to-day when working with LLMs and Huggingface Hub
  ☆159Updated last year
• michaelfeil / embed
  A stable, fast and easy-to-use inference library with a focus on a sync-to-async API
  ☆45Updated 6 months ago
• qdrant / bm42_eval
  Evaluation of bm42 sparse indexing algorithm
  ☆65Updated 9 months ago
• weaviate / structured-rag
  Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models
  ☆105Updated this week
• cognitivecomputations / kraken
  ☆66Updated 10 months ago
• premAI-io / benchmarks
  🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.
  ☆136Updated 8 months ago
• etalab-ia / albert-models
  Deployment a light and full OpenAI API for production with vLLM to support /v1/embeddings with all embeddings models.
  ☆42Updated 8 months ago
• SalesforceAIResearch / SFR-RAG
  ☆74Updated 3 months ago
• shivamsanju / ragswift
  🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform
  ☆38Updated last year
• amogkam / llama_index_ray
  Using LlamaIndex with Ray for productionizing LLM applications
  ☆71Updated last year
• l4b4r4b4b4 / AIDocks
  LLM-Training-API: Including Embeddings & ReRankers, mergekit, LaserRMT
  ☆27Updated last year
• plaggy / rag-containers
  Ready-to-go containerized RAG service. Implemented with text-embedding-inference + Qdrant/LanceDB.
  ☆63Updated 3 months ago
• anyscale / llm-router
  Tutorial for building LLM router
  ☆193Updated 8 months ago
• interstellarninja / function-calling-eval
  A framework for evaluating function calls made by LLMs
  ☆37Updated 8 months ago
• swj0419 / detect-pretrain-code-contamination
  ☆74Updated last year
• GreenBitAI / green-bit-llm
  A toolkit for fine-tuning, inferencing, and evaluating GreenBitAI's LLMs.
  ☆82Updated last month
• enjalot / latent-data-modal
  Using modal.com to process FineWeb-edu data
  ☆20Updated last week