☆68Mar 28, 2025Updated last year
Alternatives and similar repositories for vllm-docker
Users that are interested in vllm-docker are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆19Aug 19, 2024Updated 2 years ago
- Official code for our paper "Sink-Aware Pruning for Diffusion Language Models"☆13Feb 26, 2026Updated 8 months ago
- Experimenting text-embeddings-inference server on both CPU and GPU☆17Oct 25, 2023Updated 3 years ago
- vLLM adapter for a TGIS-compatible gRPC server.☆59Updated this week
- Loader extension for tabbyAPI in SillyTavern☆27Jun 30, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Applying Evaluation Driven Development (EDD) to aid in the design decision of RAG pipelines☆31Oct 20, 2023Updated 3 years ago
- Python client for PromptWatch.io - LLM tracking platform☆29Oct 8, 2025Updated last year
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆32Sep 19, 2025Updated last year
- ☆13Aug 30, 2025Updated last year
- fused MoE kernel in Candle backend☆14Feb 3, 2026Updated 9 months ago
- Stateful LLM Serving☆111Mar 11, 2025Updated last year
- A stable, fast and easy-to-use inference library with a focus on a sync-to-async API☆46Sep 26, 2024Updated 2 years ago
- Graph model execution API for Candle☆19Jul 27, 2025Updated last year
- Python wrapper for the WFG Hypervolume implementations☆10Sep 3, 2024Updated 2 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- 基于 CUDA Driver API 的 cuda 运行时环境☆16Jul 30, 2025Updated last year
- Mistral-7B finetuned for function calling☆17Jan 28, 2024Updated 2 years ago
- a lightweight, open-source blueprint for building powerful and scalable LLM chat applications☆28Jun 7, 2024Updated 2 years ago
- LLM inference optimization simulator☆13Jul 12, 2025Updated last year
- End-to-end MLOps platform for spell correction: DVC, Docker, GitHub Actions CI/CD, GHCR publishing, Cosign signing, Flask serving.☆11Oct 14, 2026Updated last month
- Yaraa (Yet Another Rag Automation Attempt) is a library that tackles the boring aspects of managing Rag pipelines, so you don't have to.☆25Sep 5, 2024Updated 2 years ago
- The Open-Source Implementation of Cognition AI's Automated Software Engineer, Devin.☆16Mar 13, 2024Updated 2 years ago
- Prompt Jinja2 templates for LLMs☆36Jul 9, 2025Updated last year
- A Scheduler for Batched LLM Inference☆19Oct 5, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- AI_Powered_Dev_Search_Engine☆12Mar 10, 2024Updated 2 years ago
- Code and data accompanying the paper "Quantum Approximate Multi-Objective Optimization"☆17Aug 14, 2025Updated last year
- Fullstack Reddit Clone Made With React+Redux & Django☆12Sep 26, 2023Updated 3 years ago
- 친구가 풀길래 나도 풀어보는 Baekjoon Online Judge☆10May 24, 2020Updated 6 years ago
- A 🔥 cookiecutter template for building Hugging Face Spaces☆12Nov 23, 2021Updated 4 years ago
- Course submission material for Lidar point cloud based 3D Detection using Yolo for Udacity Self Driving Nanodegree☆10Jun 15, 2021Updated 5 years ago
- A high performance batching router optimises max throughput for text inference workload☆16Sep 6, 2023Updated 3 years ago
- Prediction of the activity of molecules/ligands that have been tested to bind or not bind to Beta-Lactamases using machine learning cl…☆10Mar 5, 2026Updated 8 months ago
- TLLM_QMM strips the implementation of quantized kernels of Nvidia's TensorRT-LLM, removing NVInfer dependency and exposes ease of use Pyt…☆16Jul 5, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Speaks using the Web Speech API.☆14Oct 5, 2026Updated last month
- ☆28May 3, 2023Updated 3 years ago
- ☆58Nov 18, 2024Updated 2 years ago
- PhysReason Becnhmark☆19Jul 8, 2025Updated last year
- video players in the terminal with blockish over libcaca with LD_PRELOAD magic☆10Oct 16, 2023Updated 3 years ago
- command line semantic text search tool☆12Jun 22, 2021Updated 5 years ago
- experiments with inference on llama☆103Jun 6, 2024Updated 2 years ago
Are these results useful?