☆68Mar 28, 2025Updated last year
Alternatives and similar repositories for vllm-docker
Users that are interested in vllm-docker are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆18Aug 19, 2024Updated last year
- vLLM client with minimal dependencies☆15Feb 28, 2024Updated 2 years ago
- Python client for PromptWatch.io - LLM tracking platform☆29Oct 8, 2025Updated 10 months ago
- OpenAI compatible API for open source LLMs☆16Oct 30, 2023Updated 2 years ago
- Graph model execution API for Candle☆18Jul 27, 2025Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- vLLM adapter for a TGIS-compatible gRPC server.☆58Updated this week
- 🚀 LLM inference optimization simulator, modeling compute-bound prefill and memory-bound decode phases.☆13Jul 12, 2025Updated last year
- A powerful and user-friendly tool that generates detailed captions for your images☆21Nov 11, 2024Updated last year
- A Scheduler for Batched LLM Inference☆19Oct 5, 2025Updated 10 months ago
- A high performance batching router optimises max throughput for text inference workload☆16Sep 6, 2023Updated 2 years ago
- Applying Evaluation Driven Development (EDD) to aid in the design decision of RAG pipelines☆31Oct 20, 2023Updated 2 years ago
- ITIX's Custom CoreOS build☆10Nov 24, 2020Updated 5 years ago
- Get deterministic output in any format like json from any LLM.☆19Apr 25, 2023Updated 3 years ago
- Course submission material for Lidar point cloud based 3D Detection using Yolo for Udacity Self Driving Nanodegree☆10Jun 15, 2021Updated 5 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Fullstack Reddit Clone Made With React+Redux & Django☆12Sep 26, 2023Updated 2 years ago
- experiments with inference on llama☆103Jun 6, 2024Updated 2 years ago
- Expand CIDRs or wrangle a list of IPs back to its smallest CIDR blocks possible☆10Apr 5, 2020Updated 6 years ago
- ☆14Jul 26, 2019Updated 7 years ago
- ☆12Dec 24, 2024Updated last year
- Turkish Translation of Gentle Intro | "Gentle Intro'nun Türkçe" çevirisi☆13Jan 31, 2023Updated 3 years ago
- kernel spec, config for vanilla kernel rpms from kernel.org☆10Jan 24, 2022Updated 4 years ago
- Create embeddings for LLM using the Nomic API☆23Nov 21, 2024Updated last year
- ☆12Dec 6, 2021Updated 4 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- A Paint.NET filetype plugin that loads the PSX TIM format.☆10Aug 2, 2025Updated last year
- Learn Agentic AI using CrewAI, LangChain, LangGraph, and Knowledge Graphs.☆12Feb 19, 2025Updated last year
- Sync Consul registry to Calico GlobalNetworkSet☆13Jan 6, 2022Updated 4 years ago
- main repo for the churro file/API processor☆14Nov 3, 2021Updated 4 years ago
- ZED LiveLink Plugin for Unreal☆39Jul 31, 2026Updated 2 weeks ago
- Simple HAProxy configuration linter☆10Apr 26, 2016Updated 10 years ago
- Memory-bounded compressed sparse attention via streaming top-k. Triton kernels for the DeepSeek-V4 lightning indexer. 32x regime extensio…☆24May 5, 2026Updated 3 months ago
- TensorCraft is an AIO server for Keras models☆12Mar 25, 2023Updated 3 years ago
- OpenAI compatible API for TensorRT LLM triton backend☆221Aug 1, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Self-hosted LLM chatbot arena, with yourself as the only judge☆41Feb 6, 2024Updated 2 years ago
- ☆12Jun 17, 2025Updated last year
- Examples of demo deployment using Gradio. Image Classification, Live Webcam Segmentation, APIs , Tunneling etc.☆17Oct 17, 2022Updated 3 years ago
- A stable, fast and easy-to-use inference library with a focus on a sync-to-async API☆48Sep 26, 2024Updated last year
- $ curl -sL sub.sh | bash☆17Aug 7, 2023Updated 3 years ago
- The API Gateway & Microservice Management Layer, built on NGINX☆11Jul 5, 2018Updated 8 years ago
- Benchmark suite for LLMs from Fireworks.ai☆111Updated this week