☆68Mar 28, 2025Updated last year
Alternatives and similar repositories for vllm-docker
Users that are interested in vllm-docker are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆18Aug 19, 2024Updated last year
- Experimenting text-embeddings-inference server on both CPU and GPU☆18Oct 25, 2023Updated 2 years ago
- vLLM client with minimal dependencies☆15Feb 28, 2024Updated 2 years ago
- OpenAI compatible API for open source LLMs☆16Oct 30, 2023Updated 2 years ago
- LLMs as Collaboratively Edited Knowledge Bases☆53Feb 8, 2026Updated 5 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- 🚀 LLM inference optimization simulator, modeling compute-bound prefill and memory-bound decode phases.☆14Jul 12, 2025Updated last year
- ☆12Dec 8, 2020Updated 5 years ago
- AI_Powered_Dev_Search_Engine☆12Mar 10, 2024Updated 2 years ago
- A Scheduler for Batched LLM Inference☆19Oct 5, 2025Updated 9 months ago
- A high performance batching router optimises max throughput for text inference workload☆16Sep 6, 2023Updated 2 years ago
- Applying Evaluation Driven Development (EDD) to aid in the design decision of RAG pipelines☆31Oct 20, 2023Updated 2 years ago
- Substitute types with other types to e.g. intercept generated code☆17May 28, 2026Updated 2 months ago
- experiments with inference on llama☆103Jun 6, 2024Updated 2 years ago
- operator that tracks SelinuxPolicy objects in certain namespaces.☆12Jun 26, 2022Updated 4 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆14Jul 26, 2019Updated 7 years ago
- ☆27Aug 31, 2023Updated 2 years ago
- ☆12Dec 24, 2024Updated last year
- A Machine Learning Framework for High Performance written in Rust☆28Sep 1, 2022Updated 3 years ago
- Authenticating HTTP(S) proxy with TCP/IP tunneling and acceleration—mirror of http://svn.awk.cz/cntlm☆15Jan 21, 2013Updated 13 years ago
- Turkish Translation of Gentle Intro | "Gentle Intro'nun Türkçe" çevirisi☆13Jan 31, 2023Updated 3 years ago
- DKMS packaging source for NVIDIA kernel modules on RHEL☆10Jun 28, 2023Updated 3 years ago
- main repo for the churro file/API processor☆14Nov 3, 2021Updated 4 years ago
- bundled swagger-ui pip package☆21Sep 4, 2025Updated 10 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Demo that extends the FastUI example & adds database persistence☆17Jan 2, 2024Updated 2 years ago
- how to build a sentence embedding application using BentoML☆15Jul 14, 2026Updated 2 weeks ago
- Memory-bounded compressed sparse attention via streaming top-k. Triton kernels for the DeepSeek-V4 lightning indexer. 32x regime extensio…☆23May 5, 2026Updated 2 months ago
- A Bevy friendly wrapper of Box2D and LiquidFun.☆10Aug 14, 2024Updated last year
- Helm Charts to Deploy Apache Drill on Kubernetes☆17Jan 5, 2024Updated 2 years ago
- TensorCraft is an AIO server for Keras models☆12Mar 25, 2023Updated 3 years ago
- OpenAI compatible API for TensorRT LLM triton backend☆221Aug 1, 2024Updated last year
- ☆14Nov 15, 2019Updated 6 years ago
- ☆12Jun 17, 2025Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- TensorRT-LLM server with Structured Outputs (JSON) built with Rust☆71Apr 25, 2025Updated last year
- A stable, fast and easy-to-use inference library with a focus on a sync-to-async API☆48Sep 26, 2024Updated last year
- 修改 pyTranscriber 得到 cli 版的 mypyTranscriber☆11Jun 9, 2021Updated 5 years ago
- The API Gateway & Microservice Management Layer, built on NGINX☆11Jul 5, 2018Updated 8 years ago
- IBM development fork of https://github.com/huggingface/text-generation-inference☆65Sep 18, 2025Updated 10 months ago
- JsonTuning: Towards Generalizable, Robust, and Controllable Instruction Tuning☆10Nov 3, 2024Updated last year
- Code for "AtTGen: Attribute Tree Generation for Real-World Attribute Joint Extraction", ACL 2023☆13May 19, 2023Updated 3 years ago