A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.
☆79Apr 6, 2024Updated 2 years ago
Alternatives and similar repositories for ray_vllm_inference
Users that are interested in ray_vllm_inference are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆17Mar 24, 2023Updated 3 years ago
- RIVF 2021: Deep neural network based learning to rank for address standardization☆10Jul 13, 2024Updated 2 years ago
- RayLLM - LLMs on Ray (Archived). Read README for more info.☆1,261Mar 13, 2025Updated last year
- datax的elasticsearch插件，主要是reader插件，writer插件官网已经实现了。适用于es7.x☆10Mar 6, 2021Updated 5 years ago
- MLFlow Deployment Plugin for Ray Serve☆47Apr 12, 2022Updated 4 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Node.js bindings for the Mathematical Expression Toolkit☆15Jun 22, 2026Updated 2 months ago
- Deprecated Browserbase Python SDK☆10Nov 1, 2024Updated last year
- This is suite of the hands-on training materials that shows how to scale CV, NLP, time-series forecasting workloads with Ray.☆459Feb 13, 2024Updated 2 years ago
- Pandora Java SDK 多种方式灵活接入Pandora 大数据平台☆12Jun 22, 2022Updated 4 years ago
- This is the code repository for our work on resourcing-on-demand GPU provisioning for serverless deep learning serving.☆17Apr 17, 2026Updated 4 months ago
- LLM query engine to retrieve augmented responses from json files.☆15Oct 12, 2023Updated 2 years ago
- Github repo for Peifeng's internship project☆13Nov 7, 2023Updated 2 years ago
- RLVR Testing and Training☆21Aug 28, 2025Updated last year
- Pretrain, finetune and serve LLMs on Intel platforms with Ray☆129Sep 23, 2025Updated 11 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Finetune multiple pre-trained Transformer-based models to solve Vietnamese Fake News Detection problem (ReINTEL) in VLSP2020 shared task☆18Dec 16, 2020Updated 5 years ago
- Automated tool to formally verify congestion control algorithms and find bugs in them☆28Oct 4, 2022Updated 3 years ago
- FlexOS is a Unikraft-based OS allowing users to easily specialize the safety and isolation strategy at compilation time.☆24Jun 2, 2023Updated 3 years ago
- Code release for "MORE: Multi-mOdal REtrieval Augmented Generative Commonsense Reasoning"☆11Oct 11, 2024Updated last year
- A browser extension to automatically extract and batch-copy transcripts from Udemy videos. Perfect for students and learners who use note…☆20Jun 14, 2026Updated 2 months ago
- A Rust crate offering similar functionality to the Python transformers package using Candle.☆15Nov 19, 2024Updated last year
- API Extensions for core KubeVela.☆14Aug 21, 2026Updated 2 weeks ago
- Using Siamese LSTM to classify repeated quora questions. Attempted pretrained bert embeddings, Word2Vec and training own embeddings toget…☆10Aug 28, 2020Updated 6 years ago
- Karmada APIs☆17Mar 10, 2026Updated 5 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Triton backend for https://github.com/OpenNMT/CTranslate2☆11Aug 20, 2024Updated 2 years ago
- ☆20Dec 15, 2023Updated 2 years ago
- Open source RAG with Llama Index for Japanese LLM in low resource settting☆10May 12, 2025Updated last year
- A web interface for SleekDB written in PHP☆11Jan 22, 2022Updated 4 years ago
- POC integration Airbyte+Dagster+Langchain☆13Jun 1, 2023Updated 3 years ago
- end-to-end information extraction pipeline built by LayoutLMV2, pretrained model from HuggingFace☆11Aug 15, 2023Updated 3 years ago
- A production-ready multi-tenant RAG as a Service (RaaS) orchestrator☆31Nov 10, 2025Updated 9 months ago
- Explore Multiple Vector Databases and chat with documents on Multiple LLM models, private LLM models☆47Jun 1, 2023Updated 3 years ago
- Blogging with Emacs and AI☆11Jun 4, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Atlabs is a storytelling-first video creation platform that helps businesses craft engaging videos in minutes using AI. No creative or te…☆11Jul 8, 2024Updated 2 years ago
- Android app for the fieldworkers.☆11Updated this week
- kapi provides a simplified interface to the controller-runtime library.☆26Aug 20, 2025Updated last year
- Newspaper Segmentation into images and text☆12Jan 11, 2019Updated 7 years ago
- An offline CPU-first low-resource chat application to perform RAG on your corpus of data. Powered by OpenChat and CTranslate2.☆15May 14, 2025Updated last year
- ☆14Sep 18, 2024Updated last year
- ☆91Oct 2, 2023Updated 2 years ago