A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.
☆79Apr 6, 2024Updated 2 years ago
Alternatives and similar repositories for ray_vllm_inference
Users that are interested in ray_vllm_inference are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆14May 25, 2023Updated 3 years ago
- RIVF 2021: Deep neural network based learning to rank for address standardization☆10Jul 13, 2024Updated 2 years ago
- RayLLM - LLMs on Ray (Archived). Read README for more info.☆1,261Mar 13, 2025Updated last year
- ☆21Aug 10, 2026Updated last week
- BigBertha is an architecture design that demonstrates how automated LLMOps (Large Language Models Operations) can be achieved on any Kube…☆28Oct 27, 2023Updated 2 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- MLFlow Deployment Plugin for Ray Serve☆47Apr 12, 2022Updated 4 years ago
- Deprecated Browserbase Python SDK☆10Nov 1, 2024Updated last year
- This is suite of the hands-on training materials that shows how to scale CV, NLP, time-series forecasting workloads with Ray.☆460Feb 13, 2024Updated 2 years ago
- Pandora Java SDK 多种方式灵活接入Pandora 大数据平台☆12Jun 22, 2022Updated 4 years ago
- RLVR Testing and Training☆21Aug 28, 2025Updated 11 months ago
- Pretrain, finetune and serve LLMs on Intel platforms with Ray☆129Sep 23, 2025Updated 10 months ago
- Finetune multiple pre-trained Transformer-based models to solve Vietnamese Fake News Detection problem (ReINTEL) in VLSP2020 shared task☆18Dec 16, 2020Updated 5 years ago
- FlexOS is a Unikraft-based OS allowing users to easily specialize the safety and isolation strategy at compilation time.☆24Jun 2, 2023Updated 3 years ago
- A Rust crate offering similar functionality to the Python transformers package using Candle.☆15Nov 19, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Using Siamese LSTM to classify repeated quora questions. Attempted pretrained bert embeddings, Word2Vec and training own embeddings toget…☆10Aug 28, 2020Updated 5 years ago
- Codebase, data and models for the Headline Grouping paper at NAACL2021☆12Oct 2, 2022Updated 3 years ago
- Reading comprehension based question-answering model for news articles.☆11Jun 22, 2022Updated 4 years ago
- Example create-t3-app with AWS S3 presigned URL integration☆30Jan 20, 2023Updated 3 years ago
- Karmada APIs☆16Mar 10, 2026Updated 5 months ago
- 3D Mesh Generation from 2D Images in Python☆13Feb 12, 2024Updated 2 years ago
- ☆19Jan 10, 2023Updated 3 years ago
- A web interface for SleekDB written in PHP☆11Jan 22, 2022Updated 4 years ago
- end-to-end information extraction pipeline built by LayoutLMV2, pretrained model from HuggingFace☆11Aug 15, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆10Sep 5, 2024Updated last year
- A demo and tutorial for Council that implements a financial analyst agent.☆11Jun 21, 2024Updated 2 years ago
- kapi provides a simplified interface to the controller-runtime library.☆26Aug 20, 2025Updated 11 months ago
- ☆14Sep 18, 2024Updated last year
- ☆91Oct 2, 2023Updated 2 years ago
- Vietnamese Drink Ordering Chatbot = Intent classification + Context Handler+ Address fuzzy matching + Facebook Built-in NLP☆17Dec 18, 2021Updated 4 years ago
- This repo contains the code for the tutorial for using the CrewAI agent framework to generate Sales Reports based on Salesforce data☆13Mar 16, 2024Updated 2 years ago
- Injector trait as a webhook to inject data into Workload.☆15Apr 14, 2021Updated 5 years ago
- The implementation for "DEER: Descriptive Knowledge Graph for Explaining Entity Relationships" (EMNLP '22)☆11Oct 31, 2022Updated 3 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- A simple website to manage your Hyper-V VMs and IIS sites☆12Jan 19, 2023Updated 3 years ago
- A minecraft classic server written in C#☆16Apr 9, 2012Updated 14 years ago
- Trino On K8S Via Helm & Metastore Workshop Querying Delta Tables☆11Jan 27, 2025Updated last year
- repo of files pertaining to realtime, offline translations using whisper realtime and argos translate. This repo is marked Creative Commo…☆19May 20, 2025Updated last year
- ☆26Dec 31, 2023Updated 2 years ago
- A repository for the blog 'Lambda Custom Runtime'☆16Nov 30, 2018Updated 7 years ago
- Locality-Sensitive Hashing for Minhash Signatures☆12Sep 12, 2013Updated 12 years ago