Benchmarking the serving capabilities of vLLM
☆59Aug 20, 2024Updated 2 years ago
Alternatives and similar repositories for vllm-benchmark
Users that are interested in vllm-benchmark are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Demo code for Gemini Live Integration☆13Jul 29, 2025Updated last year
- The Security Toolkit for managing Generative AI(especially LLMs) and Supervised Learning processes(Learning and Inference).☆23Jun 25, 2025Updated last year
- 在PyTorch上 重构multi-agent deep deterministic policy gradient(MADDPG)，将https://github.com/xuemei-ye/maddpg-mpe 修改到自己电脑上可运行。因为本人笔记本没有CUDA，实验速度…☆14May 10, 2019Updated 7 years ago
- ☆14Jan 7, 2025Updated last year
- The driver for LMCache core to run in vLLM☆69Feb 4, 2025Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Use smol agents to do research and then update csv coumns with its findings.☆42Jan 30, 2025Updated last year
- Flutter embedder for Tizen☆13Updated this week
- Unofficial implementation of the Ask-LLM paper 'How to Train Data-Efficient LLMs', arXiv:2402.09668.☆12Jun 19, 2024Updated 2 years ago
- SKT A.X LLM 3.1☆13Jul 24, 2025Updated last year
- ☆22Updated this week
- A web interface for SleekDB written in PHP☆11Jan 22, 2022Updated 4 years ago
- Reinforcement Learning in LLM Tutorial (Python) from scratch☆36Jan 28, 2026Updated 8 months ago
- MOTIF: Modular Thinking via Reinforcement Fine-tuning in LLMs☆17Jul 6, 2025Updated last year
- A simple cycle accurate template model for ASIC/FPGA hardware design. Including a cycle accurate FIFO design example. More designs are co…☆17Sep 5, 2019Updated 7 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆14Sep 18, 2024Updated 2 years ago
- ☆25Jan 28, 2026Updated 7 months ago
- My Gen AI research☆11Jun 3, 2024Updated 2 years ago
- A hardware accelerated IP packet forwarder running on programmable ICs☆15Jan 21, 2023Updated 3 years ago
- A simple website to manage your Hyper-V VMs and IIS sites☆12Jan 19, 2023Updated 3 years ago
- A vllm proxy server to add security and multi model management for vllm servers☆12May 30, 2024Updated 2 years ago
- a fun and educational take on vLLM☆228Jan 25, 2026Updated 8 months ago
- This repository contains a Python implementation that allows you to use gorilla-llm/gorilla-openfunctions-v2 LLM to perform function call…☆17Apr 7, 2024Updated 2 years ago
- Automatic Thief Detection via CCTV with Alarm System and Perpetrator Image Capture using YOLOv5 + ROI. This project utilizes computer vis…☆22Oct 21, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆32Sep 19, 2025Updated last year
- Little RISC-V 3-stage Pipeline CPU☆16Jun 14, 2021Updated 5 years ago
- Evaluate gpt-4o on CLIcK (Korean NLP Dataset)☆20May 18, 2024Updated 2 years ago
- A dual-chatbot system for learning languages based on LangChain☆14Jun 25, 2023Updated 3 years ago
- FlappyBird愤怒的小鸟 c++游戏实现 学习代码☆10Nov 16, 2018Updated 7 years ago
- ☆156Sep 15, 2026Updated last week
- Custom extensions to the RISC-V isa simulator for the UCB-BAR ESP project☆17Nov 27, 2022Updated 3 years ago
- ☆18Sep 16, 2026Updated last week
- Final Project for Digital Systems Design Course, Fall 2020☆17Jul 20, 2022Updated 4 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- A modified version of searx (the privacy-respecting metasearch engine) to only search an allowlist of sites, to build functionality simil…☆19Sep 17, 2021Updated 5 years ago
- ☆21Jun 4, 2024Updated 2 years ago
- ☆10Oct 2, 2024Updated last year
- RTL generator for SpGEMM☆13Feb 2, 2021Updated 5 years ago
- ☆19Jun 3, 2019Updated 7 years ago
- IBM development fork of https://github.com/huggingface/text-generation-inference☆67Sep 18, 2025Updated last year
- Lighter, cheaper and faster RAG toolkit (Graph RAG) supported by TargetPilot☆48Jun 9, 2025Updated last year