A high-throughput and memory-efficient inference and serving engine for LLMs
☆32Sep 18, 2026Updated last month
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Transform unstructured documents into actionable, structured data with enterprise-grade precision and reliability, ready for large-scale …☆22Oct 13, 2025Updated last year
- ☆17May 19, 2022Updated 4 years ago
- HIP/ROCm fork optimized for AMD RDNA2 (gfx1030) with PrismML Q1_0_G128 1-bit quant support, RotorQuant, TurboQuant, EAGLE3 and P-EAGLE sp…☆26Jun 23, 2026Updated 3 months ago
- ☆15Oct 20, 2024Updated last year
- Run a portable Chromium using dotnet 8+ and nuget.☆16Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆16Jul 23, 2026Updated 2 months ago
- ☆14Nov 29, 2024Updated last year
- Advanced terminal tool for pentest and bug bounty, integrating OpenAI and DeepSeek APIs to assist security researchers with command execu…☆15Apr 5, 2026Updated 6 months ago
- A reference app using the ragie python SDK☆10Jun 11, 2025Updated last year
- Virtual host bruteforcer against given network range or single ip☆11Mar 21, 2019Updated 7 years ago
- A fork (and mirror) of the Buffer Overflow Module created by NSF Award No. 0113627☆12Feb 11, 2017Updated 9 years ago
- MiMo: Unlocking the Reasoning Potential of Language Model – From Pretraining to Posttraining☆2,389Jun 5, 2025Updated last year
- 𝐀 𝐅𝐨𝐫𝐤 𝐨𝐟 𝐂𝐡𝐢𝐜𝐚𝐠𝐨𝟗𝟓 𝐦𝐚𝐝𝐞 𝐭𝐨 𝐥𝐨𝐨𝐤 𝐥𝐢𝐤𝐞 𝐖𝐢𝐧𝐝𝐨𝐰𝐬 𝟐𝟎𝟎𝟎.☆22Sep 1, 2026Updated last month
- ☆13May 9, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- using (Laravel 7.0, Tailwind Css, Nuxt.js, Vue Js, Bootstrap 4+, Ajax, Movie rest Api ,Rest Client)☆11Jan 6, 2023Updated 3 years ago
- CLI to download wallpapers and lock screens from 500px website.☆11Feb 23, 2023Updated 3 years ago
- frame is an open source portifolio builder for developers where developers can add and manage their information, project, articles and mo…☆14Dec 24, 2024Updated last year
- CVE-2023-2640 CVE-2023-32629☆13Aug 15, 2023Updated 3 years ago
- On the effectiveness of adversarial training against common corruptions [UAI 2022]☆30May 16, 2022Updated 4 years ago
- For sharing files☆15Jul 17, 2025Updated last year
- OpenAI Security Console - Python3 AI-powered Cybersecurity Framework☆17Mar 25, 2023Updated 3 years ago
- Brute Force attack with Python in Kali Linux☆14Mar 6, 2022Updated 4 years ago
- A python script to download embedded (hidden) vimeo videos on websites☆11May 17, 2021Updated 5 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Lightweight coding agent that runs in your terminal with any Model☆14Apr 17, 2025Updated last year
- PyTorch implementation of our ECCV 2022 paper "Rethinking Confidence Calibration for Failure Prediction"☆26Jun 10, 2023Updated 3 years ago
- 批量下载微博高清原图的代码，本代码用Python写的，需要电脑预装Python。☆11Feb 8, 2022Updated 4 years ago
- ncnn export & infer mobileclip☆20Aug 18, 2025Updated last year
- Fully open reproduction of DeepSeek-R1☆11Mar 24, 2025Updated last year
- Dominate the Active Directory game. An Active Directory environments pentest tool complementary to existing ones like NetExec.☆20Sep 15, 2026Updated last month
- PotPlayer in PortableApps.com Format☆23Aug 1, 2026Updated 2 months ago
- SGLang is a fast serving framework for large language models and vision language models.☆16Mar 31, 2026Updated 6 months ago
- ☆10Mar 24, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Tengine 管子是用来快速生产 demo 的辅助工具☆11Jul 15, 2021Updated 5 years ago
- 小红书数据采集、小红书素材下载工具，支持文本、图片(原高清图片)、原视频等素材下载，是一款完全免费、超好用、高颜值且安全的素材收集工具，支持批量下载☆16Jul 13, 2026Updated 3 months ago
- 苏丹的游戏的高清卡片图像，通过苏丹的游戏wiki获取素材并制作。Chinese card images of sultan's game.☆14Jun 17, 2025Updated last year
- Open-source advanced cracking tool made in Electron.JS☆20Jul 7, 2020Updated 6 years ago
- Repo para projeto de Verificação de força de senha do vídeo do YT☆13May 7, 2024Updated 2 years ago
- Real-time AI video segmentation of USB camera and streaming over HTTP☆14Apr 23, 2025Updated last year
- 微信(逆向)信息获取DLL☆13Sep 17, 2019Updated 7 years ago