A high-throughput and memory-efficient inference and serving engine for LLMs
☆32Sep 18, 2026Updated last week
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆17May 19, 2022Updated 4 years ago
- ☆13Jun 10, 2022Updated 4 years ago
- ☆16Aug 4, 2024Updated 2 years ago
- PyTorch implementation of our CVPR2023 paper "OpenMix: Exploring Out-of-Distribution samples for Misclassification Detection"☆28Oct 16, 2023Updated 2 years ago
- Handy tools & graphics API abstraction for blazing fast prototyping☆10Jan 17, 2024Updated 2 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- On the effectiveness of adversarial training against common corruptions [UAI 2022]☆30May 16, 2022Updated 4 years ago
- Golang bindings for FFmpeg libraries☆11Feb 4, 2022Updated 4 years ago
- ncnn export & infer mobileclip☆20Aug 18, 2025Updated last year
- ☆21Apr 13, 2022Updated 4 years ago
- 将 rqalpha 的事件引擎替换为异步的队列事件引擎，可用于模拟交易和实盘。☆11Oct 22, 2017Updated 8 years ago
- [NeurIPS 2021] Better Safe Than Sorry: Preventing Delusive Adversaries with Adversarial Training☆32Jan 9, 2022Updated 4 years ago
- 北京交通大学博士学位论文Latex模板☆12Aug 28, 2023Updated 3 years ago
- Awesome Resources about MegEngine☆16Mar 2, 2023Updated 3 years ago
- Fully open reproduction of DeepSeek-R1☆11Mar 24, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆10Mar 24, 2024Updated 2 years ago
- Easy to download and parse version of the Smartdoc 2015 - Challenge 1 dataset.☆19Mar 5, 2018Updated 8 years ago
- Tengine 管子是用来快速生产 demo 的辅助工具☆11Jul 15, 2021Updated 5 years ago
- 苏丹的游戏的高清卡片图像，通过苏丹的游戏wiki获取素材并制作。Chinese card images of sultan's game.☆14Jun 17, 2025Updated last year
- A Benchmark for Failure Detection under Distribution Shifts in Image Classification☆36Oct 19, 2024Updated last year
- 基于ncnn的android端的enet分割☆17Mar 29, 2020Updated 6 years ago
- Unofficial docker wrapper for Qualcomm SNPE(Snapdragon Neural Processing Engine) SDK☆12Mar 3, 2022Updated 4 years ago
- ☆15Apr 15, 2022Updated 4 years ago
- 演示go命令行嵌入前端资源☆16Feb 9, 2021Updated 5 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- A thread-safe collections for memory/disk queues (FIFO), stacks (LIFO) and priority by Go.☆12May 28, 2022Updated 4 years ago
- 魔兽争霸改键工具,支持鼠标改键,内涵全局钩子源码☆15Sep 3, 2015Updated 11 years ago
- A handy local disk based cache for hot content from remote storage.☆15Aug 4, 2023Updated 3 years ago
- ☆12Aug 16, 2018Updated 8 years ago
- ☆44Jan 25, 2024Updated 2 years ago
- The predecessor of CiteLab.☆18Feb 3, 2026Updated 7 months ago
- ☆20Sep 28, 2024Updated 2 years ago
- 尝试作为手机助手植入到手机内运行的 ncnn llm☆17Dec 24, 2025Updated 9 months ago
- HayLM是专门为儿童训练的大模型，通过对InternLM的训练和微调，结合儿童心理学、教育学以及对话风格的数据训练，实现与儿童的智能互动，并在交流过程中不断学习和适应用户特性，成为一个伴随儿童成长的虚拟朋友。☆16Feb 5, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Code and models for the paper Shape-Texture Debiased Neural Network Training (ICLR 2021)☆112Aug 4, 2023Updated 3 years ago
- 🐱 ncnn int8 模型量化评估☆14Oct 10, 2022Updated 3 years ago
- Call ncnn from Fortran☆18Dec 18, 2022Updated 3 years ago
- 📍 Official repository of paper "ProtoCLIP: Prototypical Contrastive Language Image Pretraining" (IEEE TNNLS 2023)☆56Nov 8, 2023Updated 2 years ago
- SCOPE ICLR 2025☆23Oct 3, 2025Updated 11 months ago
- ☆29Feb 6, 2018Updated 8 years ago
- MegEngine build with cu11x☆17Mar 13, 2023Updated 3 years ago