A high-throughput and memory-efficient inference and serving engine for LLMs
☆30May 12, 2025Updated last year
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆17May 19, 2022Updated 4 years ago
- ☆16Aug 4, 2024Updated last year
- A small library that wraps Keras models to pickle them.☆14Jul 17, 2018Updated 8 years ago
- PyTorch implementation of our CVPR2023 paper "OpenMix: Exploring Out-of-Distribution samples for Misclassification Detection"☆28Oct 16, 2023Updated 2 years ago
- A Telegram bot to download media from Twitter URLs sent to it☆11Updated this week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- CLI to download wallpapers and lock screens from 500px website.☆11Feb 23, 2023Updated 3 years ago
- spark-simrank scala☆17Jan 19, 2017Updated 9 years ago
- 利用文字信息生成文字动画视频☆17Apr 14, 2022Updated 4 years ago
- a simple asr system☆14Mar 8, 2018Updated 8 years ago
- PyTorch implementation of our ECCV 2022 paper "Rethinking Confidence Calibration for Failure Prediction"☆26Jun 10, 2023Updated 3 years ago
- ☆21Apr 13, 2022Updated 4 years ago
- 批量下载微博高清原图的代码，本代码用Python写的，需要电脑预装Python。☆11Feb 8, 2022Updated 4 years ago
- Awesome Resources about MegEngine☆16Mar 2, 2023Updated 3 years ago
- Fully open reproduction of DeepSeek-R1☆11Mar 24, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- catch weibo photo data☆13Jun 15, 2023Updated 3 years ago
- Real-time AI video segmentation of USB camera and streaming over HTTP☆13Apr 23, 2025Updated last year
- AI CHALLENGER 全球AI挑战赛 图像中文描述☆18Jan 19, 2018Updated 8 years ago
- ☆10Mar 24, 2024Updated 2 years ago
- Implementation of HAN for Sentiment Classification task from paper "Hierarchical Attention Networks for Document Classification"☆13Aug 5, 2019Updated 6 years ago
- 知乎图片下载小助手（抓取指定问题下的所有回答中的图片）/a tiny spider for crawling image of zhihu.com(espcially by Question/Favorite organized)☆12Sep 20, 2020Updated 5 years ago
- 小红书数据采集、小红书素材下载工具，支持文本、图片(原高清图片)、原视频 等素材下载，是一款完全免费、超好用、高颜值且安全的素材收集工具，支持批量下载☆15Jul 13, 2026Updated 2 weeks ago
- 基于ncnn的android端的enet分割☆17Mar 29, 2020Updated 6 years ago
- ☆15Apr 15, 2022Updated 4 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Parallel multiple login for any websites.☆16Sep 8, 2025Updated 10 months ago
- 抖音视频下载工具 💁 支持个人主页链接、作品分享链接、 抖音直播Web链接、合集链接、音乐(原声)集合链接 🔽 支持单个作品下载、主页作品下载、主页喜欢下载、 直播解析、单个合集下载、主页所有合集下载、 音乐(原声)集合下载☆19Aug 15, 2024Updated last year
- ncnn is a high-performance neural network inference framework optimized for the mobile platform☆14May 20, 2022Updated 4 years ago
- ☆20Sep 28, 2024Updated last year
- 尝试作为手机助手植入到手机内运行的 ncnn llm☆15Dec 24, 2025Updated 7 months ago
- Winning solution for ESRI Data Science Challenge 2019 - Hacker Earth☆27Oct 16, 2019Updated 6 years ago
- NVIDIA VCR - VR Capture and Replay, a set of tools to capture, modify, and replay OpenVR sessions☆26Dec 10, 2024Updated last year
- 🔥【XHS采集服务】支持API、代码调用和命令行下载，采集方法完全解耦，可扩展、集成☆19Jan 27, 2026Updated 6 months ago
- ☆21Jun 10, 2020Updated 6 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A Modern Configuration/Registry System designed for deeplearning, with some utils.☆18Apr 27, 2026Updated 3 months ago
- 🐱 ncnn int8 模型量化评估☆14Oct 10, 2022Updated 3 years ago
- Jax implementation of VIT-VQGAN☆10Jan 25, 2024Updated 2 years ago
- MegEngine build with cu11x☆17Mar 13, 2023Updated 3 years ago
- 有关末日三问及其衍生作品的AIGC项目目录 AIGC Projects related to Sukasuka series☆20Sep 25, 2023Updated 2 years ago
- Unofficial Instagram API in Python.☆23Nov 11, 2022Updated 3 years ago
- 2018年7⽉30⽇-8⽉13⽇持续2周的好未来AI训练营中语⾳情感识别营的项目报告☆33Dec 28, 2018Updated 7 years ago