A high-throughput and memory-efficient inference and serving engine for LLMs
☆12Nov 14, 2025Updated 11 months ago
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models☆23Mar 15, 2024Updated 2 years ago
- ☆11Dec 26, 2025Updated 10 months ago
- Zen-NAS, a lightning fast, training-free Neural Architecture Searching algorithm☆11Nov 12, 2021Updated 4 years ago
- Model optimizer used in Adlik.☆42May 23, 2023Updated 3 years ago
- Training autonomous vehicles with Augmented Random Search algorithm in the Carla driving simulator. Flatiron Capstone Project.☆11Aug 22, 2023Updated 3 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ☆39Jun 14, 2023Updated 3 years ago
- This projects aims to show how whisper model can be fine-tuned on language it was not trained but is trained on similar language to it.☆11May 10, 2024Updated 2 years ago
- ☆26Jul 30, 2024Updated 2 years ago
- 基于鼠标键盘操作的微信自动聊天机器人☆13Nov 26, 2024Updated last year
- ROS 2 packages for BRNE social naviagtion☆28Mar 21, 2024Updated 2 years ago
- 一个分布式的高性能Word2Vec实现☆15May 2, 2015Updated 11 years ago
- 微信AI内容创作智能体，可自动完成信息爬取、内容整理、排版及草稿推送。涵盖Kaggle竞赛、HuggingFace论文以及ProductHunt产品资讯。☆16Aug 3, 2025Updated last year
- ☆27Sep 29, 2026Updated last month
- Various Vector Similarity Search examples☆13Dec 30, 2022Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- AmphionASR: Personalized Context-Aware Speech Recognition☆13Jul 28, 2026Updated 3 months ago
- Various items related to running linux on a Lenovo Yoga c630.☆11Dec 18, 2020Updated 5 years ago
- 杂物，不维护，没文档，不保证能用☆10Aug 1, 2022Updated 4 years ago
- PureWeber 2015 Summer Web class☆13Sep 27, 2015Updated 11 years ago
- ☆15May 20, 2023Updated 3 years ago
- ROS2 packages for Unitree G1 Humanoid☆13Feb 5, 2026Updated 8 months ago
- Random snippets based on tensorflow☆10Jan 22, 2016Updated 10 years ago
- Evaluate gpt-4o on CLIcK (Korean NLP Dataset)☆20May 18, 2024Updated 2 years ago
- Rust version of nomadcoin (https://github.com/nomadcoders/nomadcoin)☆12May 15, 2022Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 图像滤镜处理组件☆14Aug 28, 2015Updated 11 years ago
- ☆12Jan 30, 2016Updated 10 years ago
- A package for filtering sensitive data (parameters, keys) from a variety of JS objects☆10Oct 23, 2026Updated last week
- 纯c++的全平台llm加速库，支持python调用， 支持chatglm-6B, llama, baichuan, moss基座，x86 / ARM☆13Aug 21, 2026Updated 2 months ago
- "프로그래밍 러스트: 빠르고 안전한 시스템 개발, 개정2판" 예제 코드☆18Dec 11, 2023Updated 2 years ago
- 一些书的源码☆13Sep 13, 2017Updated 9 years ago
- 女声优拼音缩写查询☆18Oct 8, 2026Updated 3 weeks ago
- Bootstrap 5 tutorial with Gulp, Sass, BrowserSync, and Vanilla JS☆13Jun 1, 2021Updated 5 years ago
- Fanbox Batch Downloader on browser userscript☆17Mar 13, 2022Updated 4 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- 5월 원티드 프리온보딩 Flutter 사전 과제☆13Apr 17, 2024Updated 2 years ago
- A Python library for controlling AlphaDog robotic dogs.☆12Apr 16, 2026Updated 6 months ago
- Developing a long/short equity investment portfolio with Machine Learning predictions using data acquired from web-scraping. Flatiron Mod…☆40Jan 4, 2021Updated 5 years ago
- おはなしジェネレーター for アイドルマスターミリオンライブ！☆14Apr 27, 2016Updated 10 years ago
- Research project leveraging Abstract Syntax Trees and Knowledge Graphs with Retrieval-Augmented Generation to develop an advanced, contex…☆13Jul 18, 2024Updated 2 years ago
- 这是一个网页展示slide + 实时弹幕评论系统。☆18Jul 21, 2015Updated 11 years ago
- This is the PeerSim simulation branch for P2PSP. Its purpose is to simulate practical conditions with large sets of clients in order to o…☆20Sep 8, 2022Updated 4 years ago