Adlik / vllmView external linksLinks
A high-throughput and memory-efficient inference and serving engine for LLMs
☆12Nov 14, 2025Updated 2 months ago
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below
Sorting:
- [ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models☆23Mar 15, 2024Updated last year
- Model optimizer used in Adlik.☆42May 23, 2023Updated 2 years ago
- This projects aims to show how whisper model can be fine-tuned on language it was not trained but is trained on similar language to it.☆11May 10, 2024Updated last year
- Vision-Language Models Toolbox: Your all-in-one solution for multimodal research and experimentation☆12Feb 16, 2025Updated 11 months ago
- ☆38Jun 14, 2023Updated 2 years ago
- ☆24Jun 19, 2025Updated 7 months ago
- ☆22Dec 23, 2025Updated last month
- ☆22Dec 11, 2025Updated 2 months ago
- Zen-NAS, a lightning fast, training-free Neural Architecture Searching algorithm☆11Nov 12, 2021Updated 4 years ago
- [AAAI 2026] Official Code for VQAThinker: Exploring Generalizable and Explainable Video Quality Assessment via Reinforcement Learning☆19Nov 28, 2025Updated 2 months ago
- Remote sensing labwork☆12Feb 27, 2018Updated 7 years ago
- ☆13May 17, 2025Updated 8 months ago
- Official Code for "Painting with Words: Elevating Detailed Image Captioning with Benchmark and Alignment Learning" (ICLR 2025)☆12Mar 6, 2025Updated 11 months ago
- Official training code for MUG-V 10B video generation model. Built on Megatron-LM (v0.14.0) with production-ready distributed training fo…☆19Oct 20, 2025Updated 3 months ago
- F-16 is a powerful video large language model (LLM) that perceives high-frame-rate videos, which is developed by the Department of Electr…☆34Jul 3, 2025Updated 7 months ago
- Search, download Vimeo videos and retrieve metadata in Go.☆11Feb 10, 2022Updated 4 years ago
- Image Text Segmentation using FAST corner detection and DBSCAN clustering with k-d tree data structure☆13Feb 27, 2019Updated 6 years ago
- 纯c++的全平台llm加速库，支持python调用，支持chatglm-6B, llama, baichuan, moss基座，x86 / ARM☆12Jan 30, 2026Updated 2 weeks ago
- For Recording Showroom Streaming Video☆23Dec 11, 2025Updated 2 months ago
- Expose a server running on your local machine to the internet, like Ngrok, based on Netty☆14Jun 1, 2021Updated 4 years ago
- 杂物，不维护，没文档，不保证能用☆11Aug 1, 2022Updated 3 years ago
- ☆13Feb 18, 2023Updated 2 years ago
- [ICLR 2023] PyTorch code for DFPC: Data flow driven pruning of coupled channels without data.☆15Aug 25, 2023Updated 2 years ago
- ☆11Dec 8, 2022Updated 3 years ago
- おはなしジェネレーター for アイドルマスターミリオンライブ！☆14Apr 27, 2016Updated 9 years ago
- 基于鼠标键盘操作的微信自动聊天机器人☆13Nov 26, 2024Updated last year
- Various items related to running linux on a Lenovo Yoga c630.☆11Dec 18, 2020Updated 5 years ago
- [EMNLP'2024 Findings] Explore generated documents for enhanced IR with LLMs. We enhance BM25 to surpass strong dense retriever on many da…☆15Mar 28, 2025Updated 10 months ago
- ☆13Jun 5, 2024Updated last year
- Lightweight piece tokenization library☆12Apr 15, 2024Updated last year
- frame is an open source portifolio builder for developers where developers can add and manage their information, project, articles and mo…☆14Dec 24, 2024Updated last year
- ☆15Nov 21, 2025Updated 2 months ago
- ☆11Jan 8, 2025Updated last year
- AI Router☆14Aug 1, 2024Updated last year
- A dataset with classified film shots☆11Aug 8, 2022Updated 3 years ago
- Keras Filter Response Normalization Layer.☆15Mar 30, 2020Updated 5 years ago
- SDK for developing motion control software on WeiLan Dev series robots.☆18Nov 25, 2025Updated 2 months ago
- 一些书的源码☆13Sep 13, 2017Updated 8 years ago
- Multi-temporal Scene dataset for Scene Change Detection.☆15Apr 14, 2021Updated 4 years ago