A high-throughput and memory-efficient inference and serving engine for LLMs
☆12Nov 27, 2023Updated 2 years ago
Alternatives and similar repositories for vllm
Users that are interested in vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.☆10Mar 2, 2022Updated 4 years ago
- A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training☆20Apr 26, 2022Updated 4 years ago
- Finetune Your Local LLM☆18Sep 23, 2023Updated 3 years ago
- ☆12Mar 30, 2025Updated last year
- Instantly host your AI-generated portfolio! 👑 Pharaohfolio lets you paste HTML/CSS/JS code from any AI assistant (ChatGPT, Claude, Gemin…☆12Jul 10, 2026Updated 3 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- 义务教育阶段 教科书 整理收集☆16Jan 20, 2024Updated 2 years ago
- Agentic AI Software Engineer that can convert natural language to executable code☆12Aug 10, 2024Updated 2 years ago
- Code for the paper: Proving Theorems Recursively☆12May 23, 2024Updated 2 years ago
- Codebase for fine-tuning Llama2 70B to generate math test questions and answers.☆10Aug 30, 2024Updated 2 years ago
- Codebase for paper titled: "Using Machine and Deep Learning Models, On-Chain Data, and Technical Analysis for Predicting Bitcoin Price Di…☆11Mar 20, 2025Updated last year
- This library supports evaluating disparities in generated image quality, diversity, and consistency between geographic regions.☆20Jun 3, 2024Updated 2 years ago
- LTP: Megatron-LM component☆15Sep 3, 2026Updated last month
- High quality icons that are easy to use with Bootstrap, other CSS frameworks and in any web projects.☆12Aug 12, 2013Updated 13 years ago
- An efficient LinkedIn Messaging Bot that Messages a group of interests, YouTube link in Documentation for guidance.☆12Aug 25, 2021Updated 5 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Ember addon for rAF batching Reads and Writes (replacement for ember-spaniel utils)☆13Mar 6, 2023Updated 3 years ago
- ☆14Nov 30, 2022Updated 3 years ago
- 中国铁路 GTFS 时刻表数据☆29Updated this week
- AI Engineer Skills Beginners Project 1 - Chat with YouTube☆13Nov 6, 2023Updated 2 years ago
- Template project for Go libraries.☆15Updated this week
- Multi-agent orchestration for OllamaJS. Includes TTS synthesis and speech recognition for simplified testing. Connected to telegram bot w…☆13Feb 13, 2025Updated last year
- Source for the application in the CodeTV Nginx series☆10Sep 17, 2013Updated 13 years ago
- Genie in the Box: Distill Whisper STT => Mistral-7B => Phind/Phind-CodeLlama-34B-v2 => GPT 3.5 => Coqui's TTS/OpenAI TTS☆15Apr 24, 2024Updated 2 years ago
- Copy browser tabs to (and create browser tabs from) your clipboard.☆13Oct 23, 2026Updated last week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- advanced code generator for John the Ripper☆13May 6, 2018Updated 8 years ago
- Very lightweight css grid☆15Dec 28, 2013Updated 12 years ago
- Your friendly investment advisor has now turned into an LLM chatbot!☆15Mar 24, 2024Updated 2 years ago
- Video Frame data structures, originally part of rav1e☆19Aug 2, 2026Updated 2 months ago
- Design assets and documentation☆17Oct 9, 2026Updated 3 weeks ago
- Small footprint and configurable NVMe core.☆20Jul 14, 2026Updated 3 months ago
- 8-bit Atari XL/XE platform emulator☆10May 1, 2024Updated 2 years ago
- ☆13Jul 6, 2026Updated 3 months ago
- An ember-cli-deploy-plugin to upload an Ember App directly to a CouchDB cluster.☆13Nov 1, 2020Updated 6 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- exercise for transformers-benchmarks, add 3090 benchmark☆13Feb 3, 2023Updated 3 years ago
- HTTP/S Service Monitor Script This Bash script periodically monitors the availability and content of web services (HTTP/HTTPS) specified…☆15Sep 29, 2025Updated last year
- Helper tools for developing ember-animated motions☆17Apr 29, 2024Updated 2 years ago
- Free and open fair-code licensed node based Workflow Automation Tool. Easily automate tasks across different services.☆11Jun 30, 2021Updated 5 years ago
- Run shell command through HTTP.☆15Oct 16, 2014Updated 12 years ago
- ☆10Oct 1, 2023Updated 3 years ago
- ☆11Apr 17, 2023Updated 3 years ago